So how young is too young for kids’ swimming lessons? According to the American Academy of Pediatrics (AAP), children under four years of age shouldn’t take formal swimming lessons because they can’t yet voluntarily hold their breath for a significant length of time.