Americans sure like to exercise, but they are not overly concerned about working out their brains, a new poll finds.

While most people think it is possible to improve brain fitness, only 3% of those 42 years and older consider brain health the most important issue for people their age. This information comes from “Attitudes and Awareness of Brain Health,” a poll commissioned by the American Society on Aging (ASA), with support from MetLife Foundation.

Also, most Americans think their memory is excellent or good. But people aged 42-49 worry about their memory seven years earlier than people who are 50 and older. The poll also found that most people don’t talk to their health professionals about memory concerns.