Brain aging is a multifactorial process that is occurring across multiple cognitive domains. A significant complaint that occurs in the elderly is a decrement in learning and memory ability. Both rodents and zebrafish exhibit a similar problem with memory during aging. The neurobiological changes that underlie this cognitive decline are complex and undoubtedly influenced by many factors. Alterations in the birth of new neurons and neuron turnover may contribute to age-related cognitive problems. Caloric restriction is the only non-genetic intervention that reliably increases life span and healthspan across multiple organisms although the molecular mechanisms are not well-understood. Recently the zebrafish has become a popular model organism for understanding the neurobiological consequences but to date very little work has been performed. Similarly, few studies have examined the effects of dietary restriction in zebrafish. Here we review the literature related to memory decline, neurogenesis, and caloric restriction across model organisms and suggest that zebrafish has the potential to be an important animal model for understanding the complex interactions between age, neurobiological changes in the brain, and dietary regimens or their mimetics as interventions.