Research shows that memory loss can begin as early as your 20s, and it continues as you age. Thankfully, taking a few easy steps throughout your day can help you stay sharp. When you eat a heart-healthy diet that is low in saturated fat, you reduce your risk for high blood pressure, diabetes, and obesity, all of which are believed to contribute to memory loss.