A healthy diet that includes fruits, vegetables, whole grains, and "healthy" fats, also helps improve memory. Include B vitamins, especially B6, B12, and folic acid, antioxidants like vitamins C and E, and beta carotene and omega-3 fatty acids in your diet.