Thus, while heredity, sex and age have a lot to do with your cholesterol levels, they are outside your area of influence, whereas other contributing factors such as Nutrition and Diet, Weight, Physical exercise, Stress levels, and alcohol intake can well be taken care of naturally by you.