It???s important to note that factors such as alcohol use, exercise, lifestyle (including diet, food additives, and exposure to other toxins), stress, sexual activity, and weight loss can all have an impact on hormone levels, so there are many things men can do to help maintain hormone balance.