Gendered nouns have been mentioned, but for me the biggest obstacle to confident German is case endings, mainly because English scarcely has them beyond pronouns (she/her/hers). 32 years after my first formal German lesson and 28 years after my last one, I know I will never have a ready and intuitive grasp of cases.