I am a Mathematician so, yes, Maths are easy for me
It's one of those things that you either get the hang of it or you don't.
Such as languages. Yes, they are complely different subjects, but the problem is pretty much the same: if you know what the teacher is talking about then following the instructions is rather easy (not a ton of studying required) but if you don't know what the teacher is talking about then you are completely and absolutely lost, with nothing to grab that may help you to get started.
Fixing it is not easy though.
Teachers may try to present the lesson in several different ways, hoping that one resonates with you. Hoping that something will go *click* in your mind and the pieces will start falling into place as a puzzle.
But if they don't find anything that resonates with you then they are quite lost too. Because they don't find a way to "translate" what they know into something you would understand.