I wouldn't say that materials from a particular element are generally easier to dig out. I think it's pretty relative. It matters how many knuffel you have that can dig in a particular element. If you have 5 Earth knuffs maxed in Earth, they will have more success of finding Earth rare mats more often than any knuffel that has been maxed in two or more elements (including Earth, for this example). If you have 10 Darkness knuffs, all maxed in Darkness and 5 Earth knuffs maxed in Earth, it is only logical that you will dig up more of the Rare Darkness mats and not Earth rare mats.
For example I have little Fire knuffs, (I evened it out a bit, but still) and for this reason I'm really struggling with Fire mats, generally speaking (not with all of them though).
But an other user may have a completely different situation.
Another factor might be that the rarity groups of materials probably have in-group rarities as well, that's why for most of us it is hard to get the Groundsels or Cherry Blossoms, even though they are Average mats and we happen to dig out more Green Diamonds instead
I feel like I complictaed it too much ;>_>