Is this considered ual abuse?

Yes, it is considered ual abuse. But the onus of proof is on you and after so long, it may be a case of your words against his. Maybe consult a lawyer if you want to bring this case further.