I have like 10+ legions that are nothing but loyal units. I need to cut back a bit but I can't! All those units are just a pain in the ass.
If by 'cut back' you mean financially, then loyal units cost less to you than standard ones.
Or do you mean as civil war threat ?