I believe you must speak to the master at arms at each city/castle, i.e., Winterfell you can recruit Stark troops. You must have very good relations with that faction, however. I'm not sure what level it must be at.
Edit: according to the FAQ, you must own the fief.
WhiteWolf72
Evan joined
This member has provided no bio about themself...