Are you saying to me that your family rep goes up if you shoot lawyers ?
This is what I meant
If you never shot other factions guards/or player in front of guards - you should be able to use their gate "freely" as your rep would be 0 or whatever.
If you did shoot them, your rep will go to negative and they'll attack you on sight.
And for a weird reason I have worse rep with two factions which aren't my main enemy.