Neutral players can be shot freely inside a faction's HQ, which is quite annoying expecially since the NPCs revive you allowing you to be killed over and over.
Though it seems Neutral players can attack faction members with no penalty (the guards do react but the player keeps his gear), yet they cannot attack other Neutral players.
Neutral players can also enter faction-only areas via the world map.