Residents in one small town have complained of anti-social behaviour that's left them scared to leave their house after 6pm.