Residents say their lives have been a living hell due to issues at the property