A man who was in the country illegally was arrested after breaking into an elderly Mulberry woman's home and sexually battering her, according to the Polk County Sheriff's Office.