The brother of a woman who died in a house fire which also killed a seven-year-old girl has said she was not associated with gangs.