Back when the loop was knew, Horace had a girlfriend names Edith. When Horace told her he is gay, she got so embarrassed that she asked Miss Peregrine to send her to another loop. Miss Peregrine said no, so Edith ran away and eventually ended up at Devil's Acre. You can imagine how awkward it must've been when they were reunited.