He wanted to be an original villain so he chopped it off. he did not know of any other villains without noses.

Unfortunately someone only told him after of the villains in the muggle world that had no noses like Red Skull resulting in his hatred of muggles.

~District_Gryffindor