While Voldemort was crippled (before he got his body back, so start of Goblet of Fire) Wormtail fed him a potion consisting of unicorn blood and nagini's venom.

Both obviously effected him as unicorns blood is cursed and well Nagini is a snake. Therefore e was cursed to forever have a nose like a snake!!

~District_Gryffindor