The deepest natural caves known to man are the Pierre St. Martin Caves in the Pyrenees Mountains between Spain and France, which reach 4,370 feet deep, almost three times as deep as the Empire State Building is high!