Not so. Terminal velocity is a function of mass and wind resistance and is different for different objects. The famous penny thrown from the Empire State Building would be essentially harmless. The remnants of the balloon would also act as a streamer, thus slowing its descent.
Same sized object, different mass, same impact time. Hat tip to Galileo: https://en.wikipedia.org/wiki/Galileo's_Leaning_Tower_of_Pisa_experiment
Related - an object dropped through air from a sufficient height will reach a steady speed, called the terminal velocity, when the aerodynamic drag force pushing up on the body balances the gravitational force.
Hitting the ground from 20k, 30k, 40k, 50k, 60k would be the same for the same object, with the same volume, because the terminal velocity would be the same.