Space/Science — HabitableZone

Space/Science » in reply to Re: Floating point errors

It's the iterations that do the damage.

A model that runs on a supercomputer for 200 days will likely perform untold billions of calculations (maybe trillions or even quadrillions). Using standard floating-point datatypes can lead to significant errors by accumulation over all of those iterations. Even an error at the 15th decimal point can accumulate to an error at the whole number level when you're talking about that many iterations.

Log in or register to post.

The whole thread (29 posts)