Roundoff error

From AMS Glossary
Jump to: navigation, search


roundoff error

(Also called truncation error.) The error in a numerical computation due to the finite precision in the representation of numbers in computers.

Personal tools
Namespaces
Variants