Least squares

From Glossary of Meteorology

least squares

Any procedure that involves minimizing the sum of squared differences.

For example, the deviation of the mean from the population is less, in the square sense, than any other linear combination of the population values. This procedure is most widely used to obtain the constants of a representation of a known variable Y in terms of others Xi. Let Y(s) be represented by
The an's are the constants to be determined, the fn's are arbitrary functions, and s is a parameter common to Y and Xi. N is usually far less than the number of known values of Y and Xi. The system of equations being overdetermined, the constants an must be "fitted." The least squares determination of this "fit" proceeds by summing, or integrating when Y and Xi are known continuously,
and minimizing the sum with respect to the an's. In particular, for example, if fn[Xi(s)] ≡ Xi(s), then the regression function is being determined; and when fn[Xi(s)] ≡ cos n'Xi(s), or sin n'Xi(s), then Y is being represented by a multidimensional Fourier series. Least squares is feasible only when the unknown constants an enter linearly. The method of least squares was described independently by Legendre in 1806, Gauss in 1809, and Laplace in 1812.

Copyright 2022 American Meteorological Society (AMS). For permission to reuse any portion of this work, please contact permissions@ametsoc.org. Any use of material in this work that is determined to be “fair use” under Section 107 of the U.S. Copyright Act (17 U.S. Code § 107) or that satisfies the conditions specified in Section 108 of the U.S.Copyright Act (17 USC § 108) does not require AMS’s permission. Republication, systematic reproduction, posting in electronic form, such as on a website or in a searchable database, or other uses of this material, except as exempted by the above statement, require written permission or a license from AMS. Additional details are provided in the AMS Copyright Policy statement.