Skip to Main content Skip to Navigation
Journal articles

Technical Note: Review of methods for linear least-squares fitting of data and application to atmospheric chemistry problems

Abstract : The representation of data, whether geophysical observations, numerical model output or laboratory results, by a best fit straight line is a routine practice in the geosciences and other fields. While the literature is full of detailed analyses of procedures for fitting straight lines to values with uncertainties, a surprising number of scientists blindly use the standard least squares method, such as found on calculators and in spreadsheet programs, that assumes no uncertainties in the x values. Here, the available procedures for estimating the best fit straight line to data, including those applicable to situations for uncertainties present in both the x and y variables, are reviewed. Representative methods that are presented in the literature for bivariate weighted fits are compared using several sample data sets, and guidance is presented as to when the somewhat more involved iterative methods are required, or when the standard least-squares procedure would be expected to be satisfactory. A spreadsheet-based template is made available that employs one method for bivariate fitting.
Document type :
Journal articles
Complete list of metadata

Cited literature [27 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-00304067
Contributor : Publication Egu Connect in order to contact the contributor
Submitted on : Tuesday, April 1, 2008 - 8:00:00 AM
Last modification on : Thursday, September 6, 2018 - 3:26:06 PM
Long-term archiving on: : Thursday, October 4, 2012 - 3:54:18 PM

File

acpd-8-6409-2008.pdf
Explicit agreement for this submission

Identifiers

  • HAL Id : hal-00304067, version 1

Collections

EGU | INSU

Citation

C. A. Cantrell. Technical Note: Review of methods for linear least-squares fitting of data and application to atmospheric chemistry problems. Atmospheric Chemistry and Physics Discussions, European Geosciences Union, 2008, 8 (2), pp.6409-6436. ⟨hal-00304067⟩

Share

Metrics

Les métriques sont temporairement indisponibles