Maximum entropy analysis of oversampled data problems Article Received: 28 September 1989 Accepted: 02 January 1990 DOI :
10.1007/BF02427376

Cite this article as: Bryan, R.K. Eur Biophys J (1990) 18: 165. doi:10.1007/BF02427376
155
Citations
515
Downloads
Abstract An algorithm for the solution of the Maximum Entropy problem is presented, for use when the data are considerably oversampled, so that the amount of independent information they contain is very much less than the actual number of data points. The application of general purpose entropy maximisation methods is then comparatively inefficient. In this algorithm the independent variables are in the singular space of the transform between map (or image or spectrum) and data. These variables are much fewer in number than either the data or the reconstructed map, resulting in a fast and accurate algorithm. The speed of this algorithm makes feasible the incorporation of recent ideas in maximum entropy theory (Skilling 1989 a; Gull 1989). This algorithm is particularly appropriate for the exponential decay problem, solution scattering, fibre diffraction, and similar applications.

Key words Maximum entropy Inverse problem Dynamic light scattering

References Bricogne G (1988) A Bayesian statistical theory of the phase problem. I. Acta Crystallogr A44:517–545

MathSciNet Google Scholar Bryan RK (1980) Maximum entropy image processing. PhD Thesis, University of Cambridge

Golub GH, van Loan CF (1983) Matrix computations. Johns Hopkins, Baltimore

Google Scholar Gull SF (1989) Developments in maximum entropy data analysis. In: Skilling J (ed) Maximum entropy and Bayesian methods. Kluwer, Dordrecht, pp 53–71

Google Scholar Gull SF, Daniell GJ (1978) Image reconstruction from incomplete and noisy data. Nature 272:686–690

CrossRef ADS Google Scholar Gull SF, Skilling J (1984) Maximum entropy method in image processing. IEE Proc 131(F):646–659

Google Scholar Hanson RJ (1971) A numerical method for solving Fredholm integral equations of the first kind. SIAM J Numer Anal 8:616–622

MathSciNet CrossRef Google Scholar Jaynes ET (1968) Prior probabilities. IEEE Trans SCC-4:227–241

Google Scholar Jaynes ET (1987) Bayesian spectrum and chirp analysis. In: Smith C Ray, Erickson GJ (ed) Maximum entropy and Bayesian spectral analysis and estimation poblems. Kluwer, Dordrecht, pp 1–37

Google Scholar Levenberg K (1944) A method for the solution of certain non-linear problems in least squares. Q Appl Math 2:164–168

MATH MathSciNet Google Scholar Livesey AK, Licinio P, Delaye M (1986) Maximum entropy analysis of quasielastic light scattering from colloidal dispersions. J Chem Phys 84:5102–5107

CrossRef ADS Google Scholar Marquardt DW (1963) An algorithm for least squares estimation of non-linear parameters. SIAM J Appl Math 11:431–441

MATH MathSciNet CrossRef Google Scholar Pollard KOB (1988) Thesis, University of Cambridge

Provencher SW (1976) An eigenfunction expansion method for the analysis of exponential decay curves. J Chem Phys 64:2772–2777

CrossRef ADS Google Scholar Provencher SW (1979) Inverse problems in polymer characterization: Direct analysis of polydispersity with photon correlation spectroscopy. Makromol Chem 180:201–209

CrossRef Google Scholar Provencher SW (1982) A constrained regularization method for inverting data represented by linear algebraic or integral equations. Comput Phys Commun 27:213–227

CrossRef ADS Google Scholar Shore JE, Johnson RW (1980) Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy. IEEE Trans IT-26:26–37. Comments and corrections. IEEE Trans IT-29:942–943

MathSciNet Google Scholar Sibisi S (1989) Regularization and inverse problems. In: Skilling J (ed) Maximum entropy and Bayesian methods. Kluwer, Dordrecht, pp 389–396

Google Scholar Skilling J (1989a) Classic maximum entropy. In: Skilling J (ed) Maximum entropy and Bayesian methods. Kluwer, Dordrecht, pp 45–52

Google Scholar Skilling J (1989b) The eigenvalues of mega-dimensional matrices. In: Skilling J (ed) Maximum entropy and Bayesian methods. Kluwer, Dordrecht, pp 455–466

Google Scholar Skilling J, Bryan RK (1984) Maximum entropy image reconstruction: general algorithm. Mon Not R Astr See 211:111–124

MATH ADS Google Scholar Slepian D (1964) Prolate spheroidal wave functions, Fourier analysis and uncertainty, IV: Extensions to many dimensions; Generalized prolate spheroidal functions. Bell Syst Tech J 43: 3009–3058

MATH MathSciNet Google Scholar Slepian D, Pollak HO (1961) Prolate spheroidal wave functions, Fourier analysis and uncertainty, I. Bell Syst Tech J 40:43–64

MATH MathSciNet Google Scholar Strand ON (1974) Theory and methods related to the singular-function expansion and Landweber's iteration for integral equations of the first kind. SIAM J Numer Anal 11:798–825

MATH MathSciNet CrossRef Google Scholar Turchin VF, Nozik VZ (1969) Statistical regularization of the solution of incorrectly posed problems. Atmos Oceanic Phys 5:14–18

Google Scholar Turchin VF, Kozlov VP, Malkevich MS (1971) The use of the mathematical statistics method in the solution of incorrectly posed problems. Sov Phys Uspekhi 13:681–703

CrossRef ADS Google Scholar Authors and Affiliations 1. Europäisches Laboratorium für Molekularbiologie Heidelberg Federal Republic of Germany 2. Laboratory of Molecular Biophysics South Parks Road United Kingdom