No data available.
Please log in to see this content.
You have no subscription access to this content.
No metrics data to plot.
The attempt to load metrics for this article has failed.
The attempt to plot a graph for these metrics has failed.
The full text of this article is not currently available.
Perspective: Sloppiness and emergent theories in physics, biology, and beyond
15.S. Amari and H. Nagaoka, Methods of Information Geometry, Translations of Mathematical Monographs (American Mathematical Society, 2000).
16.B. Averick, R. Carter, J. More, and G. Xue, Preprint MCS-P153-0694, Mathematics and Computer Science Division, Argonne National Laboratory, Argonne, Illinois (1992).
19.A. Atkinson, A. Donev, and R. Tobias, Optimum Experimental Designs, with SAS (Oxford University Press, UK, 2007).
20.J. M. Bernardo and A. F. M. Smith, Bayesian Theory (John Wiley & Sons, 2009), Vol.405.
21.S. Kullback, Information Theory and Statistics (Courier Corporation, 1997).
22.E. Beale, J. R. Stat. Soc. Ser. B (Methodological) 22, 41 (1960).
23.D. M. Bates and D. G. Watts, J. R. Stat. Soc. Ser. B (Methodological) 42, 1 (1980).
24.S.-i. Amari, Differential-Geometrical Methods in Statistics (Springer, 1985).
25.S.-i. Amari, O. E. Barndorff-Nielsen, R. Kass, S. Lauritzen, and C. Rao, Lecture Notes-Monograph Series, i (1987).
26.M. K. Murray and J. W. Rice, in Differential Geometry and Statistics (CRC Press, 1993), Vol. 48.
27.S.-i. Amari and H. Nagaoka, in Methods of Information Geometry (American Mathematical Society, 2007), Vol. 191.
32.M. Spivak, A Comprehensive Introduction to Differential Geometry (Publish or Perish, 1979).
33.T. Ivancevic, Applied Differential Geometry: A Modern Introduction (World Scientific Publishing Co., Inc, 2007).
34.J. Stoer, R. Bulirsch, W. Gautschi, and C. Witzgall, Introduction to Numerical Analysis (Springer-Verlag, 2002).
37.D. Bates and D. Watts, Nonlinear Regression Analysis and Its Applications (John Wiley, 1988).
41.N. Goldenfeld, Lectures on Phase Transitions and the Renormalization Group (Addison-Wesley, Advanced Book Program, Reading, 1992).
42.J. Zinn-Justin, Phase Transitions and Renormalization Group (Oxford University Press, 2007).
44.P. Kokotovic, H. K. Khali, and J. O’Reilly, in Singular Perturbation Methods in Control: Analysis and Design (SIAM, 1999), Vol. 25.
45.D. Naidu, Dynamics of Continuous Discrete and Impulsive Systems Series B 9, 233 (2002).
46.A. C. Antoulas, in Approximation of Large-Scale Dynamical Systems (SIAM, 2005), Vol.6.
49.G. Dullerud and F. Paganini, Course in Robust Control Theory (Springer-Verlag, New York, 2000).
56.A. J. Krener, Analysis and Design of Nonlinear Control Systems (Springer, 2008), pp. 41–62.
57.B. C. Daniels
and I. Nemenman
, e-print arXiv:1404.6283
68.K. Levenberg, Q. Appl. Math. 2, 164 (1944).
69.W. Press, S. A. Teukolsky, W. T. Vetterling, and B. P. Flannery, Numerical Recipes: The Art of Scientific Computing (Cambridge University Press, 2007).
73.A. Wagner, Robustness and Evolvability in Living Systems (Princeton University Press, 2005).
76.C. Thurau, K. Kersting, and C. Bauckhage, in ICDM ’09. Ninth IEEE International Conference on Data Mining, 2009 (CPS: Conference Publishing Services, Los Alamitos, CA, 2009), pp. 523–532.
78.P. Vincent, H. Larochelle, Y. Bengio, and P.-A. Manzagol, in Proceedings of the 25th International Conference on Machine Learning, ICML ’08 (ACM, New York, NY, USA, 2008), pp. 1096–1103.
79.L. X. Hayden, A. A. Alemi, and J. P. Sethna, “Information geometry of neural networks” (unpublished).
81.F. P. Casey, D. Baird, Q. Feng, R. N. Gutenkunst, J. J. Waterfall, C. R. Myers, K. S. Brown, R. A. Cerione, and J. P. Sethna, IET Syst. Biol. 1, 190 (2007).
Article metrics loading...
Large scale models of physical phenomena demand the development of new statistical and computational tools in order to be effective. Many such models are “sloppy,” i.e., exhibit behavior controlled by a relatively small number of parameter combinations. We review an information theoretic framework for analyzing sloppy models. This formalism is based on the Fisher information matrix, which is interpreted as a Riemannian metric on a parameterized space of models. Distance in this space is a measure of how distinguishable two models are based on their predictions. Sloppy model
manifolds are bounded with a hierarchy of widths and extrinsic curvatures. The manifold boundary approximation can extract the simple, hidden theory from complicated sloppy models. We attribute the success of simple effective models in physics as likewise emerging from complicated processes exhibiting a low effective dimensionality. We discuss the ramifications and consequences of sloppy models for biochemistry and science more generally. We suggest that the reason our complex world is understandable is due to the same fundamental reason: simple theories of macroscopic behavior are hidden inside complicated microscopic processes.
Full text loading...
Most read this month