• The Stochastic Complexity of Spin Models
  • View times: 9
  • |
  • Release time: 2021-11-03
  • statistical inference
  • model complexity
  • minimum description length
Video Introduction

Models can be simple for different reasons: because they yield a simple and computationally efficient interpretation of a generic dataset (e.g., in terms of pairwise dependencies)—as in statistical learning—or because they capture the laws of a specific phenomenon—as e.g., in physics—leading to non-trivial falsifiable predictions. In information theory, the simplicity of a model is quantified by the stochastic complexity, which measures the number of bits needed to encode its parameters. In order to understand how simple models look like, authors study the stochastic complexity of spin models with interactions of arbitrary order. Authors show that bijections within the space of possible interactions preserve the stochastic complexity, which allows to partition the space of all models into equivalence classes. They thus found that the simplicity of a model is not determined by the order of the interactions, but rather by their mutual arrangements. Models where statistical dependencies are localized on non-overlapping groups of few variables are simple, affording predictions on independencies that are easy to falsify. On the contrary, fully connected pairwise models, which are often used in statistical learning, appear to be highly complex, because of their extended set of interactions, and they are hard to falsify. 

Full Transcript


Are you sure to Delete?
If you have any further questions, please contact Encyclopedia Editorial Office.
Mulatier, C.D.; Battistin, C.; Marsili, M. The Stochastic Complexity of Spin Models. Encyclopedia. Available online: https://encyclopedia.pub/video/video_detail/110 (accessed on 25 June 2022).
Mulatier CD, Battistin C, Marsili M. The Stochastic Complexity of Spin Models. Encyclopedia. Available at: https://encyclopedia.pub/video/video_detail/110. Accessed June 25, 2022.
Mulatier, Clelia De, Claudia Battistin, Matteo Marsili. "The Stochastic Complexity of Spin Models," Encyclopedia, https://encyclopedia.pub/video/video_detail/110 (accessed June 25, 2022).
Mulatier, C.D., Battistin, C., & Marsili, M. (2021, November 03). The Stochastic Complexity of Spin Models. In Encyclopedia. https://encyclopedia.pub/video/video_detail/110
Mulatier, Clelia De, et al. ''The Stochastic Complexity of Spin Models.'' Encyclopedia. Web. 03 November, 2021.