Techniques of replica symmetry breaking and the storage problem of the McCulloch-Pitts neuron

DOI10.1016/S0370-1573(00)00073-9zbMath1001.82535arXivcond-mat/0010025OpenAlexW2031995004MaRDI QIDQ1595743

Géza Györgyi

Publication date: 13 February 2001

Published in: Physics Reports (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/cond-mat/0010025

zbMATH Keywords

differential equationsGreen functionstatistical mechanical description

Mathematics Subject Classification ID

Learning and adaptive systems in artificial intelligence (68T05) Neural networks for/in biological studies, artificial life and related topics (92B20) Neural nets applied to problems in time-dependent statistical mechanics (82C32)

Related Items (4)

Out-of-equilibrium dynamical mean-field equations for the perceptron model ⋮ Unboundedness and periodicity of solutions for a discrete-time network model of three neurons ⋮ Transitive group structure for the one-body Keplerian problem ⋮ Critical properties of the SAT/UNSAT transitions in the classification problem of structured data

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Optimization by Simulated Annealing
• Some rigorous results on the Sherrington-Kirkpatrick spin glass model.
• Bounds on the learning capacity of some multi-layer networks
• Gibbs states of the Hopfield model with extensively many patterns.
• Multilayer feedforward networks are universal approximators
• The replica-symmetric solution without replica trick for the Hopfield model
• The existence of persistent states in the brain
• Replica symmetry breaking and the nature of the spin glass phase
• ABOUT THE OVERLAP DISTRIBUTION IN MEAN FIELD SPIN GLASS MODELS
• Performance of robust training algorithms for neural networks
• Phase transitions in the generalization behaviour of multilayer neural networks
• Random-energy model: An exactly solvable model of disordered systems
• Retrieval phase diagrams for attractor neural networks with optimal interactions
• Die Lernmatrix
• Fractal measures and their singularities: The characterization of strange sets
• The roles of stability and symmetry in the dynamics of neural networks
• Computational limitations on learning from examples
• General properties of overlap probability distributions in disordered spin systems. Towards Parisi ultrametricity
• Derivation of Hebb's rule
• Parallel dynamics of the neural network with the pseudoinverse coupling matrix
• Finite-size effects and bounds for perceptron models
• Modeling Brain Function
• Storage capacity of the fully-connected committee machine
• Threshold-induced phase transitions in perceptrons
• Storage capacities of committee machines with overlapping and non-overlapping receptive fields
• An exact learning algorithm for autoassociative neural networks with binary couplings
• Storage capacity of a fully-connected parity machine with continuous weights
• A new simple version of the replica method
• Statistical Field Theory
• Learning the unlearnable
• Optimal capacity of graded-response perceptrons: a replica-symmetry-breaking solution
• Replica-symmetry breaking in perceptrons
• Correlation of internal representations in feed-forward neural networks
• Weight space structure and generalization in the reversed-wedge perceptron
• Observation of a hexatic vortex glass in flux lattices of the high-<mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" display="inline"><mml:mrow><mml:msub><mml:mrow><mml:mi mathvariant="italic">T</mml:mi></mml:mrow><mml:mrow><mml:mi mathvariant="italic">c</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:math>superconductor<mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" display="inline"><mml:mrow><mml:msub><mml:mrow><mml:mi mathvariant="normal">Bi</mml:mi></mml:mrow><mml:mrow><mml:…
• Stochastic Tunneling Approach for Global Minimization of Complex Potential Energy Landscapes
• From shrinking to percolation in an optimization model
• Optimal storage of a neural network model: a replica symmetry-breaking solution
• Learning and retrieval in attractor neural networks above saturation
• Ginzburg - Landau theory of the cluster glass phase
• Maximal stability in unsupervised learning
• Explicit symmetries and the capacity of multilayer neural networks
• Replica symmetry instability in perceptron models
• Low-temperature properties of directed walks with random self interactions
• Fluctuations and thermodynamic variables in mean field spin glass models
• The replica-symmetry-breaking solution of the Hopfield model at zero temperature: critical storage capacity and frozen field distribution
• Block diagonalizing ultrametric matrices
• Tricritical points in random combinatorics: the -SAT case
• The statistical mechanics of constructive algorithms
• Neural networks and physical systems with emergent collective computational abilities.
• Learning representations by back-propagating errors
• Neurons with graded response have collective computational properties like those of two-state neurons.
• The space of interactions in neural network models
• Enumeration of Seven-Argument Threshold Functions
• On the rotation operators in quantum mechanics
• The partial differential equation u_t + uu_x = μ_xx
• On a quasi-linear parabolic equation occurring in aerodynamics
• A logical calculus of the ideas immanent in nervous activity
• Beyond storage capacity in a single model neuron: Continuous replica symmetry breaking

This page was built for publication: Techniques of replica symmetry breaking and the storage problem of the McCulloch-Pitts neuron