Seminars & Colloquia Calendar
Geometry of Concept Manifolds
Haim Sompolinsky, Hebrew University and Harvard University
Date & time: Wednesday, 05 May 2021 at 10:45AM - 11:45AM
Abstract: A remarkable capability of animals and humans is invariant perception - the ability to extract abstract features, such as the identity of objects, from high-dimensional sensory streams, which are sensitive to variation in many nuisance physical variables (e.g., in the case of visual objects-orientation, pose, scale, location, and intensity). How neuronal systems give rise to invariant object classification and recognition is a fundamental problem in brain theory, as well as in machine learning. A related outstanding cognitive skill is the ability to learn new concepts or categories based on only a few examples (a property known as few-shot learning).
I will address these challenges by introducing the notion of a concept manifold, i.e., the set of all population response vectors induced by different physical instantiations of a single concept. I will discuss a recent statistical mechanics theory of concept manifolds that we developed. The theory derived new geometric measures, manifold radius and dimension, and established the relationship between them and invariant perception, focusing on two classes of tasks:
first, the capacity to categorize a large number of familiar concepts, and second, the ability to perform few-shot learning of new concepts.
We have applied our theory to illuminate the principles underlying changes in object representations across layers of artificial Deep Convolutional Neural Networks. Electrical recordings from neurons in several stages of visual cortex, responding to object and face stimuli, have been similarly analyzed, shedding light on the correspondence between artificial deep networks and the visual hierarchy in the primate brain.
Overall, this work extends the reach of statistical mechanics to important problems in information processing of high dimensional data with rich, naturalistic statistical structures.
R. Shapiro Organizer's Page
Chiara Damiolini, Ian Coley and Franco Rota -Charles Weibel Organizer's Page
Wujun Zhang Organizer's webpage
Ziming Shi, Sagun Chanillo, Xiaojun Huang, Chi Li, Jian Song Seminar website Old seminar website
Swastik Kopparty, Sepehr Assadi Seminar webpage
Jeffry Kahn, Bhargav Narayanan, Jinyoung Park Organizer's webpage
Brooke Ogrodnik, Website
Robert Dougherty-Bliss and Doron Zeilberger --> homepage
Paul Feehan, Daniel Ketover, Natasa Sesum Organizer's webpage
Lev Borisov, Emanuel Diaconescu, Angela Gibney, Nicolas Tarasca, and Chris Woodward Organizer's webpage
Jason Saied Seminar webpage
Brian Pinsky, Rashmika Goswami website
Quentin Dubroff Organizer's webpage
James Holland; Organizer website
Edna Jones Organizer's webpage
Brooke Ogrodnik website
Yanyan Li, Zheng-Chao Han, Jian Song, Natasa Sesum Organizer's Webpage
Organizer: Luochen Zhao
Yanyan Li, Zheng-Chao Han, Natasa Sesum, Jian Song Organizer's Page
Lisa Carbone, Yi-Zhi Huang, James Lepowsky, Siddhartha Sahi Organizer's webpage
Simon Thomas website
Kasper Larsen, Daniel Ocone and Kim Weston Organizer's page
Joel Lebowitz, Michael Kiessling
Yanyan Li, Haim Brezis Organizer's Webpage
Stephen D. Miller, John C. Miller, Alex V. Kontorovich, Alex Walker seminar website
Stephen D. Miller
Brooke Ogrodnik, Website
Organizers: Yanyan Li, Z.C. Han, Jian Song, Natasa Sesum
Yael Davidov Seminar webpage
Kristen Hendricks, Xiaochun Rong, Hongbin Sun, Chenxi Wu Organizer's page
Fioralba Cakoni Seminar webpage
Ebru Toprak, Organizer
Organizer's webpage: Organizer's webpage
- Show events from all categories
Special Note to All Travelers
Directions: map and driving directions. If you need information on public transportation, you may want to check the New Jersey Transit page.
Unfortunately, cancellations do occur from time to time. Feel free to call our department: 848-445-6969 before embarking on your journey. Thank you.