I am a physicist working on neural networks and machine learning. I am a member of the research staff at the MIT-IBM Watson AI Lab and IBM Research in Cambridge, MA. Prior to this, I was a member of the Institute for Advanced Study in Princeton. Broadly defined, my research focuses on the computational properties of neural networks. Particularly, I am interested in implementing ideas coming from neuroscience and physics in modern AI systems. I received a PhD in Physics from Princeton University in 2014.
Email: krotov@ibm.com
Publications, see also Google Scholar
2023
- D.Krotov, A new frontier for Hopfield networks, Nature Reviews Physics, free pdf.
- L.Kozachkov, K.Kastanenka, D.Krotov, Building transformers from neurons and astrocytes, PNAS.
- B.Hoover, Y.Liang, B.Pham, R.Panda, H.Strobelt, D.H.Chau, M.J.Zaki, D.Krotov, Energy transformer, NeurIPS 2023.
- H.Chaudhry, J.Zavatone-Veth, D.Krotov, C.Pehlevan, Long Sequence Hopfield Memory, NeurIPS 2023.
- B.Saha, D.Krotov, M.J.Zaki, P.Ram, End-to-end Differentiable Clustering with Associative Memories, ICML 2023.
- T.Bricken, X.Davies, D.Singh, D.Krotov, G.Kreiman, Sparse Distributed Memory is a Continual Learner, ICLR 2023.
- D.Krotov, Modern Hopfield Networks in AI and Neurobiology, American Physical Society March Meeting 2023.
2022
- B.Hoover, D.H.Chau, H.Strobelt, D.Krotov, A Universal Abstraction for Hierarchical Hopfield Networks, Symbiosis of Deep Learning and Differential Equations workshop, NeurIPS 2022.
- Y.Liang, D.Krotov, M.J.Zaki, Modern Hopfield Networks for graph embedding, Frontiers in Big Data.
2021
- D.Krotov, J.Hopfield, Large associative memory problem in neurobiology and machine learning, ICLR 2021.
- Y.Liang, C.K.Ryali, B.Hoover, L.Grinberg, S.Navlakha, M.J.Zaki, D.Krotov, Can a Fruit Fly Learn Word Embeddings?, ICLR 2021.
- D.Krotov, Hierarchical associative memory.
2020
2019
2018
2017
2016
2014
2011
Selected Talks
- Dense Associative Memory for Pattern Recognition, NeurIPS 2016 oral talk.
- Lecture at Introduction to Deep Learning, MIT course 6.S191, 2019.
- Fireside chat between Sepp Hochreiter and Dmitry Krotov, NeurIPS 2020.
- Seminar at Microsoft Research, 2018.
- New Technologies in Mathematics Seminar, CMSA, Harvard University, 2023.
- Institute of Advanced Research in Artificial Intelligence, 2020.
- Foundations of Machine Learning and Its Applications for Scientific Discovery in Physical and Biological Systems, NSF, Washington DC, 2022.
Our work in the news
- MIT News, AI models are powerful, but are they biologically plausible?
- Decrypt, Scientists Uncover Biological Echoes in Powerful AI Transformer Models.
- Quanta Magazine, How Transformers Seem to Mimic Parts of the Brain.
- TechCrunch, This week in AI: Amazon ‘enhances’ reviews with AI while Snap’s goes rogue.
- The New Indian Express, Making AI systems biologically plausible.
- InfoQ, Transformers Can Mock Part of Human Brain.
- Discover Magazine, Fruit Fly Brain Hacked For Language Processing.
- VentureBeat, IBM’s biology-inspired AI generates better hash codes than classical approaches.
- Neurohive, IBM Researchers Proposed New Biologically Plausible Learning Algorithm for Neural Networks.
- Datanami, Toward Biologically Plausible AI.