Foundation Models
Modern AI models that execute specific tasks in a single domain are giving way to ones that learn more generally, and work across domains and problems. Foundation models, which are trained on large, unlabeled datasets and fine-tuned for an array of applications, are driving this shift.
Overview
Modern AI models can learn from millions of examples to help find new solutions to difficult problems. But building new systems tends to take time — and lots of data. The next wave in AI will replace task-specific models with ones that are trained on a broad set of unlabeled data that can be used for different tasks — with minimal fine-tuning. These are called foundation models. They can be the foundation for many applications of the AI model. Using self-supervised learning and fine-tuning, the model can apply information it has learned in general to a specific task.
We believe that foundation models will dramatically accelerate AI adoption in business. Reducing time spent labeling data and programming models will make it much easier for businesses to dive in, allowing more companies to deploy AI in a wider range of mission-critical situations. Our goal is to bring the power of foundation models to every enterprise in a frictionless hybrid-cloud environment. Learn more about foundation models
Our work
AI transformers shed light on the brain’s mysterious astrocytes
ResearchKim Martineau- AI
- Foundation Models
- Life Sciences
- Machine Learning
- Natural Language Processing
- Science
IBM and NASA open source the largest geospatial AI foundation model on Hugging Face
NewsKim Martineau- Accelerated Discovery
- AI
- Climate
- Distributed Systems
- Foundation Models
- Hybrid Cloud
- Scaling AI
Did an AI write that? If so, which one? Introducing the new field of AI forensics
ExplainerKim Martineau- Adversarial Robustness and Privacy
- AI
- Explainable AI
- Foundation Models
- Generative AI
- Trustworthy AI
Researchers validate a new class of AI-generated Covid antivirals
NewsKim Martineau- Accelerated Discovery
- AI
- Foundation Models
- Generative AI
- Trustworthy AI
AI diffusion models can be tricked into generating manipulated images
NewsKim Martineau- AI
- AI Testing
- Data and AI Security
- Foundation Models
- Generative AI
- Security
A cloud-native, open-source stack for accelerating foundation model innovation
Technical noteTalia Gershon, Priya Nagpurkar, Carlos Costa, and Darrell Reimer- AI
- Foundation Models
- Hybrid Cloud
- See more of our work on Foundation Models
Publications
- Arindam Jati
- Vijay E
- et al.
- 2023
- KDD 2023
- Pin-Yu Chen
- Chao-han Huck Yang
- et al.
- 2023
- INTERSPEECH 2023
- Hao Yen
- Pin-jui Ku
- et al.
- 2023
- INTERSPEECH 2023
- Shreyas Basavatia
- Shivam Ratnakar
- et al.
- 2023
- IJCAI 2023
- Dirk Fahland
- Fabiana Fournier
- et al.
- 2023
- IJCAI 2023
- Turguy Caglar
- Sirine Belhaj
- et al.
- 2023
- IJCAI 2023