What is Multimodal?
A model that processes multiple types of information: text, images, audio, or video.
// Explanation
The first LLMs only understood text. Multimodal models can also see images, listen to audio, and even analyze video. GPT-4o, Gemini 2.5 Pro, and Claude 3.5 Sonnet are multimodal. This makes them far more versatile for real-world tasks.
// Example
You send a photo of your grocery receipt and say 'tell me how much I spent on drinks'. A multimodal model reads it and gives you the number.