Abstract: Advancing Multimodal AI for Integrated Understanding and Generation explores the transformative potential of multimodal artificial intelligence (AI), which integrates diverse data types such ...

Microsoft Corp. today expanded its Phi line of open-source language models with two new algorithms optimized for multimodal processing and hardware efficiency. The first addition is the text-only ...

Manzano combines visual understanding and text-to-image generation, while significantly reducing performance or quality trade-offs.

Google’s Gemini 2.0 represents a significant advancement in multimodal artificial intelligence, offering a versatile API that transforms user interactions with AI systems. By supporting text, voice, ...

Sept. 9, 2024 — Forty percent of generative AI (GenAI) solutions will be multimodal (text, image, audio and video) by 2027, up from 1% in 2023, according to Gartner, Inc. This shift from individual to ...

French AI startup Mistral has dropped its first multimodal model, Pixtral 12B, capable of processing both images and text. The 12-billion-parameter model, built on Mistral’s existing text-based model ...

Apple's researchers continue to focus on multimodal LLMs, with studies exploring their use for image generation, ...

Artificial intelligence voice assistants are giving way to multimodal interfaces that offer small businesses the ability to streamline even more mundane tasks, so their employees can focus on more ...

As large language models (LLMs) evolve into multimodal systems that can handle text, images, voice and code, they’re also becoming powerful orchestrators of external tools and connectors. With this ...