Skip to content
Papers.

Multimodal and robotics

Vision, video, audio, world models and robot control. 4 papers from 3 labs.

4 of 4 papers, newest first

PaperCitations
Towards Physics of Multimodal Pretraining: Knowledge Flow, Modality Synergy, Early Unification, and RecipesControlled experiments on when text, image understanding and image generation help or compete when trained together.Meta · Aug 20262
Cosmos 3: Omnimodal World Models for Physical AIOne model that reads and generates text, images, video, audio and robot actions for physical AI.NVIDIA · Jun 202690
MolmoAct2: Action Reasoning Models for Real-world DeploymentA fully open robot action model, released with new datasets including 720 hours of two-arm teleoperation.Ai2 · May 202644
Segment AnythingA promptable model and a dataset of over a billion masks that cut out any object in any image.Meta · Apr 202315.7k

Sources: each lab's own papers and arXiv, with citation and upvote counts from Semantic Scholar and Hugging Face. One-line summaries are for orientation, not a substitute for the paper. Logos via logo.dev; trademarks belong to their owners.

New papers by email

Monday afternoons, only in weeks with new papers from the labs.

Double opt-in. Unsubscribe any time.