iCreatAI News
Back to main site
Skip to content
#Video
  1. Hugging Face Blog62

    New NVIDIA Cosmos 3 Open Models for Interactive World Simulation

    NVIDIA's Cosmos world model platform adds four new open-weight checkpoints to its Cosmos 3 family: Cosmos3-Nano-Transfer-Auto for multi-view driving data with varied weather, lighting and time of day; Cosmos3-Nano-Sim-Auto for streaming synchronized camera and LiDAR driving simulation; Cosmos3-Nano-Sim-Transfer for turning simulator controls and text prompts into photorealistic video; and Cosmos3-Nano-Sim-Bimanual for predicting video from robot or camera actions. All four are post-trained examples of Cosmos 3 Nano with 16B trainable parameters and use OpenMDW1.1, permitting commercial and non-commercial use under its terms. The post also details a four-stage training recipe (bidirectional adaptation, teacher forcing, consistency distillation, self-forcing) and post-training guidance for adapting the models to new sensor rigs and embodiments.

    Why it matters: It gives a concrete inventory of newly released open-weight world-model checkpoints plus the training recipe, useful for researchers weighing them for robotics or driving simulation.

  2. Google DeepMind80

    Gemini Omni 1.2 Flash: Fast and cost-effective with longer clips

    Google DeepMind released Gemini Omni 1.2 Flash, now generally available across the Gemini API and Gemini for business, adding native 15-second video generation, multi-turn conversational editing, and stronger reference adherence. The model is priced 30% below Gemini Omni 1.1 at $0.07 per second for 720p video, with duration settable in one-second increments from 3 to 15 seconds. It also adds more natural speech and lip-sync, more controllable cinematic camera moves, and outputs carrying an imperceptible SynthID watermark.

    Why it matters: Useful for developers and creators weighing a cheaper, longer-clip video model against its stated limits on fast action and complex physics.

  1. Hacker News AI80

    Meta's Muse Realtime Avatar turns any image into a talking AI character

    Meta introduced Muse Realtime Avatar, an audio-driven Diffusion Transformer that turns reference images into expressive, interactive avatars with synchronized facial, hand, and full-body movement during live conversation. It shares Muse Realtime Voice's speech-token stream for synchronization, uses distillation to cut inference from 120 to 2 neural function evaluations per chunk (a 60x reduction), and streams 448x768 portrait video at 25 fps with roughly 870 ms latency. Meta says raters preferred it over Runway Characters and HeyGen LiveAvatar overall and across every evaluated dimension, and it embeds Meta Video Seal watermarks without added latency.

    Why it matters: It offers a detailed look at how Meta achieves real-time, low-latency avatar video generation and serving at scale, including its distillation and infrastructure techniques.

  2. TechCrunch · AI76

    Google’s Genie 4 world model adds audio, more realistic worlds, and real-time steering

    Google DeepMind released Genie 4 in research preview, a world model that generates photorealistic, interactive worlds with real-time audio and lets users type prompts mid-simulation to change scenes, weather, camera angles, or add objects. It maintains a consistent scene for up to two minutes, double Genie 3's limit, and integrates with Gemini, which plans steps while Genie creates visuals; a Gemini Robotics experiment had a Gemini 4 Argon model break tasks into steps that Genie 4 simulated in real time. Genie 4 is available now to trusted testers and will roll out in the coming weeks to Google AI Ultra subscribers in Project Genie and to early access partners of the Gemini API and Google AI Studio.

    Why it matters: It maps both Genie 4's capabilities and the consolidating world-model market, useful for readers tracking competition in interactive simulation.

You have reached the end