iCreatAI News
Back to main site
Skip to content

Technology areas

AI Video Latest updates

AI video generation and understanding: tracking text-to-video models, video editing tools, and transformations in film and television creation.

3 条精选Past 30 days: 3 updatesTotal: 59 updates

Updated

AI Video的精选

Nov 6Fri 1–3 updates
  1. Hugging Face Blog62

    New NVIDIA Cosmos 3 Open Models for Interactive World Simulation

    NVIDIA's Cosmos world model platform adds four new open-weight checkpoints to its Cosmos 3 family: Cosmos3-Nano-Transfer-Auto for multi-view driving data with varied weather, lighting and time of day; Cosmos3-Nano-Sim-Auto for streaming synchronized camera and LiDAR driving simulation; Cosmos3-Nano-Sim-Transfer for turning simulator controls and text prompts into photorealistic video; and Cosmos3-Nano-Sim-Bimanual for predicting video from robot or camera actions. All four are post-trained examples of Cosmos 3 Nano with 16B trainable parameters and use OpenMDW1.1, permitting commercial and non-commercial use under its terms. The post also details a four-stage training recipe (bidirectional adaptation, teacher forcing, consistency distillation, self-forcing) and post-training guidance for adapting the models to new sensor rigs and embodiments.

    Why it matters: It gives a concrete inventory of newly released open-weight world-model checkpoints plus the training recipe, useful for researchers weighing them for robotics or driving simulation.

  2. Google DeepMind80

    Gemini Omni 1.2 Flash: Fast and cost-effective with longer clips

    Google DeepMind released Gemini Omni 1.2 Flash, now generally available across the Gemini API and Gemini for business, adding native 15-second video generation, multi-turn conversational editing, and stronger reference adherence. The model is priced 30% below Gemini Omni 1.1 at $0.07 per second for 720p video, with duration settable in one-second increments from 3 to 15 seconds. It also adds more natural speech and lip-sync, more controllable cinematic camera moves, and outputs carrying an imperceptible SynthID watermark.

    Why it matters: Useful for developers and creators weighing a cheaper, longer-clip video model against its stated limits on fast action and complex physics.

Oct 28Wed
  1. Hacker News AI80

    Meta's Muse Realtime Avatar turns any image into a talking AI character

    Meta introduced Muse Realtime Avatar, an audio-driven Diffusion Transformer that turns reference images into expressive, interactive avatars with synchronized facial, hand, and full-body movement during live conversation. It shares Muse Realtime Voice's speech-token stream for synchronization, uses distillation to cut inference from 120 to 2 neural function evaluations per chunk (a 60x reduction), and streams 448x768 portrait video at 25 fps with roughly 870 ms latency. Meta says raters preferred it over Runway Characters and HeyGen LiveAvatar overall and across every evaluated dimension, and it embeds Meta Video Seal watermarks without added latency.

    Why it matters: It offers a detailed look at how Meta achieves real-time, low-latency avatar video generation and serving at scale, including its distillation and infrastructure techniques.