iCreatAI News
Back to main site
Skip to content
Only First party#Deployment
Oct 29Thu
  1. Meta Engineering36

    Meta Andromeda: Powering the Next Generation of Ads Retrieval Through Model-System Co-Design

    Meta describes the next generation of its Andromeda ads retrieval engine, which uses a retrieval mixture-of-experts architecture and a single fused GPU pipeline to score every eligible ad at over one billion ads per second, a 100x throughput lift over the 2024 system. The system delivers near ranking-level model performance at retrieval scale with roughly 300x fewer inference-time FLOPs than the 2024 model, and Meta reports a 2.4% increase in conversions on Facebook since 2025. A joint collaboration with NVIDIA pushed individual components toward hardware limits, with the gating kernel reaching over 10 billion ads per second on a single GH200 and index matching exceeding 100 billion ads per second.

  2. Artificial Analysis Articles72

    GitHub Copilot Fusion orchestrates Anthropic and OpenAI models to balance performance and cost

    GitHub has released Copilot Fusion in GitHub Copilot, a runtime orchestration system that selects and coordinates models from Anthropic and OpenAI, including Claude Opus 5.5, Claude Sonnet 5.5, GPT-6 Astra and GPT-6 Sol, to optimize performance, cost and latency per task. In Artificial Analysis' Coding Agent Index v2.0, its max setting in GitHub Copilot CLI scored 2 points below Opus 5.5 in Claude Code at half the cost per task ($5.59 versus $11.42), leading Terminal-Bench 4.0 at 71 while ranking third on FrontierCode at 51 and scoring 57 on SWE-Atlas-QnA-AA. It used 7.2M tokens per task, roughly half of Claude Opus 5.5 in Claude Code and 30% less than Devin Fusion with Opus 5.5 (max) + GPT-6 Luna (high).

    Why it matters: Offers concrete benchmark and cost comparisons for a multi-model orchestration approach, useful for readers weighing coding-agent performance against token spend.

  3. Allen Institute for AI Blog38

    How researchers are adapting olmOCR 2 for historical and archaeological archives

    Ai2 describes how researchers adapted its open olmOCR 2 model: historian Maurice Casey built ArtificeOCR to run olmOCR 2 locally and make his Tropy photo library of archival sources searchable, while TU Wien and Austrian Academy of Sciences researchers fine-tuned olmOCR 2 with LoRA on 57 annotated Carnuntum pottery records, lowering transcription error on 450 test records from 15.58% to 1.11% through their CENTURIA benchmark.

Oct 28Wed
  1. NVIDIA Newsroom58

    NVIDIA RTX Spark Windows Laptops Gain New Models, Agent Tools and Games

    NVIDIA announced RTX Spark laptops from ASUS, Dell, HP, Lenovo, Microsoft and MSI, combining a Blackwell RTX GPU and Grace CPU with up to 128GB unified memory and up to 1 petaflop of FP4 AI performance, starting at $2,599. Updates include the open-weight Nemotron 3.5 Transcribe speech model, Liquid AI's LFM3 family with day-zero support, and resource management controls in NVIDIA App for sharing GPU resources between foreground apps and background agents. Phantom Blade Zero launches Oct. 28 with ray tracing and DLSS 4.5, and RTX Remix 1.6 brings path tracing and DLSS to Minecraft Java Edition 1.21.1.

  2. Amp Chronicle22

    Your Own Self-Hosted Orbs

    You can now self-host orbs without being in a workspace: personal providers can be added under Settings → Orbs and configured the same way as workspace providers. Threads created this way appear under Self-Hosted and are marked Personal.

  3. Sarvam AI Blog38

    Sarvam and HQ IDS establish joint framework for AI adoption across the Army, Navy and Air Force

    Sarvam signed a Memorandum of Understanding with Headquarters Integrated Defence Staff (HQ IDS) under the Ministry of Defence, creating an umbrella framework for AI projects across the Indian Army, Navy and Air Force and HQ IDS joint organisations. Under the MoU, Sarvam will design, develop and deploy AI applications for operational, training and decision-support needs and provide follow-on technical support, with work carried out by its firewalled division Chanakya using its AI stack including Sarvam 105B. Focus areas include decision support, target acquisition and data fusion across the sensor-to-shooter loop, with human oversight retained on operational decisions and deployment on sovereign infrastructure.

  4. ElevenLabs Blog38

    How to build an AI voice assistant: Brand-aligned voice AI

    This guide explains how to build an AI voice assistant by connecting speech to text, an LLM, and text to speech into one real-time pipeline, then adding a knowledge base, business tools, system instructions, and fallback rules. It covers architecture choices between raw APIs and the managed ElevenAgents platform, latency targets below 500 ms with voice activity detection, caller verification, human handoff, brand voice customization, and pre-launch testing for latency, interruptions, accuracy, and safety. Post-launch metrics such as containment, escalation rate, word error rate, hallucination rate, and CSAT are recommended for continued improvement.

  5. Browser Use Blog38

    Why Playwright Scripts Break When the Site Changes

    The article explains that Playwright scripts break on redesigns because they locate elements by page structure (CSS classes, DOM position, XPath, generated IDs) rather than by what users see, and recommends role, label, text, or owned test-ID locators with auto-waiting instead of fixed timeouts. It catalogs causes and fixes for flakiness, including strict-mode violations, copy changes, A/B variants, iframes and shadow DOM, expired sessions, and overlays handled via page.addLocatorHandler() since v1.42. For sites you don't control, it lays out options from manual fixes to Playwright's healer agent and agent fallbacks, with a Python example attaching Browser Use to Chrome over CDP.

  6. Browser Use Blog38

    How to Run Browser Automation at Scale in the Cloud (2026)

    This guide describes a queue-and-worker architecture for cloud browser automation, where each job gets its own isolated remote browser driven over CDP with Playwright or Puppeteer, with concurrency capped at the plan limit and browsers always stopped when jobs end. It compares pricing, concurrency limits and session caps across seven providers (Browser Use, Browserbase, Steel, Hyperbrowser, Browserless, Kernel, Anchor), works through a cost example of 1,000 jobs a day, and covers rate limits, retries with backoff, and self-hosting versus managed trade-offs.

  7. Browser Use Blog30

    Headless Browser Blocked by Cloudflare? What Works (2026)

    Cloudflare blocks stock headless Chrome because it signals automation (navigator.webdriver is true, Playwright's headless shell sends HeadlessChrome in its user agent), often runs from cloud server IPs, and starts each run without cookies. The article recommends getting recognized via an official API or Web Bot Auth verification, or, on sites you're allowed to automate, using a real Chromium with residential IPs and a persistent profile, which in practice means a managed stealth browser. It cites Stealth Bench V2 (September 25, 2026) results where headless Chrome with no proxy got through 3% of visits versus 90.5% for Browser Use Cloud, noting the site set favors the vendor.

  8. Together AI Blog40

    Auto repair for Together GPU Clusters: from GPU fault to healthy node

    Together AI describes its automatic node remediation system for GPU clusters, which detects faults from both inside the VM (Xid errors, DCGM ECC and thermal signals, Node Problem Detector) and on the host (InfiniBand rail state, host reachability), then recommends and optionally executes repairs. Repairs follow a cordon-wait-drain-act-rejoin lifecycle with an escalation ladder from reboot to quick reprovision to migration, governed by per-fault consent, wait-for-idle controls, concurrency budgets, cooldowns, and a circuit breaker. Migrated or removed machines are automatically re-validated with GPU, NCCL, InfiniBand, and storage checks, and only an explicit failure files a hardware ticket.

  9. NVIDIA Technical Blog35

    Memory-Enforced GPU Sharing in Kubernetes with NVIDIA CUDA 13.4

    Many AI workloads need only a fraction of a GPU, and giving each one a whole device can leave capacity idle, so sharing GPUs lets platform teams serve more workloads with existing infrastructure. NVIDIA GPUs already support several sharing approaches, including Multi-instance GPU (MIG), which splits a GPU into hardware-isolated instances that are transparent to the application.

  10. Claude Code Releases12

    v2.1.312

    Claude Code v2.1.312 adds an oidc.user_id_claim option to the Claude apps gateway for identifying users by an id_token claim other than sub, and lets fullscreen users send a queued message by clicking the "to send now" hint. It fixes issues including managed settings not being fetched after VS Code extension sign-in, Claude overwriting large CLAUDE.md or rules files after reading only their start, per-directory and paths: skills not found after a Bash cd, and a Read tool PDF failure. Other changes include limiting prompt and agent hooks to 24 at a time per session, renaming the "session limit" to "5-hour limit" in usage messages, and various VS Code, cloud session, Remote Control, Claude Tag and Code Review fixes.

  11. Claude Blog38

    Manage costs and demonstrate ROI for Claude Code on Google Cloud

    This post outlines a control, track, and prove framework for managing Claude Code spending on Google Cloud, using native tools such as per-project billing, budget alerts, spend caps, BigQuery exports, quotas, and the self-hosted Claude apps gateway for per-user and per-group spend limits and model allowlists. It describes tracking via Claude Code's OpenTelemetry metrics and events exported to Cloud Monitoring or BigQuery, and proving ROI through usage, satisfaction, and impact metrics such as PR cycle time and review turnaround. It cites Delivery Hero, Shopify, and Fifth Dimension as examples of measured impact.

  12. Codex Releases28

    0.165.0

    This release adds a built-in Google Cloud Vertex AI provider configured with model_provider = "gcp", adds GPT-6.1 Terra to the model catalogs, and adds a repository filter to the session picker plus directory grouping in the agent command center. It also enables reasoning effort changes during a conversation by default for supported models, turns on memory v2 by default for fresh profiles with support for importing external-agent memories, and adds experimental attached thread forks to the app-server API. Bug fixes include honoring the server's default approval reviewer on fresh TUI sessions, cancelling remote MCP tool requests when local response futures are dropped, treating model-not-found provider errors as terminal, and closing a marketplace URL validation gap involving backslashes in userinfo.

  13. Databricks Blog33

    Unlocking Investment Insights Without Migrating Your Data: Lakehouse Federation

    Databricks Lakehouse Federation lets users create federated connections to external databases such as SQL Server, PostgreSQL, MySQL, and Snowflake and query them directly from Databricks with standard SQL, keeping data in place. The post walks through a wealth management example that joins on-premises portfolio holdings with FactSet data subscribed from the Databricks Marketplace in a single query, then powers a dashboard and a Genie natural-language agent without pipelines, materialized views, or persisted objects. It notes the same pattern applies to other industries, such as healthcare, manufacturing, and retail.

  14. Databricks Blog38

    Vital Skills: Upskilling Genie Code with Healthcare and Life Sciences skills

    Databricks introduces Vital Skills, packaged playbooks built on the open Agent Skills standard that give Genie Code healthcare and life sciences domain knowledge, such as cohort building, HIPAA de-identification, RNA-seq analysis, and open-weight model deployment. On BiomniBench, Genie Code's average score on the 5 in-scope tasks rose from 71.9 to 76.9 across three trials, while scores on 18 out-of-scope tasks held steady. The skills are open source and installable in Genie Code, Genie One, or Genie Code CLI.

  15. Google Developers Blog34

    Building Conversational Commerce with Multi-Agent Swarms on GCP: A Working Prototype

    The post presents HappyDelivery, a working prototype of the previously described three-layer conversational commerce architecture built with LangGraph, Gemini, FastAPI, and Google Cloud. It details an omni-channel ingress service that verifies platform-specific signatures and normalizes payloads before queuing them to Pub/Sub, a Redis session and cart layer, and a LangGraph agent swarm with supervisor, profile, inventory, and transaction specialists using deterministic pricing tools. Live benchmarks and a three-turn simulated shopping flow, plus a five-test automated suite, are reported as verification.

  16. NVIDIA Technical Blog60

    NVIDIA RTX Spark Powers Neural Rendering and AI Characters in Games

    NVIDIA RTX Spark is a new Windows PC platform for AI development, creation, and gaming in slim laptops and compact desktops, powered by an NVIDIA Blackwell RTX GPU and NVIDIA Grace CPU. It combines up to 128 GB of unified memory with the full NVIDIA CUDA stack and RTX technologies including ray tracing and DLSS 5. The post covers technologies for game developers building on RTX.

  17. Databricks Blog38

    From spot fixes to measured gains: improving document extraction accuracy with ai_extract and MLflow Prompt Registry

    A Databricks engineering post describes extracting roughly 40 structured fields from partner order documents across dozens of PDF layouts, where a schema fix that halved errors on the revision field raised total errors across all fields by 9%. The authors recommend putting field rules in schema descriptions, document-level logic in global instructions, precision mode (ai_extract 2.1) for complex structures, and citations to diagnose errors, while versioning prompts and schemas in MLflow Prompt Registry with aliases such as @prod and @candidate. They evaluate candidates against a frozen human-reviewed test set, tracking accuracy, coverage and run-to-run variation, and report that restructuring the prompt and schema plus precision mode cut overall errors by 32% and revision errors by 64%.

  18. AWS Machine Learning Blog50

    Exowatt beats frontier models on accuracy with SageMaker serverless model customization

    Exowatt used Amazon SageMaker AI serverless model customization to fine-tune Qwen3-1.7B for edge alarm triage (0.911 macro-F1 vs 0.698 for Claude Sonnet 4.6) and Qwen3-14B for cloud energy-market analysis (0.975 macro-F1 vs 0.625 for Claude Opus 4.7, at about 49× lower cost per 1,000 answers). The pipeline spans seven AWS serverless services, with the edge model quantized to GGUF and run offline via llama.cpp on existing CPUs, and the cloud model served through Amazon Bedrock Custom Model Import. Exowatt moved from experimentation to production in nine days and plans to reuse the pipeline across fleet tasks.

  19. AWS Machine Learning Blog40

    Fix evaluation bias to unlock better models on Amazon Bedrock

    Property Finder found that 96.8% of its evaluation labels came directly from its incumbent vision model's predictions rather than human verification, biasing comparisons against alternatives. After building expert-annotated ground truth (356 UAE images) and running evolutionary prompt optimization from v0 to v27, it selected Llama 4 Maverick 17B Instruct on Amazon Bedrock, reaching a Micro F1 of 0.80 versus 0.56 for its previous model on the evaluation set, at an estimated 86% lower cost per 1,000 images.

  20. AWS Machine Learning Blog38

    Announcing SOCI-indexed images for faster SageMaker AI jobs

    AWS announced Seekable OCI (SOCI) indexing for Amazon SageMaker AI Training and processing jobs, which lazy-loads container images so jobs start in seconds instead of minutes by fetching only the files needed to launch and streaming the rest in the background. Benchmarks across eight images from 1.8 GB to 35.4 GB showed download times dropping from as much as 7 min 17 s to 3–11 s, with training performance unaffected beyond a 3–16 s first-epoch penalty. Users can adopt it by switching to a pre-indexed AWS Deep Learning Container with the -soci tag or by creating an index for their own image, with no changes to job definitions, entry points, or data channels.

  21. Google Developers Blog67

    Fast, reliable A2UI, with swappable inference formats

    A2UI now supports swappable inference formats, with A2UI Express as the new default that requires up to 3x fewer tokens than Direct JSON and can cut latency by up to 3x, while decision models like Jev can reduce latency by up to 80x for layouts defined in advance. Express is available in the Python agent SDK (a2ui-agent-sdk 0.9.0), the TypeScript agent SDK (@a2ui/agent) and the Dart SDK (a2ui_agent 0.0.1-wip004), and the SDK compiles the model's reply into validated A2UI messages. The post also describes the Apparite (jev2ui) example, where Jev answers layout questions and code builds the component tree, with screens complete in 0.8 to 1.7 s across 11 prompts in a small first-look sample.

    Why it matters: It gives concrete latency and token figures plus working SDK versions for teams weighing Express against decision-model-driven layouts.

  22. Replit Blog72

    Anyone can now bring their ideas into the company codebase

    Replit launched Cloud Agents for existing repositories, letting anyone on a team describe a change in plain language and have an agent find the code, test it in cloud sandboxes, and open a tested pull request in GitHub or GitLab with screenshots and video. The feature includes shared environments set up once by an admin, review feedback that agents turn into proposed team skills for engineer approval, and a Slack integration for starting changes from threads; it is available to all Pro and Enterprise customers.

    Why it matters: Announces a notable shift in how non-engineers can contribute tested code changes to production repositories, with concrete details on testing, review, and setup.

  23. NVIDIA Newsroom58

    NVIDIA and Oracle Expand NVIDIA Vera Rubin to Multi-Gigawatt Scale and Bring NVIDIA Vera CPU to Oracle Cloud Infrastructure

    NVIDIA and Oracle announced plans to expand OCI Superclusters with NVIDIA Vera Rubin NVL72 systems to multi-gigawatt scale, and said Vera Rubin NVL72 and NVIDIA Vera CPUs are now generally available on OCI. OCI also plans to introduce NVIDIA HGX Rubin NVL8, an x86-based eight-GPU configuration with two 64-core Intel Xeon 6 CPUs, 4TB of DDR5 memory and 6.4 Tbps RDMA networking. OpenAI, which trained and served GPT-6 Astra on an OCI Supercluster with more than 100,000 NVIDIA Blackwell GPUs in Abilene, is bringing Vera CPUs into production on OCI for agentic sandbox workloads.

  25. Meta Engineering38

    PrivacyLib: Privacy Controls at the Data Access Boundary

    Meta details PrivacyLib, a common library embedded in the clients of hundreds of its data and processing systems that enforces privacy requirements at the point of data access, performing billions of checks per second. Systems integrate once and new requirements arrive as plug-in modules, with changes simulated before release and rolled out per module; for internal AI agents, tool calls carry agent context to PrivacyLib so modules can observe data use and block disallowed operations.

  26. Databricks Blog22

    BigQuery to Databricks: A Strategic Framework

    This Databricks guide outlines a BigQuery-to-Databricks migration framework across three pillars—Process, Technology, and People—covering estate assessment with the open-source Lakebridge profiler, BI-first or ETL-first entry points, wave-based migration, and dual operation via Lakehouse Federation. It describes moving data into open formats on Google Cloud Storage, migrating SQL logic through rule-based transpilation, LLM-assisted conversion, and engineers, plus three-level validation, and maps BigQuery governance into Unity Catalog. The People pillar covers shared Notebooks, Genie for natural-language code generation, and Databricks Academy training, closing with field lessons such as profiling before planning and defining parity criteria before dual-run starts.

  27. Amp Chronicle42

    Amp on Android

    Amp now has an Android app, available for download and install from ampcode.com/app or via a QR code. The post shows the Amp design talk thread, the slide deck in the Portals tab, and the present.js diff in the Changes tab, all within the Android app.

Oct 27Tue
  1. Lovable Blog22

    Your workspace has undead apps

    Lovable describes "app sprawl"—forgotten but still-published projects that may retain working credentials, unpatched vulnerabilities, and personal data—and outlines its Enterprise abandoned project clean-up, which marks projects inactive after a default 60 days and can auto-delete them after a 7, 14, or 30 day grace period. Owners and editors are warned 5 days and 1 day before deletion, deleted projects remain recoverable for 60 days, and a free Halloween game in Lovable uses fictional projects without accessing real ones.

  2. Cloudflare Blog22

    Introducing the Cloudflare PHP Capture the Flag challenge

    Cloudflare has launched a PHP Capture the Flag challenge through its HackerOne bug bounty program, placing a deliberately vulnerable PHP 8.5.11 installation behind its WAF and inviting researchers to bypass protections for CVE-2026-109618 and CVE-2026-109619, exploit the sandbox, and recover the contents of /flag. Eligible submissions require a materially distinct WAF bypass method, a private HackerOne report with full reproduction details, and successful flag verification through the CTF UI. Testing is limited to POST requests against the challenge hostname's /php/* endpoints, and the challenge remains open per the Cloudflare HackerOne page.

  3. n8n Blog55

    Introducing n8n 3.0

    n8n released version 3.0.0 BETA, focused on internal changes for reliability, stability and security, with a stable release planned for early December. The release includes breaking changes such as removal of legacy nodes (Function, Item Lists, Cron, Interval), Docker-only self-hosting, safer security defaults, and a Migration Report under Settings to identify affected workflows and settings. Upgrading to 3.x is one-way, so users are advised to test on a staging instance and take a full backup first.

  4. Browser Use Blog38

    Browser Use vs Browserless: Pricing, Stealth & Features

    This comparison contrasts Browser Use and Browserless across pricing, stealth, performance, and deployment: Browser Use charges $0.02 per browser-hour with no subscription and reports 90.5% access success versus Browserless's 77.5% in its Stealth Bench V2 study, while Browserless uses unit-based subscription pricing and supports Chrome, Firefox, and WebKit. Browser Use offers hardened Chromium and hosted AI agents, whereas Browserless adds REST screenshot/PDF APIs, BrowserQL, and self-hostable Docker images. A worked example puts Browser Use at $7 in monthly usage versus Browserless's $25/month for 600 ten-minute sessions with 1 GB of residential traffic.

  5. NVIDIA Newsroom75

    NVIDIA and Meta to Expand Collaboration on Muse and Muse Family of Models Amid Robust Growth

    NVIDIA and Meta announced they will expand their partnership on Muse and the Muse family of models to improve inference and training performance, citing popular demand for AI agents. Meta intends to expand deployment of NVIDIA Vera Rubin and Vera CPUs, plus Spectrum-X Ethernet networking and BlueField-4, and the companies will consider collaboration on NVIDIA OpenShell Reference Architecture and NVIDIA Sentry for agent security and monitoring. NVIDIA will invest $3 billion in Meta's equity offering.

    Why it matters: The announcement details a major AI infrastructure partnership and a $3 billion equity investment, useful for readers tracking NVIDIA-Meta ties and agent infrastructure.

  6. Codex Releases8

    0.165.0-alpha.1.2

    A pre-release tagged rust-v0.165.0-alpha.1.2 was published by github-actions on 27 Oct at 04:57, with 151 commits to main since the previous release. The release is identified by commit 720fec8 and lists 320 assets.

  8. Cloudflare Blog74

    Cross-request KV cache exposure in the GLM-5.3 Workers AI model, and our remediation with SGLang

    Cloudflare reports that from August 27 to September 9, 2026, 155 responses from the GLM-5.3 Workers AI model (@cf/zai-org/glm-5.3) to prompts longer than 681,280 tokens contained data from other customers' requests, caused by a prefill KV pool smaller than the 1,048,576-token context window combined with an SGLang bug that let rejected over-length requests proceed through disaggregated prefill/decode handoff. The model was taken offline on September 9 and restored the same day after a corrected configuration and an engine patch, and Cloudflare says it found no evidence of deliberate exploitation. Cloudflare recommends operators of disaggregated SGLang upgrade to v0.5.22 or later and verify KV pool size against context length on every node.

    Why it matters: A detailed first-party incident report that is useful for anyone operating disaggregated LLM inference, with concrete configuration checks and upstream patch references.

  9. Baseten Blog55

    BDN Sealed Volumes: publish once, mount anywhere

    Baseten released BDN Sealed Volumes, which let you publish read-only data such as model weights, LoRA adapters, indexes, and compiled engines once as an immutable, digest-addressed version and mount it in any deployment via config.yaml. Volumes are pushed or synced from Hugging Face, S3, GCS, Azure Blob, Cloudflare R2, CoreWeave buckets, or local directories, with chunk-level deduplication so updates upload only changed bytes, and mounts start in seconds without a download step. Existing weights-block deployments will be migrated automatically, and the feature requires Baseten CLI 1.1.0+ and Truss 0.18.30+ if applicable.

  10. Databricks Blog20

    How to teach with Databricks Free Edition

    Databricks Free Edition is a perpetually free, browser-based version of the Databricks Data + AI Platform that students and educators can sign up for individually without a cloud contract, credit card, or installation, running on smaller compute under fair-use limits and not for production or commercial use. The article maps common courses—from intro programming and statistics to data engineering, data warehousing, ML, AI agents, and capstones—to platform tools such as notebooks, Apache Spark, Lakeflow, Delta Lake, Databricks SQL, MLflow, Genie Agents, and Databricks Apps, and answers instructor FAQs on distributing assignments and datasets, group work, and compute limits.