iCreatAI News
Back to main site
Skip to content
#Hugging Face
  1. Hugging Face Blog60

    llama.cpp v1.0.0 : A stronger foundation for the local AI ecosystem

    llama.cpp released libraries v1.0.0, marking a commitment to stable public APIs for downstream developers, with both llama.cpp and ggml now reflecting API and ABI incompatibilities through major-version bumps. The project states it supports more than 150 architecture variants and all mainstream speculative decoding methods, and distributes pre-release artifacts across Linux, macOS, Windows, Android and iOS plus channels including Docker, Homebrew, conda-forge, MacPorts, Winget and XCFramework. It also describes continued investment in CI infrastructure and self-hosted runners with hardware support from NVIDIA, AMD, Qualcomm, Arm, IBM and Intel.

    Why it matters: Signals a versioning milestone for a widely depended-on local inference library, useful for developers tracking API stability and platform support.

  2. Hugging Face Blog66

    LLMON: An LLM-Native Markup Language, now in Granite 4.1 3B and 8B

    IBM researchers introduce LLMON (LLM Object Notation), an XML-like markup language that uses reserved special-token delimiters to explicitly mark instructions, data, requirements and execution bindings in an LLM's context, addressing the brittleness of JSON-style formats for causal models. They release two experimental preview models derived from Granite 4.1 base checkpoints (granite-4.1-3b-LLMON-preview and granite-4.1-8b-LLMON-preview) plus a GitHub toolkit, reporting that on the OPI benchmark LLMON models avoid 47% more indirect prompt injection attacks than the best frontier model tested while maintaining general capability on par with Granite 4.1 Instruct. The models ship with their own chat template and lossless JSON-to-LLMON converters, and the post notes the previews are for exploration, not production.

    Why it matters: Useful for teams weighing structured context formats against JSON and for anyone evaluating prompt-injection defenses in small open models.

  3. Tomasz Tunguz88

    When the Central Bank of AI Changes Chairs

    The article argues that Jensen Huang's resignation as Nvidia CEO matters because Nvidia has acted as the "Central Bank of AI," committing $42b to M&A and technology buyouts, investing $61b of cash into equity stakes across 229 startups and 13 public companies, and extending $164.5b in lease guarantees and cloud capacity backstops. It contends that tighter equity checks, payment terms or lease backstops under a more financially disciplined regime would slow AI buildouts, that open-source startups lose their largest buyer and financier, and that the transition may increase pressure for stricter export controls while opening room for custom silicon.

    Why it matters: It offers a detailed, source-cited framework for judging how Nvidia's leadership change could ripple through AI startup financing, open-source funding and custom chip competition.

  1. TechCrunch · AI78

    Jensen Huang’s exit puts Nvidia’s support for open source in question

    Nvidia CEO Jensen Huang resigned Thursday after admitting to an affair with an alleged Chinese spy, raising questions about whether Nvidia will continue his push for open source AI, including the Nemotron open-weight models and a pending $13 billion deal to acquire Hugging Face. Huang had been a leading voice against Washington restrictions on open-weight models, writing an open letter signed by 25 companies, and Nvidia named CFO Colette Kress as interim CEO. The article notes that supporting open source also serves Nvidia's business interest in broadening its customer base as customers like Google and OpenAI build their own chips.

    Why it matters: It reports a major leadership change at Nvidia and examines how it could affect open source AI policy and Nvidia's open-model strategy.

  1. Amazon Science62

    Mitra-v2: Scaling synthetic pretraining for tabular foundation models

    Mitra-v2 is a second-generation tabular foundation model for classification and regression, pretrained entirely on synthetic tables with 10x as many rows and roughly 3x as many columns as Mitra-v1, plus a new hybrid SCM prior and hybrid optimizer. On TabArena it leads the single-model field, beating Mitra-v1 on 32 of 33 datasets where both run natively and completing all 51 datasets within the one-hour budget, and fine-tuned Mitra-v2 ranks first on ScoringBench. The fine-tuned models and inference/fine-tuning code are released under Apache-2.0 on Hugging Face.

    Why it matters: Useful for readers tracking tabular foundation models, as it reports concrete benchmark rankings and an open Apache-2.0 release.

  1. Tomasz Tunguz82

    A $90 Key into Your Company's Secrets

    The cost of an AI-driven break-in of a simulated corporate network fell 99% in five months, from a $5k–$10k BIS estimate in April to $90 with Zhipu's open-weight GLM-5.3, and Goldman executives have discussed spending as much or more on AI for security as on AI coding tools. The piece argues attackers now run expected-value calculations on compute and concentrate on the largest balance sheets, while defenders must inspect every alert and face compounding speed, scale and breadth multipliers. It concludes the CISO's job is to buy enough compute and convert it into defensive tokens to push the attacker's expected value below zero.

    Why it matters: It offers a concrete cost curve for AI-enabled intrusion plus a framework for reasoning about offense-defense economics in security budgets.

  1. Hugging Face Blog71

    A Closer Look at Phonon TTS. Launching High-Quality On-Device Speech That Tops the Benchmarks.

    Gradium details Phonon, a small on-device text-to-speech model released two weeks ago that needs no server or network, with Phonon 31m (English) under Apache 2.0 and Phonon 40m covering English, French, German, Spanish and Portuguese under a non-commercial license. The models, about 65 MB and 75 MB, offer over 100 built-in voices plus voice cloning and voice design, and on Hugging Face's Open TTS Leaderboard Phonon ranks first in German and Spanish on intelligibility and tops the CPU streaming benchmark on time-to-first audio. The post also covers the ptts inference framework, Transformers integration from v5.21, launch demos, and more than 200,000 downloads in the first two weeks.

    Why it matters: It offers a detailed look at how a small on-device TTS model was built, benchmarked and integrated into developer tooling.

  2. MarkTechPost76

    Ricursive AI Releases Ripple-65B Preview: A 65B Dense Open-Weight Model Scoring 80.5 on Terminal-Bench 2.1

    Ricursive Intelligence released Ripple-65B Preview, a 65B dense open-weight model pretrained from scratch on 12T tokens with up to 1M context, shipping three Apache 2.0 checkpoints (instruction-tuned BF16, NVFP4, and BF16 base). Ricursive reports 80.5 on Terminal-Bench 2.1, the top self-reported score among US open-weight models, while trailing larger MoE rivals on SciCode (39.4) and DeepSWE 1.1 (44.3), with full R&D cost stated at $32M. Weights are on Hugging Face, with Together AI, GMI Cloud and OpenRouter listed at launch and an experimental NVFP4 build targeting NVIDIA DGX Spark.

    Why it matters: Useful for readers tracking open-weight agentic coding models, since it pairs self-reported benchmark claims with a detailed architecture, cost and deployment breakdown.

  1. Hugging Face Blog80

    Welcome Le Chonk: Mistral Large 4 on Hugging Face

    Mistral Large 4 ("Le Chonk") is a multimodal, multilingual Mixture-of-Experts model with about 1T total and 49B active parameters and a 1M-token context window, released in FP8 and NVFP4 variants under the Mistral Ecosystem Open-Weight License. It combines a 72-layer text decoder using MLA with a DeepSeek Sparse Attention indexer and a 1.6B Pixtral vision encoder, and the post reports 82% on the Artificial Analysis Cyber Index vulnerability reproduce-and-patch test and 93% on Cybench. Day-0 support covers Transformers, vLLM, llama.cpp, TRL fine-tuning, Inference Endpoints and Dell Enterprise Hub, with GGUFs from Unsloth and the llama.cpp team.

    Why it matters: A detailed, hands-on release guide that pairs architecture specifics and benchmark claims with runnable deployment and fine-tuning recipes for a large open-weight model.

  2. TechCrunch · AI78

    Mistral releases weights for its trillion-parameter AI model, targeting cybersecurity

    Mistral has released the weights for Mistral Large 4 (ML4), nicknamed "Le Chonk," a trillion-parameter open-weight model that businesses and governments can download and deploy themselves, available on Hugging Face and via its API. Mistral says the model is comparable in performance to Chinese open-weight competitor GLM-5.3 while using 47 percent fewer tokens per task, and claims it outranks all other open models on Artificial Analysis' Coding Agent Index for agentic coding tasks. The company positions ML4 for sovereign cyber defense, with VP of Science Pierre Stock saying open weights give organizations access to frontier intelligence "that can't be cut off by definition."

    Why it matters: The piece is useful for readers tracking the open-versus-closed model debate and the push to apply frontier AI to cybersecurity, though its performance claims come largely from Mistral itself.

  1. Hugging Face Blog78

    NVIDIA Nemotron 3.5 Transcribe and Granary v2: Intelligent Multilingual Transcription You Can Prompt and Adapt

    NVIDIA released Nemotron 3.5 Transcribe, an open-weight, promptable model that handles transcription in 40 languages, translation of 31 to or from English, speaker attribution in 13 languages, and audio question answering in one checkpoint, running on a single NVIDIA GPU. It ranks first among open-weight models on the Hugging Face Open ASR Leaderboard for English at 5.33% average WER and posts the lowest diarization error rate on David AI's 21-language leaderboard. The release also includes Granary v2, an open data curation pipeline covering 463,062 hours across 48 languages, and NeMo Speech fine-tuning recipes that cut held-out WER by 45.8% relative to the best prompt in a medical case study.

    Why it matters: It documents concrete benchmark standings, an open data pipeline, and a reproducible fine-tuning recipe for teams evaluating or adapting open speech models.

  1. Hugging Face Blog62

    Turning Database Grading into RL Rewards: Post-Training Agents with ThinkingBox

    Microsoft and Hugging Face describe using ThinkingBox's executable terminal-database-state checks as binary rewards to fine-tune Qwen3.8-27B with GRPO for 50 steps on an offline-selected pool of 187 tasks, raising pass@1 from 51.70% to 60.78% and tasks passing all 20 attempts from 38 to 107 on the 507-task ThinkingBox-Bench, while pass@20 dipped slightly from 453 to 446. The post details offline policy-relative difficulty selection via Jeffreys posteriors, the reward loop, cost-per-dependable-task falling from $24.36 to $8.00, and releases the training stack in microsoft/thinkingbox-training.

    Why it matters: It offers a concrete, reproducible recipe for converting stateful agent grading into RL rewards, plus an honest account of the repeatability-versus-coverage tradeoff.

  1. Hugging Face Blog75

    NVIDIA Kumo Relational Outperforms Supervised Machine Learning on Relational Data, No Training Required

    NVIDIA introduces Kumo Relational, a pre-trained relational foundation model that predicts directly on enterprise databases via in-context learning in a single forward pass, requiring no task-specific training, feature engineering, or table flattening. Across 41 tasks on 15 databases, it beats supervised relational deep learning models and expert-engineered gradient-boosted tree pipelines, and on the SAP SALT benchmark it surpasses AutoGluon ensembles by 8% in mean reciprocal rank (MRR). It scales to databases with 500B+ rows and is available through NVIDIA's open-source structured-data-models and kumo-engine libraries or as an NVIDIA NIM.

    Why it matters: Useful for ML teams weighing whether to replace production XGBoost pipelines with a pre-trained relational model, though the reported gains come from NVIDIA's own paper and benchmarks.

  1. NVIDIA Blog73

    NVIDIA Open Models Advance Europe’s Sovereign Intelligence Across Industries

    NVIDIA is expanding its family of open models across language, robotics, biology and quantum computing, including the new Nemotron 3.5 Super VL and Nemotron 3.5 Bolt models, Nemotron Retriever models, the Kumo family for structured business data, Cosmos 3.5 world models, Alpamayo 2 Edge for autonomous vehicles, BioNeMo for healthcare and science, and Ising for quantum computing. The company says the open models give organizations a foundation they can customize with local data and deploy on infrastructure they control, with Nemotron built using data and expertise from the NVIDIA Nemotron Coalition including European partners Black Forest Labs, H-Company and Mistral. Availability details include Nemotron 3.5 Super VL on Hugging Face, ModelScope, OpenRouter and build.nvidia.com, with Nemotron 3.5 Bolt E4B 4GB expected Friday, Oct. 23.

    Why it matters: The piece is a broad product roundup that shows how NVIDIA is positioning open models as a sovereignty-friendly foundation for European enterprises and researchers.

  1. Hugging Face Blog65

    Hugging Face ❤️ TorchTPU: TPUs, Natively

    TorchTPU adds TPU as a native PyTorch backend, letting Transformers, Diffusers and Kernels run on TPU by sending models to "tpu" instead of going through torch_xla or JAX, and Optimum TPU is no longer required. The post shows loading a model with device_map="tpu", running Diffusers pipelines with pipe.to("tpu") plus optional torch.compile, and using Pallas kernels from the Kernels Hub, with reported speedups of 21.5× on Qwen3-30B-A3B and 12.8× on Gemma 4 26B-A4B at batch size 64. It also reports that 96.5% of tests run on TPU pass, with 34 issues filed on the TorchTPU repo and 19 already fixed.

    Why it matters: It documents a new native PyTorch TPU backend and concrete usage patterns for the Hugging Face stack, useful for readers weighing TPU support.

You have reached the end