iCreatAI News
Back to main site
Skip to content
Only Papers#Deployment
Nov 15Sun
  1. Hacker News AI40

    Sandlock: Confining AI Agent Code with Unprivileged Linux Primitives

    Sandlock is a lightweight Linux process sandbox that compiles static, input-independent policy into kernel-enforced rules while a narrow supervisor handles runtime-dependent decisions and virtualized effects, enforcing filesystem, network, IPC, and syscall policies without root, cgroups, images, or mandatory namespaces. It supports dynamic network decisions, HTTP-level access control, TOCTOU-safe inspection of execve arguments, and reversible filesystem effects, adding roughly 5 ms of startup overhead and running Redis at bare-metal throughput on the authors' workstation. Its pipeline operator further supports per-stage confinement for separating data, network, and untrusted-content capabilities.

Nov 14Sat
  1. Hacker News AI60

    1 in 4 3rd Party AI Endpoints Underperform Their Advertised Models

    Artificial Analysis released version 1.1 of its Endpoint Accuracy Index, which compares more than 100 serverless endpoints hosting open-weight models against reference deployments of the official weights, finding roughly one in four score below their reference. The index reruns each endpoint on BFCL v4-500, HLE-250 and AA-LCR-25, and version 1.1 raises long-context repeats from 10 to 25, cutting the average 95% confidence interval from plus or minus 4.7 to plus or minus 2.6 points, while coverage expands to six models including DeepSeek V4.1 Flash 1017, GLM-5.3, GLM-5.3 Flash, Muse Spark Open, Kimi K3 and gpt-oss-120b. Reported gaps trace to output caps that truncate answers, shorter reasoning, and a schema bug encoding string tool arguments as numbers, with GLM-5.3 endpoints scoring from 67.2% to 99.3% and all 22 DeepSeek endpoints statistically consistent with the reference.

Nov 13Fri
  1. MIT News AI34

    New AI “copilot” helps engineers design better structures

    MIT researchers developed a human-in-the-loop topology optimization system that presents regions of an algorithmic design to a human designer for feedback as it is generated, using machine learning trained on synthetic human-feedback data to identify likely regions of interest. In demonstrations, the approach improved manufacturability and linear buckling load by 39 percent while adding only 15 seconds to total design time compared to all-algorithmic approaches. The system currently only lets users make structures within identified regions thicker or thinner, and the researchers hope to add other modification options in future versions.

  2. Hacker News AI36

    Air-LLM: Broadcasting AI Weights for Edge LLM Inference via RF Computing

    The paper proposes AIR-LLM, an edge LLM inference architecture in which a central radio such as a 5G base station broadcasts LLM weights over the air and edge users perform the general matrix-vector multiplication of inference directly in the RF domain using RF mixers, avoiding weight storage and loading. It uses MIMO spatial multiplexing with an energy-efficient precoder-postcoder pair to shorten airtime, and because the central radio stays user-unaware, one broadcast can serve unlimited users in coverage. Evaluated on NVIDIA Sionna ray-traced channels of two urban scenes with a real RF mixer profile, AIR-LLM shows 4.0% WikiText-2 perplexity degradation on LLaMA-3.1-8B while saving 157.7x/40.4x energy versus FP16 and weight-only quantization baselines, and with 20 users its airtime is 104.1x/26.0x shorter.

Nov 11Wed
  1. Hacker News AI45

    Doc2Harness: Benchmarking how well AI builds agent harnesses

    The authors propose Doc2Harness, a two-stage benchmark that evaluates long-horizon harness engineering: a build model constructs a candidate harness from an interface-only contract skeleton and a development document consolidating behavior across twelve frontier harnesses, and the frozen harness is then run per test case by a scripted mock model and scored via four observable channels. Across nineteen frontier models, each with three independent builds on 328 test cases, GPT-6 Astra achieves the highest pass rate at 53.05% while the weakest model reaches 27.44%, and failures cluster around how cross-cutting functionality is split across modules. The authors describe it as the first deterministic benchmark for measuring long-horizon harness engineering.

  2. Baseten Blog69

    How Baseten and Genspark trained a deep research model to outperform Opus 5.5

    Genspark worked with Baseten Applied Research to post-train Qwen3.5-397B into a specialized Deep Research model that scores 0.759 on Genspark's quality grader, up from 0.612 for the base model and above Opus 5.5 (0.738), Sonnet 5.5 (0.742), GPT-5.6 Sol (0.637), Kimi K3 (0.724) and DeepSeek V4 Pro (0.675). The recipe splits the task into research, trained with reinforcement learning against a shaped semi-verifiable reward, and synthesis, trained mainly with supervised fine-tuning on high-quality reports written from the model's own research trajectories, followed by end-to-end RL. The model crawls 5× more sources per query than the base model and runs with NVFP4 weights on 2×B200 GPUs per replica, now serving as the default for Genspark's Deep Research agent in production.

    Why it matters: A detailed, reproducible account of post-training an open model for a judged production workload, useful for teams weighing RL versus SFT and reward shaping.

Nov 10Tue
  1. Hacker News AI58

    Beyond FLOP/s: comparing AI hardware for inference by memory and communication

    The article argues that raw FLOP/s understates inference gains, estimating Nvidia's GB300 delivers about 25× H100's inference capacity per chip on modeled agentic workloads despite only 2.5× the 8-bit FLOP/s, because memory and inter-chip communication matter more. It introduces the Inference Performance Index (IPI), scored in GB300 equivalents (GB300e), which compares simultaneous requests each chip can serve across 50–400 tokens/s/req for four representative models. Reported scores include GB300 NVL72 at 1, B300 HGX at 0.54, MI355X at about 0.55, VR200 at 2.18, and H200 HGX at 0.12.

  2. Hacker News AI40

    We Benchmarked Fireworks, Together, Baseten, Modal, DeepInfra, Z.ai and Keln

    This post reports benchmark results for DeepSeek V4.1 Flash and GLM-5.3 Flash across seven inference providers, measuring turns answered, cache hit rate, decode speed, reasoning tokens and cost per 1,000 turns. Keln answered every turn on both models, had the highest median decode speed on GLM-5.3 Flash at 432 tokens/s, and retained 63.0% of the prompt cached after a 15–20 minute break versus 38.4% on DeepInfra and 0% on Baseten, Modal and Fireworks. Baseten refused about half the DeepSeek turns with rate-limit errors, Modal cut one stream, and Fireworks had 165 cold turns on DeepSeek, making it the most expensive there at $2.86 per 1,000 turns.

  3. Hacker News AI38

    Triton for MTIA: Bridging the Programming Model Gaps for Custom AI Accelerators

    This paper presents the first production-scale application of Triton on a custom ML accelerator, Meta's MTIA-2i, via a new compiler backend, TorchInductor code generation enhancements, and minimal language extensions exposing MTIA-specific architectural features. Triton-MTIA kernels achieve performance competitive with expert-tuned C++ implementations, and manually written plus Inductor-generated Triton kernels were deployed in production across roughly 60 model types, covering 50% of layers and 47% of non-GEMM execution time for these models.

  4. MarkTechPost64

    Baidu’s ERNIE Evolve Automated Research System Beats NanoChat and NanoGPT Records

    Baidu released ERNIE Evolve, an automated research system that selects research directions, edits code and runs experiments against a fixed objective, keeping only changes that pass a hidden evaluator and a separate reviewer. It beat the best public result on 3 of 4 public metrics, including 0.8763 validation BPB on NanoChat AutoResearch, 38.9 s on NanoGPT Speedrun Track 1 and 2,590 steps on Track 3, while scoring 0.819 mean SOL on SOL-ExecBench, behind the 0.827 leaderboard best. On ERNIE-5.5-Flash inference it reported 623.6% of baseline generation speed on Kunlunxin P800, +33.7% deterministic throughput and +14.9% single-request decode speed, though the system itself is not released.

Nov 9Mon
  1. Hugging Face Blog38

    Your Experts Have Partners. There's HOPE for Keeping Them Together

    This post introduces HOPE (Higher-Order Pruning of Experts), a second-order expert-pruning method for Mixture-of-Experts language models that accounts for pairwise expert interactions via an F-matrix and a quadratic program, rather than scoring each expert independently. Evaluated on Qwen3.5-122B, Qwen3.5-35B and GLM-4.5-Air with two calibration datasets, HOPE achieved the best average rank across conditions and gains of up to +6.1% on agentic coding tasks over the next-best method, with its advantage growing at aggressive pruning rates such as 50%. The post also describes a three-step calibrate/solve/prune package and notes limitations, including weaker advantages at 10–20% pruning and no cross-layer interaction modeling.

  2. Artificial Analysis Articles40

    Endpoint Accuracy Index v1.1: Tighter long context intervals and expanded model coverage

    Artificial Analysis released Endpoint Accuracy Index v1.1, which updates AA-LCR-25 to dataset version 1.1 with corrected answer keys, an updated equality-checker LLM and 25 repeats per question, narrowing the average 95% confidence interval from ±4.7 to ±2.6 points. Coverage now spans 103 serverless endpoints across six open weights models, adding GLM-5.3 Flash and Muse Spark Open and replacing DeepSeek V4 Pro with DeepSeek V4.1 Flash 1017, while GLM-5.2 leaves. Of the 103 endpoints, 24 score statistically below their self-hosted reference, with causes grouped as output token caps, reduced reasoning, tool call handling differences, and request limits or stream behavior.

Nov 7Sat
  1. Hacker News AI58

    VFlash: Enabling System-1 VLMs for Physical AI

    VFlash is a generalist decoding framework for Physical AI that adapts VLM speculative decoding by exploiting the known structure of visual primitives, using a lightweight drafter trained on annotated geometry to generate complete primitives in one parallel pass while the target VLM stays frozen. It reduces mean 3D displacement error by 42.6% relative to the autoregressive target across three robot datasets and three target variants, and reaches 70.2% average success on MolmoSpaces versus 62.6% for the baseline. On Jetson Thor, DGX Spark, and H100, VFlash cuts decoding latency by 12–42×, yielding 5× faster robot inference and over 3× faster NAVSIM driving inference on Jetson Thor and DGX Spark.

Nov 6Fri
  1. Cloudflare Blog34

    The post-quantum future of web privacy

    Cloudflare explains how Privacy Pass, which relies on classical cryptography like RSA and elliptic curves, will need post-quantum replacements, and explores MOLE (Moderation Of unLinkable Endorsements), a design whose endorsements hide the issuer's identity. The post describes how the VOLE-in-the-Head proof system combined with multivariate signatures such as UOV and MAYO yields blind signatures like PoMFRIT (6.7KB, reducible to about 4.3KB with UOV), and how these building blocks can be reconfigured into MOLE endorsements and credentials. It also covers optimizations (fewer hashes, TurboSHAKE, smaller Keccak state, multivariate commitments and PRGs) and notes that multivariate cryptanalysis is still immature, so parameter changes and further study are expected.

  2. SemiAnalysis72

    The Iron(wood) Throne: Google's TPU Stakes Its Claim on Inference

    SemiAnalysis reports first official long-context, multi-turn agentic inference benchmark results on TPUv7 (Ironwood) across four models on InferenceX/AgentX, finding TPUv7 either competitive or best-in-class on performance per dollar for external customers, including 1.2x to 2.7x the tokens per dollar of B200, B300 and MI355X on GLM-5.2 FP8. The results came through ecosystem partners including SGLang (RadixArk), vLLM (Inferact) and llm-d, and the piece argues NVIDIA's bureaucracy and stingy cluster contributions to open-source maintainers are among the biggest risks to its moat. It also notes NVIDIA's GB300 FP4 counter submission still trails TPUv7 FP8 on end-to-end performance per dollar, while FP4 GPUs retain a per-dollar lead on GLM-5.3 until TPUv8 adds FP4 support, expected in Q1 2027.

  3. Microsoft Research58

    Formally verifying agent-written full-stack web apps with PDD Kit

    GitHub Next describes PDD Kit, a toolkit for Proof-Driven Development that turns a developer's intent into a formal specification in Verus, proves the agent's code meets that spec for every input, and falls back to tests where proofs cannot reach. The team applied it to Pet Store, a roughly 5,000-line Rust full-stack app, formally verifying its login logic while the developer reviewed the intent rather than reading generated code line by line. PDD Kit labels each result as either formal verification or empirical evidence and asks developers to sign off on each trusted component.

Nov 5Thu
  1. Hacker News AI48

    Novel AI framework runs on optical hardware

    Researchers including a University of Tokyo team combined an SS-DFA training method with a simpler "single-map framework" architecture and demonstrated it in an optical computing system using a 200-meter optical fiber and few electronic components. The simplified design matched or in some tests outperformed more complex neural networks while requiring far less computation, measurement and data storage. The team says future work must test scaling to the largest AI models and address miniaturization, stability and large-scale manufacturing.

Nov 4Wed
  1. Hacker News AI31

    EdgeDAE: Acceleration of Diffusion Action Experts for Real-Time Physical AI

    EdgeDAE is a heterogeneous FPGA-GPU system that offloads the perception-heavy vision transformer to the GPU while accelerating Diffusion Action Expert (DAE) inference on an FPGA by storing all parameters on-chip in BRAM/URAM, eliminating the repeated DRAM parameter loading of iterative denoising. It co-designs quantization, fixed-point arithmetic, and hardware-efficient random number generation for the FPGA fabric. Compared with an edge GPU baseline, it reduces end-to-end inference latency by 52.5% for Octo-Small and 38.7% for Octo-Base with up to 2.10x higher throughput, and achieves about 17x higher energy efficiency than an RTX 4090.

Nov 3Tue
  1. Hacker News AI43

    CloudOpsBench: AI benchmark shows FAI models struggling with cloud infra

    CloudOpsBench is a benchmark for AI agents on real cloud operations, and its leaderboard ranks models by resolution rate, harness, release date, time, tokens and cost. The top entry, claude-fable-5-1 (max) with claude-code, reaches a 60.6% resolution rate at 38.6h, 97.9M tokens and $404.3, while the lowest listed, kimi-k3.1-pro (high) with terminus-2, reaches 19.1%.

Oct 30Fri
  1. Amazon Science38

    Speeding up language models for travel applications

    Researchers combined knowledge distillation, which trains a compact student model on a large teacher's outputs, with Medusa, a framework that predicts multiple tokens in parallel, and applied the pipeline with Booking.com to three travel features. The final model matched the quality of a 70-billion-parameter teacher while running 10 to 20 times as fast, with reported gains including 2.9% higher engagement versus GPT-3.5 for AI Trip Planner and 15-times-faster Smart Filters responses for 99% of queries. The work received the Industry Track best-paper award at ACL.

Oct 29Thu
  1. Hacker News AI60

    Agent Scrum: Running a team of AI coding agents in two-hour sprints

    Over 38 days, a fleet of AI coding agents ran 324 two-hour sprints on a real product backlog, with 79% of committed stories reaching done inside the sprint in the 90 sprints run by a dedicated scrum-team agent and ceremony taking under five minutes per sprint. The paper describes Agent Scrum, which keeps Scrum's core devices (time-boxed sprints, committed sprint backlogs, story points, velocity, a Definition of Done and retrospectives) but changes their scale and constraints, with capacity coming from model rate limits and cost measured as token velocity. It reports that the slowest stage was not writing code (median approval-to-merge time equalled median build time) and that compounding was weakest, with 119 of 159 retrospective actions still open.

  2. Meta Engineering36

    Meta Andromeda: Powering the Next Generation of Ads Retrieval Through Model-System Co-Design

    Meta describes the next generation of its Andromeda ads retrieval engine, which uses a retrieval mixture-of-experts architecture and a single fused GPU pipeline to score every eligible ad at over one billion ads per second, a 100x throughput lift over the 2024 system. The system delivers near ranking-level model performance at retrieval scale with roughly 300x fewer inference-time FLOPs than the 2024 model, and Meta reports a 2.4% increase in conversions on Facebook since 2025. A joint collaboration with NVIDIA pushed individual components toward hardware limits, with the gating kernel reaching over 10 billion ads per second on a single GH200 and index matching exceeding 100 billion ads per second.

Oct 27Tue
  1. Hacker News AI58

    Static reasoning can't prove runtime behavior: benchmark of AI PR reviewers

    Heal benchmarked its runtime sandbox agent against CodeRabbit, Greptile and cubic across 236 replayed PRs on five products, finding that 70% of the 202 user-facing defects Heal proved (141) had never been flagged by any review bot. Code review bots instead dominated on files Heal skips by design, such as CI, migrations, analytics and tests (654 of 1,003 distinct flags), and stacking multiple bots added only marginal coverage. Heal reports 1,085 regression tests generated across the five products.

Oct 22Thu
  1. Hugging Face Blog58

    How Specializing the Vocabulary of SLMs Can Cut Inference Cost by 77% in Real Applications

    Dharma-AI describes VocabX, a method that rebuilds a small model's tokenizer around the cost of each token rather than its frequency, combining sub-word merges with multi-word "macro" tokens under a shared cost criterion. In a production Portuguese essay grader built on Qwen3-4B, the approach cut average response length from 350 to 101 tokens and measured inference cost by 77.0% with the same base model and training recipe, while the bench score rose from 0.703 to 0.810. The article previews results from a VocabX paper still under review, noting the numbers may change before publication.

Oct 16Fri
  1. Microsoft Research58

    Proof-based general-purpose computing with Magnetar

    Microsoft Research introduces Magnetar, a zero-knowledge virtual machine that proves execution of RISC-V programs written in Rust, Go, or C, running 10 to 39 times faster on average than the fastest comparable zkVMs across 15 benchmarks and verifying proofs in about 12 milliseconds. Magnetar's security rests only on standard hash functions such as SHA-256 or SHA-3, requiring no elliptic curves, lattices, special-purpose hash functions, trusted setup, or unproven conjectures. It builds on more than a decade of Microsoft Research work including Spartan, Phalanx, Nova, Brakedown, Lasso, Jolt, and BinarySpartan.

Oct 1Thu
  1. Microsoft Research40

    Forecasting space weather risks on power grids

    A Microsoft Research intern developed a machine learning pipeline that uses forecast-time solar-wind data, AE and Dst index forecasts, local geology and grid data to produce location-specific geomagnetically induced current risk estimates for 66,935 substations in the continental United States, 30 to 60 minutes ahead. During the 2020-2026 evaluation period the pipeline detected nearly 80% of major space-weather events, with detection rates of 76.5% for events ≥10 nT/min, 81.2% for ≥20 nT/min and 64.1% for ≥50 nT/min, and it produced estimates for all substations in about 333 milliseconds. The authors note that further validation with utilities and operational data would be needed before use in grid operations.

Jul 29Wed
  1. Berkeley AI Research60

    From CUDA to MLX: How K-Search Brings Decades of Kernel Expertise to Apple Silicon

    IBM Research extended K-Search, an evolutionary LLM-driven kernel search framework from UC Berkeley Sky Lab, with a native MLX backend and a structured CUDA-to-MLX translation layer that maps CUDA primitives, constraints and optimization patterns onto Apple Silicon equivalents. On Apple Silicon the approach reached 0.97x the speed of the native MLX Attention kernel and up to a 20x prefill speedup over the community mlx-lm implementation on the Mamba SSM kernel, attributed largely to adding a parallel scan. The authors say the bottleneck was not the LLM's ability to write Metal code but the quality of context and constraints supplied to it.

    Why it matters: Describes a concrete method for transferring CUDA kernel expertise to non-NVIDIA hardware, with reported benchmark numbers and an open-source reproduction path.