Specialization reaches the whole stack

OS Twitter / X Recap

Specialized models and training

• Carbon-X specializes a 14B model for DNA The team says it mid-trained Qwen3.5-14B on 300B interleaved DNA/text tokens, then used SFT and RL without distillation. A hybrid tokenizer encodes DNA in roughly one-third the BPE tokens; weights are Apache-2.0. @_lewtun ↗
• Mid-training—not scale—is the claimed lever Leandro von Werra says the project mid- and post-trained the base model to match frontier biology performance at a fraction of the cost. Benchmark and cost comparisons remain project-reported. @lvwerra ↗
• Sage-A1.5 packages orchestration into a 35B MoE Shanghai AI Lab describes a 35B model with 3B active parameters, parallel sub-agents, verification and a synthetic-environment data flywheel. Its benchmark claims and 61.2% SWE-Bench Pro result are publisher-reported. @sageai_official ↗
• vLLM adds day-zero Sage support vLLM says Sage-A1.5 can be served locally by model ID immediately. This establishes a supported path, not independent verification of the model’s agent benchmarks. @vllm_project ↗

Retrieval, evaluation and open tools

• Qdrant 1.20 folds BM25 into hybrid search Qdrant says a full-text index can now apply BM25 and combine it with vectors in one request. The release also names a code tokenizer, faster nested filters and turbo16/turbo8. @qdrant_engine ↗
• Decision Index 0.4 moves entirely to private tests The maintainer says the score now uses only private and in-house benchmarks to reduce benchmark gaming, with 224 models evaluated. That may improve contamination resistance while reducing external reproducibility. @multimodalart ↗
• x0 velocity proposes a drop-in diffusion target The proposal keeps the flow-matching forward process and sampling trajectory, then converts the network output back to velocity with one subtraction so existing samplers, schedulers and guidance can remain unchanged. @ostrisai ↗
• Hermes Labs opens an experimental plugin lane Nous says its new community-plugin repository will hold experiments that may not be maintained and explicitly encourages forks. The maintenance caveat is part of the release contract. @Teknium ↗
• DeepSeek Search enters a third-party index at the low-price end Artificial Analysis scores the search API 69, 17th of 27 products, and reports $0.75 per thousand searches in its Stirrup harness. This is a third-party benchmark of a paid service, not an open release. @ArtificialAnlys ↗

OS Reddit Recap

r/LocalLLaMA, r/LocalLLM and r/DeepSeek — local inference

• Kapitsa publishes a reproducible Flint sweep on M4 Pro A contributor reports 127.9 tok/s short-context decode, 45.7 at 128K, 23.3 GB peak memory and 0.13-second cached follow-up latency on an M4 Pro 48 GB; scripts and result files are linked. DotaMate ↗
• capy-flash pushes a 125B MoE into 64 GB RAM Version 0.7.1 streams 3-bit routed experts from RAM, caches hot experts in VRAM and reports 121 tok/s on one RTX 5070 Ti or 234 on two. The author discloses quality loss for the 27B 3-bit path. FeydRowan ↗
• A 510 GB DeepSeek build runs on a 12 GB RTX 3060 The author reports 5.8 tok/s cold and 7.4 warm by decoding with 2-bit experts and selectively rebuilding uncertain tokens from stored FP4 correction data. Code is not yet released, so reproduction is pending. Muted_Context_1999 ↗
• A local agent benchmark finds reliability saturating below 125B One 2×RTX 5080 harness reports 27B–35B quants matching or beating a 125B path on its agent tasks. Thinking improved hard-code scores but raised median latency from 36 ms to 629 ms. Joralk_ ↗

r/ollama, r/Qwen_AI and r/StableDiffusion — quantization and packaging

• BaseQuant releases three Qwen3.8-27B GGUF sizes The author lists 10.93, 16.41 and 20.82 GB files and reports 17–34% lower KL divergence from BF16 than similarly sized Unsloth quants. Everyday task quality remains unverified. nightowlsleeping ↗
• MOSS-Image’s download size is larger than its DiT A community audit separates the 10.16 GB BF16 or 5.41 GB int8 DiT from the required Qwen3.5-9B text encoder, which ranges from 7.34 to 19.31 GB, plus the VAE. katefix9 ↗
• Domyn Small gains llama.cpp support months after its weight release The post describes a 10B MIT model with thinking on/off, tool calls and 32K native context. Its cited card dates the model to May; the new event is runtime support, not a new checkpoint. jacek2023 ↗

Domain models

• Carbon-X reaches a local llama.cpp path The release post describes a 14B DNA/text model that runs locally and links the weights. Claims of beating every tested open DNA model and matching a frontier model remain author-reported. loubnabnl ↗

OS Discord Recap

Unsloth

• A 12-hour local coding project stress-tests compaction One user reports completing a project across eight or nine Qwen3.8-27B sessions, each using 200K context and repeatedly compacting around 150K, with typical working context around 70K–100K. Errrrrrr [UnAI],  Server Tag: UnAI UnAI ↗

Nous Research

• Hermes contributors expose several operational edge cases A maintainer roundup covers provider-only CLI resolution, SSH image uploads, tool-only workspace leakage, uv cache symlinks and bounded stale-stream re-kills, while distinguishing merge conflicts from workflow-approval blocks. Suhas [NOUS],  Server Tag: NOUS NOUS ↗
• Home Assistant timestamps move to local time A proposed plugin fix adds local forms of last_changed, last_updated and last_triggered because agents were manually converting UTC and sometimes choosing the wrong date. Sal [NOUS],  Server Tag: NOUS NOUS ↗
• Hermes adds an official 3D-generation plugin Nous announces a MeshyAI plugin integrated with the desktop app, including rendered models, a gallery, animations and 360-degree videos that can be sent through messaging platforms. teknium [NOUS],  Server Tag: NOUS NOUS Core Team ↗

Hugging Face

EleutherAI

Other primary-source items

llama.cpp

• The rerank endpoint accepts typed content Build b11818 adds TEI/Jina-shaped typed inputs, returns 400 for media/download failures and negative top_n, and rejects multimodal rerank requests when no compatible template exists instead of silently dropping images. github-actions[bot] ↗
• A SYCL layout bug was silently producing wrong convolution results Build b11815 fixes non-contiguous CWHN indexing, takes the affected CONV_2D tests from 16 failures to zero and reports 2,006 passing backend tests. github-actions[bot] ↗
• Domyn Small support requires tokenizer and GQA exceptions Build b11819 adds non-standard GQA, BPE handling, a Domyn pre-type and Metaspace prepend metadata rather than treating the model as a generic Nemotron variant. github-actions[bot] ↗
• KleidiAI adds Q8 SVE kernels Build b11811 adds Q8_0 SVE dot-product GEMV and SVE i8mm GEMM kernels for Arm targets. The feed does not quantify end-to-end speedups. github-actions[bot] ↗
• WebGPU gains Q2_0 support Build b11809 adds Q2_0 row dequantization and matrix multiplication, expanding low-bit browser/GPU execution support. github-actions[bot] ↗

Model applications

• IBM publishes an ensemble-forecasting guide The Hugging Face feed exposes a new article about combining IBM Granite time-series models. The collected item is title-only, so architecture and accuracy details are not asserted. Hugging Face blog ↗

Business of open AI

• DeepSeek reportedly raises $15 billion TechCrunch reports a $15 billion financing days after U.S. restrictions. The checked feed does not disclose investors, valuation, terms or closing evidence, so this remains a reported—not confirmed—round. Kate Park ↗

Companies & consequential moves