Stars Radar
Support
LiveUpdated 2026-11-06 12:45 UTC

Models & inference

Models & inference scores 72/100 on the Stars Radar (#4), with 21 starred repositories and 447.9k GitHub stars.

No repository was starred in this market over the last 7 days.

Top Models & inference repositories

heretic

Fully automatic censorship removal for language models

Models & inference · 39.7k GitHub stars · starred 8 days ago · p-e-w

Edge0

Run 35B MoE models in ~2.5 GB of RAM. Weights stream from SSD; a trained router predicts loads a step ahead. Mac, iPhone, Android, Windows supported

Models & inference · 9.1k GitHub stars · starred 16 days ago · edge0-ai

litellm

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and…

Models & inference · 62.8k GitHub stars · starred 44 days ago · berriai

Sana

SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformer

Models & inference · 9.8k GitHub stars · starred 31 days ago · nvlabs

BitNet

Official inference framework for 1-bit LLMs

Models & inference · 41.5k GitHub stars · starred 32 days ago · microsoft

PowerInfer

High-speed Large Language Model Serving for Local Deployment

Models & inference · 9.9k GitHub stars · starred 38 days ago · tiiny-ai

whisper.cpp

Port of OpenAI's Whisper model in C/C++

Models & inference · 55k GitHub stars · starred 154 days ago · ggml-org

moshi

Moshi is a speech-text foundation model and full-duplex spoken dialogue framework. It uses Mimi, a state-of-the-art streaming neural audio codec.

Models & inference · 11.4k GitHub stars · starred 148 days ago · kyutai-labs

VoxCPM

VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning

Models & inference · 41.1k GitHub stars · starred 63 days ago · openbmb

OmniVoice

High-Quality Voice Cloning TTS for 600+ Languages

Models & inference · 16.3k GitHub stars · starred 87 days ago · k2-fsa

ultravox

A fast multimodal LLM for real-time voice

Models & inference · 4.6k GitHub stars · starred 148 days ago · fixie-ai

colibri

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

Models & inference · 48.3k GitHub stars · starred 50 days ago · justvugg

parakeet

OpenAI Whisper-compatible ASR server using NVIDIA Parakeet TDT 0.6B (ONNX). Super fast CPU/GPU transcriptions

Models & inference · 356 GitHub stars · starred 71 days ago · achetronic

Qwen3-Omni

Qwen3-omni is a natively end-to-end, omni-modal LLM developed by the Qwen team at Alibaba Cloud, capable of understanding text, audio, images, and video, as…

Models & inference · 4.1k GitHub stars · starred 148 days ago · qwenlm

laya-mlx

Native MLX runtime for Laya typed decision models — 7–14 ms short decisions on M3 Max. No text generation, PyTorch, or cloud API.

Models & inference · 7.1k GitHub stars · starred 45 days ago · mizorewww

models.dev

An open-source database of AI models.

Models & inference · 7.5k GitHub stars · starred 49 days ago · anomalyco

csm

A Conversational Speech Generation Model

Models & inference · 14.7k GitHub stars · starred 148 days ago · sesameailabs

magnitude

Open source inference engine optimized for consumer hardware. Profiles your machine, recommends the best models for it, then downloads, tunes, and runs them.…

Models & inference · 7.7k GitHub stars · starred 89 days ago · magnitudedev

VibeVoice

Open-Source Frontier Voice AI

Models & inference · 56.4k GitHub stars · starred 91 days ago · microsoft

jevonian

One local endpoint. The right model for every turn — enforced in code, not prompts.

Models & inference · 28 GitHub stars · starred 41 days ago · xinyao27

cadence

Machine learning library for building consensus-style equilibrium world models that continuously learn from experience.

Models & inference · 525 GitHub stars · starred 43 days ago · muellerberndt

FAQ

How many models & inference repositories does Agentik OS star?

21 repositories with 447.9k GitHub stars in total; 0 starred in the last 7 days. Market score: 72/100 (#4 of 10).

What are the newest models & inference repositories?

heretic, Edge0, litellm, Sana, BitNet. Updated 2026-11-06 12:45 UTC.

How is this ranked?

50% the number of starred repositories in the market, 30% their GitHub stars, 20% how many were starred in the last 7 days. See methodology.

Every repository Agentik OS stars on GitHub is read and classified by AGK Intelligence: what it is, which market it belongs to, how useful and how mature. 314 repositories, 10 markets. The stars are read every 5 minutes — last update 2026-11-06 12:45 UTC. Full method.