LiveUpdated 2026-09-28 23:38 UTC
Tiiny-AI/PowerInfer — High-speed Large Language Model Serving for Local Deployment
This is a stars post classified by Jev as Models & inference (a tool drop), kept by the Stars Radar because it carries real work, not commentary.
Tiiny-AI/PowerInfer — High-speed Large Language Model Serving for Local Deployment
Posted by Tiiny-AI (0 followers) 4 h ago · 9.8k likes · 9.8k views · view the original post on X. Kept by the Stars Radar as Models & inference. Tools mentioned: PowerInfer.
More stars work like this
- xinyao27/jevonian — One local endpoint. The right model for every turn — enforced in… — @xinyao27
- muellerberndt/cadence — Deep recursive settlement networks (DRSNs) that continuously… — @muellerberndt
- BerriAI/litellm — The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+… — @BerriAI
- mizorewww/laya-mlx — Native MLX runtime for Laya typed decision models — 7–14 ms short… — @mizorewww
- xai-org/x-algorithm — Algorithm powering the For You feed on X — @xai-org
- anomalyco/models.dev — An open-source database of AI models. — @anomalyco
- JustVugg/colibri — Run frontier MoE models on hardware you already own — pure C, zero… — @JustVugg
- OpenBMB/VoxCPM — VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation,… — @OpenBMB
Every post is read and classified by Jev (TypeSafe): what it is, which market it belongs to, and whether the link is a real tool. 246 posts from 1 X accounts over the last 365 days, 246 tools, 10 markets. Collected every 5 minutes, fully re-ranked every hour — last update 2026-09-28 23:38 UTC. Full method.