Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,969

Base only

Active filters: on-device

prism-ml/Ternary-Bonsai-2-27B-gguf

Text Generation • 27B • Updated 6 days ago • 2.82M • 1.96k

prism-ml/Ternary-Bonsai-2-27B-mlx-2bit

Text Generation • 27B • Updated 1 day ago • 48.2k • 358

Cactus-Compute/needle3

Text Generation • Updated 4 days ago • 62k • 209

openbmb/MiniCPM5-2B

Text Generation • 3B • Updated 12 days ago • 564k • 1.67k

dealignai/Bonsai-2-27B-Ternary-CRACK-GGUF

Text Generation • 27B • Updated 6 days ago • 44.1k • 136

huihui-ai/Huihui-Qwen3.8-27B-abliterated-GGUF

Image-Text-to-Text • 27B • Updated 2 days ago • 2.24M • 870

openbmb/MiniCPM5-2B-GGUF

Text Generation • 3B • Updated 12 days ago • 205k • 318

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 27B • Updated 23 days ago • 659k • • 1.39k

dealignai/Bonsai-2-27B-1bit-CRACK-GGUF

Text Generation • 27B • Updated 6 days ago • 25.5k • 75

prism-ml/Bonsai-27B-gguf

Text Generation • 27B • Updated Jul 17 • 450k • 872

prism-ml/Bonsai-27B-mlx-1bit

Text Generation • 2B • Updated Jul 14 • 1.11M • 256

oddadmix/Kokoro-7M-Distill

Text-to-Speech • Updated 7 days ago • 429 • 29

Cactus-Compute/needle2

Text Generation • Updated 21 days ago • 29.9k • 326

desert-ant-labs/voz

Automatic Speech Recognition • Updated 1 day ago • 203 • 41

openbmb/MiniCPM5-1B

Text Generation • 1B • Updated Aug 17 • 559k • 1.15k

Abiray/MiniCPM5-2B-heretic-abliterated-GGUF

Text Generation • 3B • Updated 16 days ago • 20.6k • 31

ganmoor-ai-labs/finanalyzer-indian-bank-statements

Text Generation • 2B • Updated 5 days ago • 388 • 10

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Jun 10 • 388k • 159

Supertone/supertonic-3

Text-to-Speech • Updated May 18 • 29k • 969

ginigen-ai/Edge-4B-TELL

Any-to-Any • 7B • Updated 5 days ago • 1.17k • 32

desert-ant-labs/uhm

Audio Classification • Updated about 9 hours ago • 2.04k • 14

desert-ant-labs/redact

Token Classification • Updated about 9 hours ago • 6.54k • 24

prism-ml/bonsai-image-ternary-4B-mlx-2bit

Text-to-Image • Updated Jun 1 • 1.08k • 101

openbmb/MiniCPM5-2B-SFT

Text Generation • 3B • Updated 12 days ago • 5.09k • 29

openbmb/MiniCPM5-2B-DSpark

Text Generation • 0.3B • Updated 17 days ago • 395k • 41

prism-ml/Ternary-Bonsai-27B-mlx-2bit

Text Generation • 27B • Updated Jul 14 • 1.1M • 198

openbmb/MiniCPM5-2B-Base

Text Generation • 3B • Updated 12 days ago • 9.37k • 28

openbmb/MiniCPM5-2B-DSpark-GGUF

Text Generation • 0.3B • Updated 15 days ago • 6.13k • 24

0xSojalSec/MiniCPM5-2B-Abliterated-Uncensored-GGUF

Text Generation • 3B • Updated 13 days ago • 3.48k • 9

Cactus-Compute/needle

30.4M • Updated Jul 13 • 356 • 349