Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,916

Base only

Active filters: llama.cpp

HuggingFaceBio/Carbon-8B-GGUF

8B • Updated 8 days ago • 1.1k • 8

bigatuna/Qwen3.5-9b-Sushi-Coder-RL-GGUF

Text Generation • 9B • Updated Apr 20 • 14.6k • 83

invincibleambuj/Ambuj-Tripathi-Indian-Legal-Llama-GGUF

1B • Updated 8 days ago • 4.4k • 33

S4MPL3BI4S/gemma4-coding-agent

8B • Updated Apr 10 • 9.35k • 21

WithinUsAI/Opus4.7-GODs.Ghost.Codex-4B.GGuF

Text Generation • 4B • Updated 27 days ago • 33.9k • 74

spiritbuun/Qwen3.6-27B-DFlash-GGUF

Updated Apr 24 • 32.2k • 70

YTan2000/Qwen3.6-35B-A3B-MTP-TQ3_4S

Image-Text-to-Text • 36B • Updated 9 days ago • 2.77k • 11

HuggingFaceBio/Carbon-3B-GGUF

3B • Updated 8 days ago • 1.04k • 7

armand0e/Qwen3.5-9B-Opus-Agent-GGUF

9B • Updated 4 days ago • 2.56k • 6

Brian6145/Qwen3.6-27B-Claude-Opus-Sonnet-DistilledV2-MTP-GGUF

Text Generation • 27B • Updated 7 days ago • 3.23k • 4

k0valik/Darwin-28B-Coder-IQ4_XS12.9GiB-GGUF

Text Generation • 27B • Updated 8 days ago • 653 • 3

osmapi/osmQwopus-3.6-27B-V2-heretic-abliterated-uncensored-TQ3_1s-GGUF

Image-Text-to-Text • 27B • Updated 5 days ago • 912 • 3

jedisct1/MiMo-V2.5-coder-Q2-v2-MTP

Text Generation • Updated 4 days ago • 402 • 3

pankajpandey-dev/Carbon-3B-GGUF

Text Generation • 3B • Updated 4 days ago • 431 • 3

LiquidAI/LFM2.5-VL-1.6B-GGUF

Image-Text-to-Text • 1B • Updated Mar 30 • 65.4k • 89

LiquidAI/LFM2.5-Audio-1.5B-GGUF

1B • Updated Mar 30 • 19k • 101

LiquidAI/LFM2.5-1.2B-Thinking-GGUF

Text Generation • 1B • Updated Apr 6 • 12.4k • 96

beleata74/BgGPT-Gemma-3-27B-IT-V2-GGUF-mmproj

Image-Text-to-Text • 27B • Updated Mar 30 • 298 • 2

kai-os/Carnice-9b-GGUF

Text Generation • 9B • Updated Apr 4 • 3.25k • 57

khazarai/Qwen3-4B-Qwen3.6-plus-Reasoning-Distilled-GGUF

Text Generation • 4B • Updated Apr 19 • 24.5k • 42

tomvaillant/qwen3.5-9b-abliterated-journalist-GGUF

9B • Updated 5 days ago • 404 • 2

loilkon/Qwopus3.5-9B-v3.5-Uncensored

Text Generation • 9B • Updated Apr 25 • 674 • 7

kai-os/Carnice-V2-27b-GGUF

27B • Updated Apr 25 • 346k • 104

GestaltLabs/Ornstein-Hermes-3.6-27b-GGUF

Image-Text-to-Text • 27B • Updated Apr 26 • 1.83k • 10

fesalfayed/gpt-oss-20b-hermes_agent-tool-finetune_gguf

Text Generation • 21B • Updated 28 days ago • 1.85k • 3

bekoozkan/godot-gemma-4-e4b-it-GGUF

Any-to-Any • 8B • Updated 22 days ago • 8.07k • 5

LibertAIDAI/Qwen3.6-35B-A3B-NVFP4-GGUF

Image-Text-to-Text • 35B • Updated 26 days ago • 3.52k • 7

localweights/Qwen3.6-27B-MTP-IQ4_XS-Q8nextn-GGUF

27B • Updated 23 days ago • 1.19k • 6

Dyluhn/lordx64-Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-MTP-GGUF

Text Generation • 36B • Updated 23 days ago • 6.75k • 9

sana0756/Gemma-4-GodMode-V9-Ultimate-GGUF

8B • Updated 21 days ago • 376 • 2