Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

5,068

Base only

Active filters: llama.cpp

bigatuna/Qwen3.5-9b-Sushi-Coder-RL-GGUF

Text Generation • 9B • Updated Apr 20 • 11.6k • 83

prithivMLmods/Qwen3.5-9B-abliterated-v2-MAX

Image-Text-to-Text • 9B • Updated 2 days ago • 1.85k • 6

prism-ml/Bonsai-1.7B-gguf

Text Generation • 2B • Updated Apr 18 • 10.6k • 74

prithivMLmods/gemma-4-E2B-it-F32-GGUF

Image-Text-to-Text • 5B • Updated Apr 3 • 1.88k • 3

kai-os/Carnice-9b-GGUF

Text Generation • 9B • Updated Apr 4 • 3.02k • 57

apothic/bonsai-8B-1bit-turboquant

8B • Updated Apr 5 • 288 • 5

BrainboxAI/law-il-E2B

Text Generation • 5B • Updated Apr 22 • 244 • 3

Jackrong/Qwopus3.5-2B-v3-GGUF

2B • Updated Apr 12 • 1.88k • 5

prithivMLmods/gemma-4-E4B-it-Uncensored-MAX-GGUF

Image-Text-to-Text • 8B • Updated Apr 14 • 2.47k • 2

prithivMLmods/gemma-4-E2B-it-Uncensored-MAX-GGUF

Image-Text-to-Text • 5B • Updated Apr 14 • 3.72k • 4

batiai/Qwen3.6-35B-A3B-GGUF

Text Generation • 35B • Updated 30 days ago • 17.6k • 3

tomvaillant/qwen3.5-9b-abliterated-journalist-GGUF

9B • Updated 9 days ago • 398 • 2

exdysa/MiniMax-M2.7-REAP-172B-A10B-GGUF

Text Generation • 173B • Updated Apr 27 • 996 • 8

edbuildingstuff/splashco-drive-gguf

Text Generation • 1B • Updated Apr 20 • 16 • 1

jinaai/jina-embeddings-v5-omni-small-retrieval-GGUF

Feature Extraction • 0.6B • Updated 22 days ago • 3.45k • 3

mad-lab-ai/Qwen3.6-27B-tq-gguf

Text Generation • 27B • Updated Apr 23 • 993 • 5

batiai/Qwen3.6-27B-GGUF

Text Generation • 27B • Updated 30 days ago • 90.7k • 3

wangzhang/Qwen3.6-27B-abliterated-GGUF

Text Generation • 27B • Updated May 2 • 882 • 7

spiritbuun/Qwen3.6-27B-DFlash-GGUF

Updated Apr 24 • 20.3k • 70

GestaltLabs/Ornstein-Hermes-3.6-27b-GGUF

Image-Text-to-Text • 27B • Updated Apr 26 • 1.21k • 10

zlaabsi/Qwen3.6-27B-OTQ-GGUF

Image-Text-to-Text • 27B • Updated May 2 • 3.05k • 25

knoopx/Qwen3.6-35B-A3B-NVFP4-GGUF

Text Generation • 35B • Updated 29 days ago • 5.51k • 10

freakyskittle/MiniMax-M2.75-460B-A20B-GGUF

Text Generation • 453B • Updated 8 days ago • 782 • 1

ssweens/DeepSeek-V4-Flash-GGUF-YMMV

Text Generation • 284B • Updated 22 days ago • 8.02k • 5

kasimat/Qwen3.6-27B-AEON-Ultimate-Uncensored-GGUF

Text Generation • 27B • Updated 29 days ago • 2.14k • 1

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-GGUF-Q8_0

Image-Text-to-Text • 32B • Updated 28 days ago • 351 • 1

localweights/Qwen3.6-27B-MTP-IQ4_XS-Q8nextn-GGUF

27B • Updated 27 days ago • 1.3k • 6

AtomicChat/gemma-4-26B-A4B-it-assistant-GGUF

Text Generation • 0.4B • Updated 27 days ago • 30.6k • 23

Paulescu/LFM2.5-Audio-1.5B-OHF-Voice-GGUF

1B • Updated 22 days ago • 682 • 3

armand0e/Qwen3.5-9B-Agent-GGUF

9B • Updated 17 days ago • 3.47k • 5