Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,493

Full-text search

Active filters: llama.cpp

TeichAI/GLM-4.7-Flash-Claude-Opus-4.5-High-Reasoning-Distill-GGUF

30B • Updated 16 days ago • 94.6k • 455

LiquidAI/LFM2-24B-A2B-GGUF

Text Generation • 24B • Updated 21 days ago • 25.6k • 106

TeichAI/Qwen3.5-27B-Claude-Opus-4.6-Distill-GGUF

27B • Updated 7 days ago • 9.99k • 21

avalon2244/Qwen3.5-4B-Claude-Opus-4.6-Distilled-GGUF

4B • Updated 4 days ago • 2.6k • 9

jinaai/jina-embeddings-v5-text-small-retrieval

Sentence Similarity • 0.6B • Updated 8 days ago • 158k • 15

Ex0bit/Qwen3.5-122B-A10B-PRISM-PRO-GGUF

Image-Text-to-Text • 122B • Updated 9 days ago • 148 • 16

Andycurrent/Mistral-Nemo-2407-12B-Thinking-Claude-Gemini-GPT5.2-Uncensored-HERETIC-GGUF

Text Generation • 12B • Updated 7 days ago • 4k • 5

Ex0bit/Qwen3.5-122B-A10B-PRISM-LITE-GGUF

Image-Text-to-Text • 122B • Updated 10 days ago • 2.86k • 10

Ex0bit/Qwen3.5-PRISM-Dynamic-Quant-GGUF

Text Generation • 0.8B • Updated 8 days ago • 2.88k • 7

LiquidAI/LFM2.5-1.2B-Thinking-GGUF

Text Generation • 1B • Updated Jan 16 • 55k • 66

jinaai/jina-embeddings-v5-text-small-text-matching

Sentence Similarity • 0.6B • Updated 8 days ago • 15.2k • 7

avalon2244/Qwen3.5-4B-Claude-Opus-4.6-Distilled

5B • Updated 4 days ago • 600 • 3

marksverdhei/LCO-Embedding-Omni-7B-GGUF

Feature Extraction • 8B • Updated 6 days ago • 712 • 3

LiquidAI/LFM2.5-1.2B-Instruct-GGUF

Text Generation • 1B • Updated Jan 5 • 58.2k • 139

seanbailey518/Step3-VL-10B-GGUF

8B • Updated Jan 30 • 3.68k • 8

TeichAI/Devstral-Small-2505-Deepseek-V3.2-Speciale-Distill-GGUF

24B • Updated Feb 4 • 2k • 7

jinaai/jina-embeddings-v5-text-small-clustering

Feature Extraction • 0.6B • Updated 8 days ago • 13.6k • 5

prithivMLmods/Qwen3-VL-4B-Instruct-Unredacted-MAX-GGUF

Image-Text-to-Image • 4B • Updated 24 days ago • 2.2k • 5

marksverdhei/LCO-Embedding-Omni-3B-GGUF

Feature Extraction • 3B • Updated 6 days ago • 652 • 2

Mustafaege/Qwen3.5-0.8B-GGUF-q4_k_m

Image-Text-to-Text • 0.8B • Updated 5 days ago • 813 • 2

prithivMLmods/Gliese-Qwen3.5-9B-Abliterated-Caption

Image-Text-to-Text • 9B • Updated about 5 hours ago • 2

google/gemma-2b-it-GGUF

3B • Updated Jun 27, 2024 • 136 • 20

LiquidAI/LFM2-350M-GGUF

Text Generation • 0.4B • Updated Dec 5, 2025 • 43.5k • 55

mistralai/Magistral-Small-2509-GGUF

24B • Updated Sep 18, 2025 • 1.22k • 70

vito95311/Qwen3-Omni-30B-A3B-Thinking-INT8FP16

Text Generation • 32B • Updated Sep 24, 2025 • 7 • 5

LiquidAI/LFM2-Audio-1.5B-GGUF

0.3B • Updated Dec 5, 2025 • 1.2k • 29

LiquidAI/LFM2-VL-3B-GGUF

Image-Text-to-Text • 3B • Updated Dec 5, 2025 • 79.1k • 34

geoffmunn/Qwen3-30B-A3B-Thinking-2507

Text Generation • 31B • Updated Nov 13, 2025 • 210 • 2

prithivMLmods/Qwen3-VL-8B-Instruct-abliterated-v2-GGUF

Image-Text-to-Text • 8B • Updated Dec 15, 2025 • 14k • 19

LiteMind/YutaLM-GGUF

Text Generation • 0.4B • Updated Dec 28, 2025 • 48 • 2