Instructions to use Soofi-Project/Soofi-S-Base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Soofi-Project/Soofi-S-Base with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Soofi-Project/Soofi-S-Base")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("Soofi-Project/Soofi-S-Base", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Soofi-Project/Soofi-S-Base with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Soofi-Project/Soofi-S-Base"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Soofi-Project/Soofi-S-Base",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/Soofi-Project/Soofi-S-Base

SGLang

How to use Soofi-Project/Soofi-S-Base with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Soofi-Project/Soofi-S-Base" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Soofi-Project/Soofi-S-Base",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Soofi-Project/Soofi-S-Base" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Soofi-Project/Soofi-S-Base",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use Soofi-Project/Soofi-S-Base with Docker Model Runner:
```
docker model run hf.co/Soofi-Project/Soofi-S-Base
```

'This year' on the homepage, no date on the release page. Which is current?

by M-vdBerg - opened 4 days ago

Discussion

M-vdBerg

4 days ago

Great work on Soofi-S-Base, the technical report and public training/eval code are genuinely valuable.

But the release messaging doesn't add up. The soofi.info homepage says the open-source release is planned "this year," while the linked detail page ("Mehr erfahren") already softens that to "later in the project," timeline "to be announced."

The beta is also closed to new applicants, and the HF checkpoints remain gated closed-beta previews under a still-unfinished license.

For comparison, Switzerland's Apertus (ETH/EPFL) went from announcement to a fully open, Apache-2.0, publicly accessible release. A proof this is achievable, not a structural constraint of sovereign AI projects.

Could you commit to something firmer than "this year"? A target month/quarter, or the concrete milestones still outstanding (licensing, safety sign-off, trial results)? I'm holding off on a proper evaluation until this is settled, so even a tentative update would help a lot.

Thanks for the work so far, looking forward to something concrete.

Best,
Michael

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment