AI & ML interests

None defined yet.

multimodalartย 
posted an update about 1 year ago
view post
Post
41,612
Want to iterate on a Hugging Face Space with an LLM?

Now you can easily convert any HF entire repo (Model, Dataset or Space) to a text file and feed it to a language model!

multimodalart/repo2txt
  • 3 replies
ยท
multimodalartย 
posted an update over 1 year ago
view post
Post
18,666
Self-Forcing - a real-time video distilled model from Wan 2.1 by @adobe is out, and they open sourced it ๐Ÿ

I've built a live real time demo on Spaces ๐Ÿ“น๐Ÿ’จ

multimodalart/self-forcing
  • 6 replies
ยท
cbensimonย 
posted an update over 1 year ago
view post
Post
5,508
๐Ÿš€ ZeroGPU now supports PyTorch native quantization via torchao

While it hasnโ€™t been battle-tested yet, Int8WeightOnlyConfig is already working flawlessly in our tests.

Let us know if you run into any issues โ€” and weโ€™re excited to see what the community will build!

import spaces
from diffusers import FluxPipeline
from torchao.quantization.quant_api import Int8WeightOnlyConfig, quantize_

pipeline = FluxPipeline.from_pretrained(...).to('cuda')
quantize_(pipeline.transformer, Int8WeightOnlyConfig()) # Or any other component(s)

@spaces.GPU
def generate(prompt: str):
    return pipeline(prompt).images[0]
  • 5 replies
ยท
cbensimonย 
posted an update over 1 year ago
view post
Post
6,249
๐Ÿš€ ZeroGPU medium size is now available as a power-user feature

Nothing too fancy for nowโ€”ZeroGPU Spaces still default to large (70GB VRAM)โ€”but this paves the way for:
- ๐Ÿ’ฐ size-based quotas / pricing (medium will offer significantly more usage than large)
- ๐Ÿฆฃ the upcoming xlarge size (141GB VRAM)

You can as of now control GPU size via a Space variable. Accepted values:
- auto (future default)
- medium
- large (current default)

The auto mode checks total CUDA tensor size during startup:
- More than 30GB โ†’ large
- Otherwise โ†’ medium
  • 3 replies
ยท
cbensimonย 
posted an update about 2 years ago
view post
Post
4,813
Hello everybody,

We've rolled out a major update to ZeroGPU! All the Spaces are now running on it.

Major improvements:

1. GPU cold starts about twice as fast!
2. RAM usage reduced by two-thirds, allowing more effective resource usage, meaning more GPUs for the community!
3. ZeroGPU initializations (coldstarts) can now be tracked and displayed (use progress=gr.Progress(track_tqdm=True))
4. Improved compatibility and PyTorch integration, increasing ZeroGPU compatible spaces without requiring any modifications!

Feel free to answer in the post if you have any questions

๐Ÿค— Best regards,
Charles
multimodalartย 
posted an update over 2 years ago
view post
Post
35,712
New feature ๐Ÿ”ฅ
Image models and LoRAs now have little previews ๐Ÿค

If you don't know where to start to find them, I invite you to browse cool LoRAs in the profile of some amazing fine-tuners: @artificialguybr , @alvdansen , @DoctorDiffusion , @e-n-v-y , @KappaNeuro @ostris
  • 3 replies
ยท
multimodalartย 
posted an update over 2 years ago
view post
Post
28,688
The first open Stable Diffusion 3-like architecture model is JUST out ๐Ÿ’ฃ - but it is not SD3! ๐Ÿค”

It is Tencent-Hunyuan/HunyuanDiT by Tencent, a 1.5B parameter DiT (diffusion transformer) text-to-image model ๐Ÿ–ผ๏ธโœจ, trained with multi-lingual CLIP + multi-lingual T5 text-encoders for english ๐Ÿค chinese understanding

Try it out by yourself here โ–ถ๏ธ https://huggingface.co/spaces/multimodalart/HunyuanDiT
(a bit too slow as the model is chunky and the research code isn't super optimized for inference speed yet)

In the paper they claim to be SOTA open source based on human preference evaluation!
multimodalartย 
posted an update over 2 years ago
view post
Post
The Stable Diffusion 3 research paper broken down, including some overlooked details! ๐Ÿ“

Model
๐Ÿ“ 2 base model variants mentioned: 2B and 8B sizes

๐Ÿ“ New architecture in all abstraction levels:
- ๐Ÿ”ฝ UNet; โฌ†๏ธ Multimodal Diffusion Transformer, bye cross attention ๐Ÿ‘‹
- ๐Ÿ†• Rectified flows for the diffusion process
- ๐Ÿงฉ Still a Latent Diffusion Model

๐Ÿ“„ 3 text-encoders: 2 CLIPs, one T5-XXL; plug-and-play: removing the larger one maintains competitiveness

๐Ÿ—ƒ๏ธ Dataset was deduplicated with SSCD which helped with memorization (no more details about the dataset tho)

Variants
๐Ÿ” A DPO fine-tuned model showed great improvement in prompt understanding and aesthetics
โœ๏ธ An Instruct Edit 2B model was trained, and learned how to do text-replacement

Results
โœ… State of the art in automated evals for composition and prompt understanding
โœ… Best win rate in human preference evaluation for prompt understanding, aesthetics and typography (missing some details on how many participants and the design of the experiment)

Paper: https://stabilityai-public-packages.s3.us-west-2.amazonaws.com/Stable+Diffusion+3+Paper.pdf
  • 3 replies
ยท
multimodalartย 
posted an update over 2 years ago
multimodalartย 
posted an update over 2 years ago
view post
Post
It seems February started with a fully open source AI renaissance ๐ŸŒŸ

Models released with fully open dataset, training code, weights โœ…

LLM - allenai/olmo-suite-65aeaae8fe5b6b2122b46778 ๐Ÿง 
Embedding - nomic-ai/nomic-embed-text-v1 ๐Ÿ“š (sota!)

And it's literally February 1st - can't wait to see what else the community will bring ๐Ÿ‘€