How to use bigcode/astraios-ptuning with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("bigcode/starcoderbase") model = PeftModel.from_pretrained(base_model, "bigcode/astraios-ptuning")
43a3b7d ebb5351 43a3b7d
1
2
3
4
version https://git-lfs.github.com/spec/v1 oid sha256:2e8f18a933a496ac1fb0a1253969ac767b4454041a50230570402c570520f7c9 size 738109
