Haochen and Valerie helps me on Chameleon instance

Alok helps me on login in

image.png

image.png

done huggingface

Huggingface Lai@89251001 token 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

git clone https://Haibin428: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@huggingface.co/meta-llama/Llama-3.2-1B

image.png

huggingface example:

import torch
from transformers import pipeline
import time

model_id = "meta-llama/Llama-3.2-1B"
torch.manual_seed(123)

pipe = pipeline(
    "text-generation", 
    model=model_id, 
    torch_dtype=torch.bfloat16, 
    device_map="auto",
    max_new_tokens=256,
)

start = time.time()
res = pipe("The key to life is")