Chinese-Llama-2-7b

Runtime error

shiyemin2 commited on Jul 22, 2023

Commit

dbb0b17

1 Parent(s): 042afcb

Update model.py

Files changed (1) hide show

model.py CHANGED Viewed

@@ -14,7 +14,6 @@ if torch.cuda.is_available():
         model = AutoModelForCausalLM.from_pretrained(
                 model_id,
                 load_in_4bit=True,
-                local_files_only=True,
                 torch_dtype=torch.float16
             )
     else:

         model = AutoModelForCausalLM.from_pretrained(
                 model_id,
                 load_in_4bit=True,
                 torch_dtype=torch.float16
             )
     else: