Spaces:

wormcode
/

AskDoctor

Configuration error

wormcode commited on Aug 24, 2023

Commit

97f1e29

1 Parent(s): c6351f0

fix runtime error for model.half()

Files changed (1) hide show

app.py CHANGED Viewed

@@ -74,7 +74,7 @@ def main(
     model.config.bos_token_id = 1
     model.config.eos_token_id = 2
-    if not load_8bit:
         model.half()  # seems to fix bugs for some users.
     model.eval()

     model.config.bos_token_id = 1
     model.config.eos_token_id = 2
+    if not load_8bit and device != "cpu":
         model.half()  # seems to fix bugs for some users.
     model.eval()