Spaces:

mikegarts
/

remarqify

Runtime error

mikegarts commited on Jun 23, 2022

Commit

29e5c9b

1 Parent(s): 2c32fbf

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -17,7 +17,7 @@ def generate(prompt):
     model, tokenizer = get_model()
     input_context = prompt
-    input_ids = tokenizer.encode(input_context, return_tensors="pt").to('cpu')
     outputs = model.generate(
         input_ids=input_ids,

     model, tokenizer = get_model()
     input_context = prompt
+    input_ids = tokenizer.encode(input_context, return_tensors="pt").to(model.device)
     outputs = model.generate(
         input_ids=input_ids,