Spaces:

ai4bharat
/

IndicTrans3-beta

Running on Zero

AshwinSankar commited on Jun 18

Commit

03f4676

verified ·

1 Parent(s): 60a8e5b

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -44,7 +44,6 @@ class ModelManager:
                     torch_dtype=TORCH_DTYPE,
                     device_map=DEVICE_MAP,
                     token=HF_TOKEN,
-                    use_cache=True,  # Enable KV cache
                     low_cpu_mem_usage=True,
                     trust_remote_code=True
                 )
@@ -68,7 +67,6 @@ class ModelManager:
                     torch_dtype=TORCH_DTYPE,
                     device_map=DEVICE_MAP,
                     token=HF_TOKEN,
-                    use_cache=True,  # Enable KV cache
                     low_cpu_mem_usage=True,
                     trust_remote_code=True
                 )

                     torch_dtype=TORCH_DTYPE,
                     device_map=DEVICE_MAP,
                     token=HF_TOKEN,
                     low_cpu_mem_usage=True,
                     trust_remote_code=True
                 )
                     torch_dtype=TORCH_DTYPE,
                     device_map=DEVICE_MAP,
                     token=HF_TOKEN,
                     low_cpu_mem_usage=True,
                     trust_remote_code=True
                 )