hqfang commited on
Commit
1a51781
Β·
verified Β·
1 Parent(s): 4255723

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -2
README.md CHANGED
@@ -29,7 +29,10 @@ MolmoAct is a fully open-source action reasoning model for robotic manipulation
29
 
30
  This checkpoint is a **preview** of the MolmoAct release. All artifacts used in creating MolmoAct (data, training code, evaluations, intermediate checkpoints) will be made available at a later date, furthering our commitment to open-source AI development and reproducibility.
31
 
 
 
32
  Quick links:
 
33
  - πŸ“‚ [All Models](https://huggingface.co/collections/allenai/molmoact-689697591a3936fba38174d7)
34
  - πŸ“‚ [All Data](https://huggingface.co/collections/allenai/molmoact-data-mixture-6897e583e13b6c2cf3ea2b80)
35
  - πŸ“„ [Paper](https://arxiv.org/abs/2508.07917)
@@ -62,7 +65,7 @@ ckpt = "allenai/MolmoAct-7B-D-0812"
62
  processor = AutoProcessor.from_pretrained(
63
  ckpt,
64
  trust_remote_code=True,
65
- torch_dtype="auto",
66
  device_map="auto",
67
  padding_side="left",
68
  )
@@ -71,7 +74,7 @@ processor = AutoProcessor.from_pretrained(
71
  model = AutoModelForImageTextToText.from_pretrained(
72
  ckpt,
73
  trust_remote_code=True,
74
- torch_dtype="auto",
75
  device_map="auto",
76
  )
77
 
 
29
 
30
  This checkpoint is a **preview** of the MolmoAct release. All artifacts used in creating MolmoAct (data, training code, evaluations, intermediate checkpoints) will be made available at a later date, furthering our commitment to open-source AI development and reproducibility.
31
 
32
+ **Update:** Checkpoints are now stored in FP32 (previously BF16). The model was trained in FP32, so publishing FP32 weights aligns with training and enables fine-tuning or continued training directly from this repo. For inference, you can still run BF16 by casting at load, which is what we did for evaluations. See more in the [instructions](#quick-start) below.
33
+
34
  Quick links:
35
+
36
  - πŸ“‚ [All Models](https://huggingface.co/collections/allenai/molmoact-689697591a3936fba38174d7)
37
  - πŸ“‚ [All Data](https://huggingface.co/collections/allenai/molmoact-data-mixture-6897e583e13b6c2cf3ea2b80)
38
  - πŸ“„ [Paper](https://arxiv.org/abs/2508.07917)
 
65
  processor = AutoProcessor.from_pretrained(
66
  ckpt,
67
  trust_remote_code=True,
68
+ torch_dtype="bfloat16",
69
  device_map="auto",
70
  padding_side="left",
71
  )
 
74
  model = AutoModelForImageTextToText.from_pretrained(
75
  ckpt,
76
  trust_remote_code=True,
77
+ torch_dtype="bfloat16",
78
  device_map="auto",
79
  )
80