Safetensors
ShizhaoSun commited on
Commit
dadfcf3
·
verified ·
1 Parent(s): 00348bf

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -17
README.md CHANGED
@@ -14,7 +14,7 @@ This model aims to achieve controllable Computer-Aided Design (CAD) generation a
14
  - **Model type:** Large Language Models
15
  - **Language(s):** Python
16
  - **License:** MIT
17
- - **Finetuned from model:** Llama-3.1-8B
18
 
19
  ### Model Sources
20
 
@@ -42,7 +42,7 @@ Use in any manner that violates applicable laws and regulations.
42
 
43
  FlexCAD inherits any biases, errors or omissions produced by its base model. Develops are advised to choose an appropriate base LLM carefully, depending on the intended use case.
44
 
45
- FlexCAD uses the Llama model. See https://huggingface.co/meta-llama/Llama-3.1-8B to understand the capabilities and limitations of this model.
46
 
47
  As the model is fine-tuned on very specific data about CAD models, it is unlikely to generate information other than CAD models.
48
 
@@ -92,7 +92,7 @@ See A.1 in our paper (https://arxiv.org/pdf/2411.05823) for a detailed definitio
92
 
93
  #### Speeds, Sizes, Times
94
 
95
- Llama-3.1-8B: 8B parameters
96
 
97
  ## Evaluation
98
 
@@ -106,29 +106,19 @@ The testing data is from an open-source dataset, DeepCAD: https://github.com/Chr
106
 
107
  #### Metrics
108
 
109
- - Generation diversity and quality on the generated CAD models in comparison to the test set, including Coverage (COV), Minimum Matching Distance (MMD) and Jensen-Shannon Divergence (JSD) [1][2].
110
  - The percentage of predicted CAD sequences that can be successfully rendered into 3D models, denoted as Prediction Validity (PV).
111
- - The percentage of the generated CAD models that are labeled as realistic ones by human evaluators, denoted as Realism.
112
-
113
- [1] https://arxiv.org/abs/2207.04632
114
-
115
- [2] https://arxiv.org/abs/2307.00149
116
 
117
  ### Results
118
 
119
  #### Summary
120
- We use prior work, including Skexgen [1], Hnc-cad [2], and prompting GPT-4o [3], as baselines. FlexCAD demonstrates superior performance compared to these baselines across most metrics. Notably, it achieves significant improvements in PV, with the PV values for GPT-4o, Skexgen, Hnc-cad, and FlexCAD being 62.3%, 68.7%, 72.6%, and 93.4% respectively, in the context of sketch-level controllable generation. See Table 1 for the complete evaluation in our paper (https://arxiv.org/pdf/2411.05823).
121
-
122
- [1] https://arxiv.org/abs/2207.04632
123
-
124
- [2] https://arxiv.org/abs/2307.00149
125
-
126
- [3] https://platform.openai.com/docs/models#gpt-4o
127
 
128
 
129
  ## Environmental Impact
130
 
131
- Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019).
132
 
133
 
134
  ## Citation
 
14
  - **Model type:** Large Language Models
15
  - **Language(s):** Python
16
  - **License:** MIT
17
+ - **Finetuned from model:** Llama-3-8B
18
 
19
  ### Model Sources
20
 
 
42
 
43
  FlexCAD inherits any biases, errors or omissions produced by its base model. Develops are advised to choose an appropriate base LLM carefully, depending on the intended use case.
44
 
45
+ FlexCAD uses the Llama model. See https://huggingface.co/meta-llama/Meta-Llama-3-8B to understand the capabilities and limitations of this model.
46
 
47
  As the model is fine-tuned on very specific data about CAD models, it is unlikely to generate information other than CAD models.
48
 
 
92
 
93
  #### Speeds, Sizes, Times
94
 
95
+ Llama-3-8B: 8B parameters
96
 
97
  ## Evaluation
98
 
 
106
 
107
  #### Metrics
108
 
109
+ - Generation diversity and quality on the generated CAD models in comparison to the test set, including Coverage (COV), Minimum Matching Distance (MMD) and Jensen-Shannon Divergence (JSD) [\[1\]](https://arxiv.org/abs/2207.04632)[\[2\]](https://arxiv.org/abs/2307.00149).
110
  - The percentage of predicted CAD sequences that can be successfully rendered into 3D models, denoted as Prediction Validity (PV).
111
+ - The percentage of the generated CAD models that are labeled as realistic ones by human evaluators, denoted as Realism.
 
 
 
 
112
 
113
  ### Results
114
 
115
  #### Summary
116
+ We use prior work, including [Skexgen](https://arxiv.org/abs/2207.04632), [Hnc-cad](https://arxiv.org/abs/2307.00149), and prompting [GPT-4o](https://platform.openai.com/docs/models#gpt-4o), as baselines. FlexCAD demonstrates superior performance compared to these baselines across most metrics. Notably, it achieves significant improvements in PV, with the PV values for GPT-4o, Skexgen, Hnc-cad, and FlexCAD being 62.3%, 68.7%, 72.6%, and 93.4% respectively, in the context of sketch-level controllable generation. See Table 1 for the complete evaluation in our paper (https://arxiv.org/pdf/2411.05823).
 
 
 
 
 
 
117
 
118
 
119
  ## Environmental Impact
120
 
121
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
122
 
123
 
124
  ## Citation