Update README.md
Browse files
README.md
CHANGED
|
@@ -14,7 +14,7 @@ This model aims to achieve controllable Computer-Aided Design (CAD) generation a
|
|
| 14 |
- **Model type:** Large Language Models
|
| 15 |
- **Language(s):** Python
|
| 16 |
- **License:** MIT
|
| 17 |
-
- **Finetuned from model:** Llama-3
|
| 18 |
|
| 19 |
### Model Sources
|
| 20 |
|
|
@@ -42,7 +42,7 @@ Use in any manner that violates applicable laws and regulations.
|
|
| 42 |
|
| 43 |
FlexCAD inherits any biases, errors or omissions produced by its base model. Develops are advised to choose an appropriate base LLM carefully, depending on the intended use case.
|
| 44 |
|
| 45 |
-
FlexCAD uses the Llama model. See https://huggingface.co/meta-llama/Llama-3
|
| 46 |
|
| 47 |
As the model is fine-tuned on very specific data about CAD models, it is unlikely to generate information other than CAD models.
|
| 48 |
|
|
@@ -92,7 +92,7 @@ See A.1 in our paper (https://arxiv.org/pdf/2411.05823) for a detailed definitio
|
|
| 92 |
|
| 93 |
#### Speeds, Sizes, Times
|
| 94 |
|
| 95 |
-
Llama-3
|
| 96 |
|
| 97 |
## Evaluation
|
| 98 |
|
|
@@ -106,29 +106,19 @@ The testing data is from an open-source dataset, DeepCAD: https://github.com/Chr
|
|
| 106 |
|
| 107 |
#### Metrics
|
| 108 |
|
| 109 |
-
- Generation diversity and quality on the generated CAD models in comparison to the test set, including Coverage (COV), Minimum Matching Distance (MMD) and Jensen-Shannon Divergence (JSD) [1][2].
|
| 110 |
- The percentage of predicted CAD sequences that can be successfully rendered into 3D models, denoted as Prediction Validity (PV).
|
| 111 |
-
- The percentage of the generated CAD models that are labeled as realistic ones by human evaluators, denoted as Realism.
|
| 112 |
-
|
| 113 |
-
[1] https://arxiv.org/abs/2207.04632
|
| 114 |
-
|
| 115 |
-
[2] https://arxiv.org/abs/2307.00149
|
| 116 |
|
| 117 |
### Results
|
| 118 |
|
| 119 |
#### Summary
|
| 120 |
-
We use prior work, including Skexgen
|
| 121 |
-
|
| 122 |
-
[1] https://arxiv.org/abs/2207.04632
|
| 123 |
-
|
| 124 |
-
[2] https://arxiv.org/abs/2307.00149
|
| 125 |
-
|
| 126 |
-
[3] https://platform.openai.com/docs/models#gpt-4o
|
| 127 |
|
| 128 |
|
| 129 |
## Environmental Impact
|
| 130 |
|
| 131 |
-
Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019).
|
| 132 |
|
| 133 |
|
| 134 |
## Citation
|
|
|
|
| 14 |
- **Model type:** Large Language Models
|
| 15 |
- **Language(s):** Python
|
| 16 |
- **License:** MIT
|
| 17 |
+
- **Finetuned from model:** Llama-3-8B
|
| 18 |
|
| 19 |
### Model Sources
|
| 20 |
|
|
|
|
| 42 |
|
| 43 |
FlexCAD inherits any biases, errors or omissions produced by its base model. Develops are advised to choose an appropriate base LLM carefully, depending on the intended use case.
|
| 44 |
|
| 45 |
+
FlexCAD uses the Llama model. See https://huggingface.co/meta-llama/Meta-Llama-3-8B to understand the capabilities and limitations of this model.
|
| 46 |
|
| 47 |
As the model is fine-tuned on very specific data about CAD models, it is unlikely to generate information other than CAD models.
|
| 48 |
|
|
|
|
| 92 |
|
| 93 |
#### Speeds, Sizes, Times
|
| 94 |
|
| 95 |
+
Llama-3-8B: 8B parameters
|
| 96 |
|
| 97 |
## Evaluation
|
| 98 |
|
|
|
|
| 106 |
|
| 107 |
#### Metrics
|
| 108 |
|
| 109 |
+
- Generation diversity and quality on the generated CAD models in comparison to the test set, including Coverage (COV), Minimum Matching Distance (MMD) and Jensen-Shannon Divergence (JSD) [\[1\]](https://arxiv.org/abs/2207.04632)[\[2\]](https://arxiv.org/abs/2307.00149).
|
| 110 |
- The percentage of predicted CAD sequences that can be successfully rendered into 3D models, denoted as Prediction Validity (PV).
|
| 111 |
+
- The percentage of the generated CAD models that are labeled as realistic ones by human evaluators, denoted as Realism.
|
|
|
|
|
|
|
|
|
|
|
|
|
| 112 |
|
| 113 |
### Results
|
| 114 |
|
| 115 |
#### Summary
|
| 116 |
+
We use prior work, including [Skexgen](https://arxiv.org/abs/2207.04632), [Hnc-cad](https://arxiv.org/abs/2307.00149), and prompting [GPT-4o](https://platform.openai.com/docs/models#gpt-4o), as baselines. FlexCAD demonstrates superior performance compared to these baselines across most metrics. Notably, it achieves significant improvements in PV, with the PV values for GPT-4o, Skexgen, Hnc-cad, and FlexCAD being 62.3%, 68.7%, 72.6%, and 93.4% respectively, in the context of sketch-level controllable generation. See Table 1 for the complete evaluation in our paper (https://arxiv.org/pdf/2411.05823).
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 117 |
|
| 118 |
|
| 119 |
## Environmental Impact
|
| 120 |
|
| 121 |
+
Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
|
| 122 |
|
| 123 |
|
| 124 |
## Citation
|