Commit
·
0cb5dd1
1
Parent(s):
3a263de
add citation
Browse files
README.md
CHANGED
|
@@ -41,29 +41,23 @@ You can schedule 1:1 meeting with our DevRel & Community Team to get started wit
|
|
| 41 |
Stay tuned for more updates and be a part of the coding evolution. Join us on this exciting journey as we make AI accessible to all at AI Planet!
|
| 42 |
|
| 43 |
|
| 44 |
-
## Training and evaluation data
|
| 45 |
-
|
| 46 |
-
More information needed
|
| 47 |
-
|
| 48 |
-
## Training procedure
|
| 49 |
-
|
| 50 |
-
### Training hyperparameters
|
| 51 |
-
|
| 52 |
-
The following hyperparameters were used during training:
|
| 53 |
-
- learning_rate: 0.001
|
| 54 |
-
- train_batch_size: 1
|
| 55 |
-
- eval_batch_size: 8
|
| 56 |
-
- seed: 42
|
| 57 |
-
- gradient_accumulation_steps: 8
|
| 58 |
-
- total_train_batch_size: 8
|
| 59 |
-
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
| 60 |
-
- lr_scheduler_type: constant
|
| 61 |
-
- lr_scheduler_warmup_ratio: 0.03
|
| 62 |
-
- training_steps: 512
|
| 63 |
-
|
| 64 |
### Framework versions
|
| 65 |
|
| 66 |
- Transformers 4.33.3
|
| 67 |
- Pytorch 2.0.1+cu118
|
| 68 |
- Datasets 2.14.5
|
| 69 |
- Tokenizers 0.13.3
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 41 |
Stay tuned for more updates and be a part of the coding evolution. Join us on this exciting journey as we make AI accessible to all at AI Planet!
|
| 42 |
|
| 43 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 44 |
### Framework versions
|
| 45 |
|
| 46 |
- Transformers 4.33.3
|
| 47 |
- Pytorch 2.0.1+cu118
|
| 48 |
- Datasets 2.14.5
|
| 49 |
- Tokenizers 0.13.3
|
| 50 |
+
|
| 51 |
+
```
|
| 52 |
+
|
| 53 |
+
### Citation
|
| 54 |
+
|
| 55 |
+
```
|
| 56 |
+
@misc {lucifertrj,
|
| 57 |
+
author = { {Tarun Jain} },
|
| 58 |
+
title = { Panda Coder-13B by AI Planet},
|
| 59 |
+
year = 2023,
|
| 60 |
+
url = { https://huggingface.co/aiplanet/panda-coder-13B },
|
| 61 |
+
publisher = { Hugging Face }
|
| 62 |
+
}
|
| 63 |
+
```
|