|
|
--- |
|
|
license: apache-2.0 |
|
|
datasets: |
|
|
- tomg-group-umd/wikipedia-en-2k-samples |
|
|
- BASF-AI/WikipediaEasy10Classification |
|
|
language: |
|
|
- en |
|
|
--- |
|
|
# SLiNeP |
|
|
|
|
|
*Super Low Parameter Wikipedia-based Neural Predictor* |
|
|
Super small gpt 2 based model trained from 11.6 Mb of wikipedia data. |
|
|
|
|
|
Each topic starts with `Topic Name : Topic Text` and ends with ` <|endmsg|> `. |
|
|
This is the medium version repo. |
|
|
Since the model is small and trained on minimal data |
|
|
it doesnt know many facts, but it learned some english. |
|
|
Its recommended to finetune it. |
|
|
I also didn't test it yet but it probably needs low temp to stop saying nonsensical things |
