Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
ubermenchh
/
SmolLM2-DPO-ultrafeedback-binarized-preferences
like
0
Text Generation
Transformers
Safetensors
llama
Generated from Trainer
smol-course
module_1
trl
dpo
conversational
text-generation-inference
arxiv:
2305.18290
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
SmolLM2-DPO-ultrafeedback-binarized-preferences
/
merges.txt
ubermenchh
End of training
c0db0bf
verified
10 months ago
raw
Copy download link
history
contribute
delete
Safe
466 kB
File too large to display, you can
check the raw version
instead.