Update README.md

README.md

@@ -10,13 +10,37 @@ tags:
 
 ---
 
+Example usage:
 
 
-This model was created by tremendous work of mergekit developers. I decided to merge tinyLlama models to 
+```python
+from transformers import AutoModelForCausalLM
+from transformers import AutoTokenizer
+
+tokenizer = AutoTokenizer.from_pretrained("s3nh/TinyLLama-1.1B-MoE")
+tokenizer = AutoTokenizer.from_pretrained("s3nh/TinyLLama-1.1B-MoE")
+
+input_text =  """
+###Input: You are a pirate. tell me a story about wrecked ship.
+###Response:
+""")
+
+input_ids = tokenizer.encode(input_text, return_tensors='pt').to(device)
+output = model.generate(inputs=input_ids,
+                        max_length=max_length,
+                        do_sample=True,
+                        top_k=10,
+                        temperature=0.7,
+                        pad_token_id=tokenizer.eos_token_id,
+                        attention_mask=input_ids.new_ones(input_ids.shape))
+tokenizer.decode(output[0], skip_special_tokens=True)
+```
+
+
+This model was possible to create by tremendous work of mergekit developers. I decided to merge tinyLlama models to 
 create mixture of experts. 
 Config used as below:
 
-
 ```
 """base_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
 experts: