ahxt
/

LiteLlama-460M-1T

Text Generation

llama2 architecture

text-generation-inference

Model card Files Files and versions

Update README.md

#3

by Tonic - opened Jan 7, 2024

base: refs/heads/main

←

from: refs/pr/3

Discussion Files changed

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -44,7 +44,7 @@ model.eval()
 prompt = 'Q: What is the largest bird?\nA:'
 input_ids = tokenizer(prompt, return_tensors="pt").input_ids
-tokens = model.generate(input_ids, max_length=20)
 print( tokenizer.decode(tokens[0].tolist(), skip_special_tokens=True) )
 # Q: What is the largest bird?\nA: The largest bird is a black-headed gull.
 ```

 prompt = 'Q: What is the largest bird?\nA:'
 input_ids = tokenizer(prompt, return_tensors="pt").input_ids
+tokens = model.generate(input_ids, max_length=22)
 print( tokenizer.decode(tokens[0].tolist(), skip_special_tokens=True) )
 # Q: What is the largest bird?\nA: The largest bird is a black-headed gull.
 ```