# Inference example

```python
from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel

base = 'meta-llama/Llama-3.1-8B-Instruct'
adapter = './adapter'
tok = AutoTokenizer.from_pretrained(base)
model = AutoModelForCausalLM.from_pretrained(base, device_map='auto')
model = PeftModel.from_pretrained(model, adapter)
```