runtime error

Exit code: 1. Reason: ███████▎ | 2.60G/3.55G [00:51<00:11, 81.2MB/s] model.safetensors: 77%|███████▋ | 2.74G/3.55G [00:52<00:08, 93.0MB/s] model.safetensors: 80%|████████ | 2.85G/3.55G [00:55<00:09, 72.3MB/s] model.safetensors: 83%|████████▎ | 2.95G/3.55G [00:56<00:08, 72.6MB/s] model.safetensors: 86%|████████▌ | 3.04G/3.55G [00:57<00:06, 75.7MB/s] model.safetensors: 88%|████████▊ | 3.13G/3.55G [00:58<00:05, 79.7MB/s] model.safetensors: 91%|█████████ | 3.23G/3.55G [01:00<00:04, 73.0MB/s] model.safetensors: 96%|█████████▌| 3.41G/3.55G [01:01<00:01, 96.8MB/s] model.safetensors: 99%|█████████▉| 3.53G/3.55G [01:02<00:00, 102MB/s]  model.safetensors: 100%|█████████▉| 3.55G/3.55G [01:04<00:00, 55.1MB/s] /usr/local/lib/python3.10/site-packages/psutil/__init__.py:2017: RuntimeWarning: available memory stats couldn't be determined and was set to 0 ret = _psplatform.virtual_memory() generation_config.json: 0%| | 0.00/181 [00:00<?, ?B/s] generation_config.json: 100%|██████████| 181/181 [00:00<00:00, 275kB/s] Traceback (most recent call last): File "/home/user/app/app.py", line 140, in <module> load_model() # Pre-load the model File "/home/user/app/app.py", line 19, in load_model model = AutoModelForCausalLM.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 564, in from_pretrained return model_class.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 4302, in from_pretrained dispatch_model(model, **device_map_kwargs) File "/usr/local/lib/python3.10/site-packages/accelerate/big_modeling.py", line 498, in dispatch_model raise ValueError( ValueError: You are trying to offload the whole model to the disk. Please use the `disk_offload` function instead.

Container logs: