briliantnugraha commited on
Commit
393d690
·
verified ·
1 Parent(s): 0d202de

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +139 -0
README.md ADDED
@@ -0,0 +1,139 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: nvidia-open-model-license
4
+ license_link: https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-open-model-license
5
+ library_name: cosmos
6
+ tags:
7
+ - nvidia
8
+ - cosmos
9
+ - conversational
10
+ - llama-cpp
11
+ - gguf-my-repo
12
+ extra_gated_prompt: "# NVIDIA Open Model License Agreement\nVersion Release Date:\
13
+ \ September 23, 2025\nThis NVIDIA Open Model License Agreement (the “Agreement”)\
14
+ \ is a legal agreement between the Legal Entity You represent, or if no entity\
15
+ \ is identified, You and NVIDIA Corporation and its Affiliates (“NVIDIA”) and governs\
16
+ \ Your use of the Models that NVIDIA provides to You under this Agreement. NVIDIA\
17
+ \ and You are each a “party” and collectively the “parties.” \nNVIDIA models released\
18
+ \ under this Agreement are intended to be used permissively and enable the further\
19
+ \ development of AI technologies. Subject to the terms of this Agreement, NVIDIA\
20
+ \ confirms that: \n- Models are commercially usable. - You are free to create and\
21
+ \ distribute Derivative Models. - NVIDIA does not claim ownership to any outputs\
22
+ \ generated using the Models or Model Derivatives. \nBy using, reproducing, modifying,\
23
+ \ distributing, performing or displaying any portion or element of the Model or\
24
+ \ Derivative Model, or otherwise accepting the terms of this Agreement, you agree\
25
+ \ to be bound by this Agreement. \n## 1. Definitions\n1.1. **Derivative Model**\
26
+ \ means all (a) modifications to the Model, (b) works based on the Model, and (c)\
27
+ \ any other derivative works of the Model. An output is not a Derivative Model.\
28
+ \ \n1.2. **Legal Entity** means the union of the acting entity and all other entities\
29
+ \ that control, are controlled by, or are under common control with that entity.\
30
+ \ For the purposes of this definition, “control” means (a) the power, direct or\
31
+ \ indirect, to cause the direction or management of such entity, whether by contract\
32
+ \ or otherwise, or (b) ownership of fifty percent (50%) or more of the outstanding\
33
+ \ shares, or (c) beneficial ownership of such entity. \n1.3. **Model** means the\
34
+ \ machine learning model, software, checkpoints, learnt weights, algorithms, parameters,\
35
+ \ configuration files and documentation shared under this Agreement. \n1.4. **NVIDIA\
36
+ \ Cosmos Model** means a multimodal Model shared under this Agreement. \n1.5. **Special-Purpose\
37
+ \ Model** means a Model that is only competent in a narrow set of purpose-specific\
38
+ \ tasks and should not be used for unintended or general-purpose applications.\
39
+ \ \n1.6. **You** or **Your** means an individual or Legal Entity exercising permissions\
40
+ \ granted by this Agreement. \n## 2. Conditions for Use, License Grant, AI Ethics\
41
+ \ and IP Ownership\n### 2.1. Conditions for Use - The Model and any Derivative Model\
42
+ \ are subject to additional terms as described in Section 2 and Section 3 of this\
43
+ \ Agreement. - If You institute copyright or patent litigation against any entity\
44
+ \ alleging that the Model or a Derivative Model constitutes infringement, then any\
45
+ \ licenses granted will terminate as of the date such litigation is filed. - If\
46
+ \ You bypass or disable any technical limitation, safety guardrail, encryption,\
47
+ \ DRM, or authentication mechanism contained in the Model without a substantially\
48
+ \ similar Guardrail, your rights will terminate. - NVIDIA may designate a Model\
49
+ \ as a Special-Purpose Model. - NVIDIA may update this Agreement to comply with\
50
+ \ legal and regulatory requirements. \n### 2.2. License Grant NVIDIA grants You\
51
+ \ a perpetual, worldwide, non-exclusive, no-charge, royalty-free, revocable license\
52
+ \ to publicly perform, publicly display, reproduce, use, create derivative works\
53
+ \ of, make, have made, sell, offer for sale, distribute, and import the Model. \
54
+ \ \n### 2.3. AI Ethics Use of the Models must be consistent with NVIDIA’s [Trustworthy\
55
+ \ AI terms](https://www.nvidia.com/en-us/agreements/trustworthy-ai/terms/). \n\
56
+ ### 2.4. IP Ownership - NVIDIA owns the Model and any Model Derivatives it creates.\
57
+ \ - You own your Model Derivatives. - NVIDIA claims no ownership rights in outputs.\
58
+ \ - Except as expressly granted, NVIDIA reserves all rights. \n## 3. Redistribution\n\
59
+ You may reproduce and distribute copies of the Model or Derivative Models in any\
60
+ \ medium, with or without modifications, provided that: \n- **3.1.** You must provide\
61
+ \ recipients with a copy of this Agreement and include this attribution in a “Notice”\
62
+ \ text file: \n *“Licensed by NVIDIA Corporation under the NVIDIA Open Model License”*\
63
+ \ \n\n- **3.2.** If distributing or making available a NVIDIA Cosmos Model, or\
64
+ \ products/services derived from it, you must include: \n *“Built on NVIDIA Cosmos”*\
65
+ \ \n\n- **3.3.** You may add your own copyright statements and license terms for\
66
+ \ your modifications, provided use still complies with this Agreement. \n## 4.\
67
+ \ Separate Components The Models may include components licensed under separate\
68
+ \ legal notices (e.g., Open Source Software Licenses). These terms apply, except\
69
+ \ where overridden by this Agreement unless required by third-party license terms.\
70
+ \ \n## 5. Trademarks No permission is granted to use NVIDIA’s trade names, trademarks,\
71
+ \ or product names, except for reasonable descriptive use. \n## 6. Disclaimer of\
72
+ \ Warranty The Model is provided **“AS IS”**, without warranties of any kind, including\
73
+ \ title, non-infringement, merchantability, or fitness for purpose. You assume risks\
74
+ \ associated with its use. \n## 7. Limitation of Liability NVIDIA is not liable\
75
+ \ for damages (direct, indirect, incidental, or consequential) arising from use\
76
+ \ of the Model, unless required by law. \n## 8. Indemnity You will indemnify and\
77
+ \ hold NVIDIA harmless against claims from third parties arising from your use or\
78
+ \ distribution of the Model, derivatives, or outputs. \n## 9. Feedback NVIDIA may\
79
+ \ use any feedback you provide without restriction or compensation. \n## 10. Governing\
80
+ \ Law This Agreement is governed by U.S. and Delaware law. Courts in Santa Clara\
81
+ \ County, California, have exclusive jurisdiction, except for urgent injunctive\
82
+ \ relief. \n## 11. Trade and Compliance You must comply with all export, import,\
83
+ \ trade, and sanctions laws, including U.S. Export Administration Regulations and\
84
+ \ OFAC rules."
85
+ extra_gated_fields:
86
+ ? By clicking Submit below, I accept the terms of the NVIDIA Open Model License
87
+ Agreement and acknowledge that I am an adult of legal age of majority in the country
88
+ in which the Cosmos Models will be used and have authority to accept this Agreement
89
+ : checkbox
90
+ extra_gated_description: The information you provide will be collected, stored, processed
91
+ and shared in accordance with the [NVIDIA Privacy Policy](https://www.nvidia.com/en-us/about-nvidia/privacy-policy/).
92
+ extra_gated_button_content: Submit
93
+ base_model: nvidia/Cosmos-Reason2-8B
94
+ pipeline_tag: image-text-to-text
95
+ ---
96
+
97
+ # briliantnugraha/Cosmos-Reason2-8B-Q4_K_M-GGUF
98
+ This model was converted to GGUF format from [`nvidia/Cosmos-Reason2-8B`](https://huggingface.co/nvidia/Cosmos-Reason2-8B) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
99
+ Refer to the [original model card](https://huggingface.co/nvidia/Cosmos-Reason2-8B) for more details on the model.
100
+
101
+ ## Use with llama.cpp
102
+ Install llama.cpp through brew (works on Mac and Linux)
103
+
104
+ ```bash
105
+ brew install llama.cpp
106
+
107
+ ```
108
+ Invoke the llama.cpp server or the CLI.
109
+
110
+ ### CLI:
111
+ ```bash
112
+ llama-cli --hf-repo briliantnugraha/Cosmos-Reason2-8B-Q4_K_M-GGUF --hf-file cosmos-reason2-8b-q4_k_m.gguf -p "The meaning to life and the universe is"
113
+ ```
114
+
115
+ ### Server:
116
+ ```bash
117
+ llama-server --hf-repo briliantnugraha/Cosmos-Reason2-8B-Q4_K_M-GGUF --hf-file cosmos-reason2-8b-q4_k_m.gguf -c 2048
118
+ ```
119
+
120
+ Note: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.
121
+
122
+ Step 1: Clone llama.cpp from GitHub.
123
+ ```
124
+ git clone https://github.com/ggerganov/llama.cpp
125
+ ```
126
+
127
+ Step 2: Move into the llama.cpp folder and build it with `LLAMA_CURL=1` flag along with other hardware-specific flags (for ex: LLAMA_CUDA=1 for Nvidia GPUs on Linux).
128
+ ```
129
+ cd llama.cpp && LLAMA_CURL=1 make
130
+ ```
131
+
132
+ Step 3: Run inference through the main binary.
133
+ ```
134
+ ./llama-cli --hf-repo briliantnugraha/Cosmos-Reason2-8B-Q4_K_M-GGUF --hf-file cosmos-reason2-8b-q4_k_m.gguf -p "The meaning to life and the universe is"
135
+ ```
136
+ or
137
+ ```
138
+ ./llama-server --hf-repo briliantnugraha/Cosmos-Reason2-8B-Q4_K_M-GGUF --hf-file cosmos-reason2-8b-q4_k_m.gguf -c 2048
139
+ ```