Instructions to use ICONNAI/ICONN-e1-Beta with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use ICONNAI/ICONN-e1-Beta with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="ICONNAI/ICONN-e1-Beta")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("ICONNAI/ICONN-e1-Beta")
model = AutoModelForCausalLM.from_pretrained("ICONNAI/ICONN-e1-Beta", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use ICONNAI/ICONN-e1-Beta with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "ICONNAI/ICONN-e1-Beta"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ICONNAI/ICONN-e1-Beta",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/ICONNAI/ICONN-e1-Beta

SGLang

How to use ICONNAI/ICONN-e1-Beta with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "ICONNAI/ICONN-e1-Beta" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ICONNAI/ICONN-e1-Beta",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "ICONNAI/ICONN-e1-Beta" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ICONNAI/ICONN-e1-Beta",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use ICONNAI/ICONN-e1-Beta with Docker Model Runner:
```
docker model run hf.co/ICONNAI/ICONN-e1-Beta
```

Enderchef commited on Jun 24, 2025

Commit

c12583d

verified ·

1 Parent(s): 05bf9df

Update README.md

Browse files

Files changed (1) hide show

README.md +31 -41

README.md CHANGED Viewed

@@ -1,7 +1,4 @@
 ---
-license: other
-license_name: iconn
-license_link: LICENSE
 library_name: transformers
 tags:
 - emotional-ai
@@ -9,51 +6,44 @@ tags:
 - chatbot
 - base
 co2_eq_emissions:
-  emissions: 2.74
   source: CodeCarbon
   training_type: pretraining
   geographical_location: US-West
   hardware_used: 18 x B200
-extra_gated_prompt: >
-  By accessing or downloading this model, you agree to the ICONN AI License
-  Agreement.  This includes restrictions on commercial use, redistribution,
-  derivative model training,  and uploading to public or private repositories.
-  You may not use this model to harm, surveil,  deceive, exploit, manipulate, or
-  conduct unethical AI research. All use must comply with  ethical standards and
-  respect human dignity.
-extra_gated_fields:
-  Full name: text
-  Organization (if any): text
-  Country: country
-  Date of agreement: date_picker
-  I am using this model for:
-    type: select
-    options:
-    - Personal use
-    - Internal business use
-    - Academic research
-    - Educational purposes
-    - label: Other (explain below)
-      value: other
-  Purpose explanation (if "Other"): text
-  I agree to all terms in the ICONN AI License Agreement, including:
-    type: checkbox
-    options:
-    - >-
-      I will NOT use this model for commercial purposes without explicit written
-      permission.
-    - >-
-      I will NOT redistribute, upload, or share this model in any public or
-      private repository.
-    - I will NOT train new models or derivatives from this model.
-    - >-
-      I will NOT use this model for unethical, harmful, deceptive, exploitative,
-      or surveillance purposes.
-    - I understand this license may be revoked if I breach any terms.
 pipeline_tag: text-generation
 ---
-# ICONN e1: The new era of Open-Source CoT in AI
 **GPU poor? Less than 3x A100s? A e1 Lite model is coming with just 22B parameters alongside a model for consumer CPUs with 14B and 7B parameters.**

 ---
 library_name: transformers
 tags:
 - emotional-ai
 - chatbot
 - base
 co2_eq_emissions:
+  emissions: 3.37
   source: CodeCarbon
   training_type: pretraining
   geographical_location: US-West
   hardware_used: 18 x B200
 pipeline_tag: text-generation
+license: apache-2.0
 ---
+<div align="center" style="line-height: 1;">
+![ICONN AI Logo](https://i.postimg.cc/gJwHqh1D/svgviewer-png-output.png)
+  <a href="https://huggingface.co/collections/ICONNAI/iconn-1-6851e8a88ed4eb66b4fd0132" target="_blank" style="margin: 2px;">
+    <img alt="ICONN 1 Models" src="https://img.shields.io/badge/📦_ICONN_1_Models-HuggingFace-1CBEEF?style=flat-square&labelColor=2C3E50" style="display: inline-block; vertical-align: middle;" />
+  </a>
+  <a href="https://huggingface.co/ICONNAI" target="_blank" style="margin: 2px;">
+    <img alt="ICONN on Hugging Face" src="https://img.shields.io/badge/🤗_ICONN_on_HF-ICONNAI-A4BCF0?style=flat-square&labelColor=2C3E50" style="display: inline-block; vertical-align: middle;" />
+  </a>
+  <a href="https://opensource.org/license/apache-2-0" target="_blank" style="margin: 2px;">
+    <img alt="License Apache 2.0" src="https://img.shields.io/badge/⚖️_License-Apache_2.0-5C63DA?style=flat-square&labelColor=2C3E50" style="display: inline-block; vertical-align: middle;" />
+  </a>
+  <a href="https://github.com/organizations/ICONN-AI/" target="_blank" style="margin: 2px;">
+    <img alt="ICONN on GitHub" src="https://img.shields.io/badge/🐙_ICONN_on_GitHub-ICONN--AI-8C8CFF?style=flat-square&labelColor=2C3E50" style="display: inline-block; vertical-align: middle;" />
+  </a>
+  <a href="https://huggingface.co/ICONNAI" target="_blank" style="margin: 2px;">
+    <img alt="Follow ICONNAI" src="https://img.shields.io/badge/⭐_Follow_ICONNAI-HuggingFace-A4BCF0?style=flat-square&labelColor=2C3E50" style="display: inline-block; vertical-align: middle;" />
+  </a>
+</div>
+# ICONN e1: The new era of Open-Source AI
 **GPU poor? Less than 3x A100s? A e1 Lite model is coming with just 22B parameters alongside a model for consumer CPUs with 14B and 7B parameters.**