Intel Neural Compressor

INC4AI

·

AI & ML interests

AI & ML interests

Recent Activity

updated a dataset about 17 hours ago

Intel/dynamic_model_information

new activity 1 day ago

Intel/low_bit_open_llm_leaderboard:Space Notifications

updated a model 1 day ago

LeaderboardModel1/Qwen-Image-Bench-AutoRound-W4A16-Tuning

View all activity

Organizations

INC4AI 's models 70

INC4AI/DeepSeek-V2-Lite-Chat-FP8-STATIC-ATTN-TEST-ONLY

16B • Updated Jan 7 • 4

INC4AI/DeepSeek-V2-Lite-Chat-BF16-FP8-STATIC-FP8-KV-TEST-ONLY

16B • Updated Dec 29, 2025 • 2.36k

INC4AI/DeepSeek-V2-Lite-Chat-Block-wise-FP8-Test-Only

16B • Updated Dec 29, 2025 • 9

INC4AI/Qwen3-8B-w2g64-AutoRound-test

2B • Updated Dec 23, 2025 • 5 • 1

INC4AI/Qwen3-235B-A22B-W4A16-G128-AutoRound-ITERS200-LLMC-TEST-ONLY

32B • Updated Dec 19, 2025 • 4

INC4AI/Qwen3-235B-A22B-W4A16-G128-AutoRound-ITERS1-LLMC-TEST-ONLY

Updated Dec 19, 2025

INC4AI/Qwen2.5-0.5B-W4A16-G128-AutoRound-LLMC-TEST-ONLY

Updated Dec 5, 2025

INC4AI/Ling-flash-2.0-gguf-q2ks-mixed-AutoRound

103B • Updated Oct 30, 2025 • 34 • 9

INC4AI/GLM-4.6-gguf-q2ks-mixed-AutoRound

357B • Updated Oct 24, 2025 • 4 • 6

INC4AI/DeepSeek-V3.1-Terminus-gguf-q2ks-mixed-AutoRound

671B • Updated Sep 25, 2025 • 12 • 6

INC4AI/DeepSeek-V3.1-Terminus-int4-mixed-AutoRound

Text Generation • 2B • Updated Sep 23, 2025 • 19 • 4

INC4AI/gpt-oss-20b-int4-g64-AutoRound

2B • Updated Sep 9, 2025 • 12

INC4AI/Seed-OSS-36B-Instruct-int4-AutoRound

2B • Updated Sep 1, 2025 • 7 • 14

INC4AI/Qwen2.5-VL-7B-Instruct-int4-mixed-AutoRound

2B • Updated Aug 25, 2025 • 16 • 1

INC4AI/GLM-4.5V-int4-AutoRound

2B • Updated Aug 15, 2025 • 19 • 14

INC4AI/Qwen3-Coder-480B-A35B-Instruct-gguf-q2ks-mixed-AutoRound

480B • Updated Jul 28, 2025 • 9 • 14

INC4AI/Qwen3-235B-A22B-Instruct-2507-gguf-q4km-AutoRound

235B • Updated Jul 24, 2025 • 34 • 8

INC4AI/neural-chat-7b-v3

Text Generation • 7B • Updated Nov 14, 2024 • 21 • • 67

INC4AI/Qwen2-7B-int4-inc

Text Generation • 2B • Updated Oct 24, 2024 • 10 • 6

INC4AI/phi-2-int4-inc

Text Generation • 0.6B • Updated Oct 22, 2024 • 21 • 4

INC4AI/falcon-7b-int4-inc

Text Generation • 7B • Updated Aug 26, 2024 • 10

INC4AI/gemma-2b-int4-inc

Text Generation • 3B • Updated Aug 26, 2024 • 16 • 1

INC4AI/neural-chat-7b-v3-1-int4-inc

Text Generation • 7B • Updated Aug 26, 2024 • 5 • 2

INC4AI/neural-chat-7b-v3-3-int4-inc

Text Generation • 7B • Updated Aug 26, 2024 • 6 • 2

INC4AI/Qwen2-0.5B-Instuct-int4-inc

Text Generation • 0.6B • Updated Jun 6, 2024 • 8 • 1

INC4AI/Qwen2-1.5B-Instuct-int4-inc

Text Generation • 2B • Updated Jun 6, 2024 • 10 • 3

INC4AI/Mistral-7B-v0.1-int4-inc-lmhead

Text Generation • 1B • Updated May 29, 2024 • 8 • 1

INC4AI/falcon-7b-sq-int8-inc

Text Generation • Updated Apr 17, 2024 • 25

INC4AI/albert-base-v2-sst2-int8-static-inc

Text Classification • Updated Mar 22, 2024 • 17

INC4AI/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic-inc

Text Classification • Updated Mar 21, 2024 • 1.34k • 1