Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

samuelcardillo
/
Carnice-Qwen3.6-MoE-35B-A3B

HERMES
Safetensors
English
qwen3_5_moe
qwen3.6
Mixture of Experts
agentic
tool-calling
qlora
unsloth
carnice
Model card Files Files and versions
xet
Community
1

Instructions to use samuelcardillo/Carnice-Qwen3.6-MoE-35B-A3B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • HERMES

    How to use samuelcardillo/Carnice-Qwen3.6-MoE-35B-A3B with HERMES:

    # No code snippets available yet for this library.
    
    # To use this model, check the repository files and the library's documentation.
    
    # Want to help? PRs adding snippets are welcome at:
    # https://github.com/huggingface/huggingface.js
  • Notebooks
  • Google Colab
  • Kaggle
  • Local Apps Settings
  • Unsloth Studio

    How to use samuelcardillo/Carnice-Qwen3.6-MoE-35B-A3B with Unsloth Studio:

    Install Unsloth Studio (macOS, Linux, WSL)
    curl -fsSL https://unsloth.ai/install.sh | sh
    # Run unsloth studio
    unsloth studio -H 0.0.0.0 -p 8888
    # Then open http://localhost:8888 in your browser
    # Search for samuelcardillo/Carnice-Qwen3.6-MoE-35B-A3B to start chatting
    Install Unsloth Studio (Windows)
    irm https://unsloth.ai/install.ps1 | iex
    # Run unsloth studio
    unsloth studio -H 0.0.0.0 -p 8888
    # Then open http://localhost:8888 in your browser
    # Search for samuelcardillo/Carnice-Qwen3.6-MoE-35B-A3B to start chatting
    Using HuggingFace Spaces for Unsloth
    # No setup required
    # Open https://huggingface.co/spaces/unsloth/studio in your browser
    # Search for samuelcardillo/Carnice-Qwen3.6-MoE-35B-A3B to start chatting
    Load model with FastModel
    pip install unsloth
    from unsloth import FastModel
    model, tokenizer = FastModel.from_pretrained(
        model_name="samuelcardillo/Carnice-Qwen3.6-MoE-35B-A3B",
        max_seq_length=2048,
    )
Carnice-Qwen3.6-MoE-35B-A3B / fp8
35.8 GB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 1 commit
samuelcardillo's picture
samuelcardillo
Add FP8 dynamic quantization variant
034fe92 verified 4 months ago
  • chat_template.jinja
    8.06 kB
    Add FP8 dynamic quantization variant 4 months ago
  • config.json
    3.63 kB
    Add FP8 dynamic quantization variant 4 months ago
  • generation_config.json
    173 Bytes
    Add FP8 dynamic quantization variant 4 months ago
  • model.safetensors
    35.8 GB
    xet
    Add FP8 dynamic quantization variant 4 months ago
  • recipe.yaml
    176 Bytes
    Add FP8 dynamic quantization variant 4 months ago
  • tokenizer.json
    20 MB
    xet
    Add FP8 dynamic quantization variant 4 months ago
  • tokenizer_config.json
    1.2 kB
    Add FP8 dynamic quantization variant 4 months ago