Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

runanywhere
/
bonsai_27b_1bit_HNPU

Text Generation
hnpu
hexagon
npu
v81
1-bit
Model card Files Files and versions
xet
Community
bonsai_27b_1bit_HNPU / v81
6.24 GB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 6 commits
sanmonga22's picture
sanmonga22
fix: coherent 1-bit decode shard 3 (GGUF-convention weight-fold fix)
fcfba01 verified 3 days ago
  • bonsai-27b-1024.json
    2.88 kB
    Bonsai-27B 1-bit v81 bundle (4 decode shards + 1-bit lmhead + fp16 embed + tokenizer + op-package stub) 4 days ago
  • bonsai27b_decode_s0_bitnet.bin
    873 MB
    xet
    fix: coherent 1-bit decode shard 0 (GGUF-convention weight-fold fix) 3 days ago
  • bonsai27b_decode_s1_bitnet.bin
    873 MB
    xet
    fix: coherent 1-bit decode shard 1 (GGUF-convention weight-fold fix) 3 days ago
  • bonsai27b_decode_s2_bitnet.bin
    873 MB
    xet
    fix: coherent 1-bit decode shard 2 (GGUF-convention weight-fold fix) 3 days ago
  • bonsai27b_decode_s3_bitnet.bin
    874 MB
    xet
    fix: coherent 1-bit decode shard 3 (GGUF-convention weight-fold fix) 3 days ago
  • bonsai27b_embed_f16.bin
    2.54 GB
    xet
    Bonsai-27B 1-bit v81 bundle (4 decode shards + 1-bit lmhead + fp16 embed + tokenizer + op-package stub) 4 days ago
  • bonsai27b_lmhead_bitnet.bin
    179 MB
    xet
    Bonsai-27B 1-bit v81 bundle (4 decode shards + 1-bit lmhead + fp16 embed + tokenizer + op-package stub) 4 days ago
  • tokenizer.json
    20 MB
    xet
    Bonsai-27B 1-bit v81 bundle (4 decode shards + 1-bit lmhead + fp16 embed + tokenizer + op-package stub) 4 days ago