Text Generation
Transformers
Safetensors
qwen3_5_text
qwen
accounting
transaction-classification
rule-classification
lora-merged
non-commercial
conversational
Instructions to use BlackwoodAI/LedgerGuard-27B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use BlackwoodAI/LedgerGuard-27B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="BlackwoodAI/LedgerGuard-27B") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("BlackwoodAI/LedgerGuard-27B") model = AutoModelForCausalLM.from_pretrained("BlackwoodAI/LedgerGuard-27B", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use BlackwoodAI/LedgerGuard-27B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "BlackwoodAI/LedgerGuard-27B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "BlackwoodAI/LedgerGuard-27B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/BlackwoodAI/LedgerGuard-27B
- SGLang
How to use BlackwoodAI/LedgerGuard-27B with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "BlackwoodAI/LedgerGuard-27B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "BlackwoodAI/LedgerGuard-27B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "BlackwoodAI/LedgerGuard-27B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "BlackwoodAI/LedgerGuard-27B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use BlackwoodAI/LedgerGuard-27B with Docker Model Runner:
docker model run hf.co/BlackwoodAI/LedgerGuard-27B
File size: 1,796 Bytes
692596c | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 | BlackwoodAI Personal Use Model License v1.0
Copyright (c) 2026 BlackwoodAI.
This license applies to the merged derivative model weights and BlackwoodAI
modifications in this repository.
Upstream base model notice:
This model is derived from Qwen/Qwen3.6-27B, which is distributed by its
upstream authors under the Apache License 2.0. Nothing in this license restricts
your independent use of the upstream Qwen/Qwen3.6-27B model under its own
license. Required upstream notices and attribution must be preserved.
Permission is granted to download and use this BlackwoodAI derivative model only
for personal, non-commercial research, experimentation, and evaluation.
You may not:
- sell, rent, sublicense, or otherwise commercially exploit this model;
- use this model, its outputs, or derivatives for any business, commercial, or
revenue-generating purpose;
- provide this model as a hosted API, SaaS, managed service, inference endpoint,
automation service, or other model-as-a-service offering;
- use this model inside a product, workflow, or service provided to third
parties, customers, clients, or employers;
- redistribute merged or modified versions for commercial use;
- remove or obscure this license or upstream attribution.
You may:
- run the model locally for personal testing;
- evaluate the model for non-commercial research;
- publish non-commercial benchmark results, provided they cite this repository
and do not include private training data.
No warranty:
THE MODEL IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND. BLACKWOODAI AND THE
UPSTREAM AUTHORS ARE NOT LIABLE FOR ANY CLAIM, DAMAGE, OR OTHER LIABILITY
ARISING FROM USE OF THE MODEL.
Termination:
Any use outside this license automatically terminates your rights to use this
BlackwoodAI derivative model.
|