varuneshv commited on
Commit
52c2ca9
·
verified ·
1 Parent(s): 3855742

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +179 -0
README.md CHANGED
@@ -1,3 +1,182 @@
1
  ---
2
  license: apache-2.0
 
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ base_model: Qwen/Qwen2.5-Coder-3B-Instruct
4
+ pipeline_tag: text-generation
5
+ tags:
6
+ - code-generation
7
+ - python
8
+ - qwen
9
+ - unsloth
10
+ - gguf
11
+ - coding-assistant
12
+ language:
13
+ - en
14
  ---
15
+
16
+ # VCoder
17
+
18
+ VCoder is a Python-focused coding assistant fine-tuned from Qwen2.5-Coder-3B-Instruct using LoRA and Unsloth.
19
+
20
+ The model was trained on 15,000 Python instruction-response examples from the Python Code Instructions 15K dataset and optimized for Python code generation, problem solving, debugging, and algorithm implementation.
21
+
22
+ ## Model Details
23
+
24
+ | Attribute | Value |
25
+ |------------|---------|
26
+ | Base Model | Qwen2.5-Coder-3B-Instruct |
27
+ | Fine-Tuning Method | LoRA |
28
+ | Framework | Unsloth |
29
+ | Dataset | Python Code Instructions 15K |
30
+ | Training Samples | 15,000 |
31
+ | GPU | NVIDIA Tesla T4 |
32
+ | Quantized Format | GGUF Q8_0 |
33
+ | Primary Language | Python |
34
+
35
+ ---
36
+
37
+ ## Training Pipeline
38
+
39
+ Training was performed incrementally:
40
+
41
+ | Stage | Samples |
42
+ |---------|---------|
43
+ | Stage 1 | 0 - 5,000 |
44
+ | Stage 2 | 5,000 - 10,000 |
45
+ | Stage 3 | 10,000 - 15,000 |
46
+
47
+ The model was trained using parameter-efficient fine-tuning (LoRA), allowing adaptation of the base model while keeping computational requirements low.
48
+
49
+ ---
50
+
51
+ ## Benchmark Results
52
+
53
+ ### HumanEval Comparison
54
+
55
+ The model was evaluated against the original Qwen2.5-Coder-3B-Instruct on HumanEval coding tasks.
56
+
57
+ | Model | Pass@1 |
58
+ |---------|---------|
59
+ | Base Qwen2.5-Coder-3B | 61.0% |
60
+ | VCoder | 68.0% |
61
+
62
+ ### Improvement
63
+
64
+ ```text
65
+ +7.0% Pass@1 improvement
66
+ ```
67
+
68
+ This demonstrates that the fine-tuned model performs better on Python coding tasks than the original base model.
69
+
70
+ ---
71
+
72
+ ## Example Usage
73
+
74
+ ### Python
75
+
76
+ ```python
77
+ prompt = """
78
+ ### Instruction:
79
+ Write a Python function to reverse a string.
80
+
81
+ ### Input:
82
+
83
+ ### Response:
84
+ """
85
+ ```
86
+
87
+ ### Example Output
88
+
89
+ ```python
90
+ def reverse_string(text):
91
+ return text[::-1]
92
+ ```
93
+
94
+ ---
95
+
96
+ ## Supported Tasks
97
+
98
+ - Python Code Generation
99
+ - Algorithm Design
100
+ - Data Structures
101
+ - Debugging
102
+ - Code Refactoring
103
+ - Coding Interview Questions
104
+ - Competitive Programming
105
+ - Function Completion
106
+
107
+ ---
108
+
109
+ ## GGUF Usage
110
+
111
+ Compatible with:
112
+
113
+ - Ollama
114
+ - LM Studio
115
+ - llama.cpp
116
+
117
+ ### Ollama
118
+
119
+ ```text
120
+ FROM ./VCoder.Q8_0.gguf
121
+ ```
122
+
123
+ Build:
124
+
125
+ ```bash
126
+ ollama create vcoder -f Modelfile
127
+ ```
128
+
129
+ Run:
130
+
131
+ ```bash
132
+ ollama run vcoder
133
+ ```
134
+
135
+ ---
136
+
137
+ ## Training Dataset
138
+
139
+ Dataset used:
140
+
141
+ Python Code Instructions 15K
142
+
143
+ The dataset contains instruction-response pairs focused on Python programming tasks including:
144
+
145
+ - Function generation
146
+ - Data manipulation
147
+ - Algorithms
148
+ - Debugging
149
+ - Problem solving
150
+
151
+ ---
152
+
153
+ ## Limitations
154
+
155
+ - Primarily optimized for Python.
156
+ - Benchmark performed on a subset of HumanEval tasks.
157
+ - May generate incorrect code for highly specialized domains.
158
+ - Should not be used as the sole source of production-critical code.
159
+
160
+ ---
161
+
162
+ ## Acknowledgements
163
+
164
+ - Qwen Team for Qwen2.5-Coder
165
+ - Unsloth for efficient fine-tuning
166
+ - Hugging Face
167
+ - OpenAI HumanEval Benchmark
168
+
169
+ ---
170
+
171
+ ## Citation
172
+
173
+ ```bibtex
174
+ @misc{vcoder2026,
175
+ title={VCoder: Python Code Generation Model},
176
+ author={Varunesh V, Prawin R K, Sarguru N},
177
+ year={2026},
178
+ base_model={Qwen2.5-Coder-3B-Instruct}
179
+ }
180
+ ```
181
+ Github : https://github.com/varunesh-v
182
+ Mail : varunesh.wrk@gmail.com