diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000000000000000000000000000000000000..dbaadd7c6f7070d505fb41006927b04f9edfa7cd --- /dev/null +++ b/.gitattributes @@ -0,0 +1,138 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00041-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +mmproj-model-f16.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00001-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00002-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00003-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00004-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00006-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00005-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00008-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00007-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00010-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00009-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00012-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00011-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00014-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00013-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00016-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00015-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00018-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00017-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00020-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00019-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00022-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00021-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00024-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00023-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00026-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00025-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00028-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00027-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00030-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00029-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00032-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00031-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00034-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00033-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00036-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00035-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00038-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00037-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00040-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q2_K-GGUF/Q2_K-GGUF-00039-of-00041.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00061-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00001-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00002-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00003-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00004-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00005-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00006-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00007-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00008-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00009-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00010-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00011-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00012-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00013-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00014-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00015-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00016-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00017-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00018-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00019-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00020-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00021-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00022-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00023-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00024-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00025-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00026-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00027-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00028-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00029-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00030-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00031-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00032-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00033-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00034-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00035-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00036-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00037-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00038-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00039-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00040-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00041-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00042-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00043-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00044-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00045-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00046-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00047-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00048-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00049-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00050-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00051-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00052-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00053-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00054-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00055-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00056-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00057-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00058-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00059-of-00061.gguf filter=lfs diff=lfs merge=lfs -text +Q3_K-GGUF/Q3_K-GGUF-00060-of-00061.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Q2_K-GGUF/Q2_K-GGUF-00001-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00001-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..ee515c9aebf3bff1183859d170d54092985cd3f0 --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00001-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6be9a7614f4405eeea30dbd4c043b7c199fd1ecb7460ac91041a87dfc8ade1d7 +size 7768241152 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00002-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00002-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..2a6f9cbe93fb19b3ddae7d5e20444ef8eca87689 --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00002-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:eb8292456324fc3c8bbf353ca0c80f246c1a412e1b5e2935cfba5ee304bcdcd3 +size 8617252736 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00003-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00003-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..97e0d8570f2636e4bfdbfe10013ae18096e367ad --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00003-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cca563f437ef1796af2414ab25a8643a5807041191cfbd10f82f660d103cf74a +size 9948949728 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00004-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00004-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..3c079341eeb83c4131ddd9e348e6f454340bea42 --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00004-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2091884b203d05c2e511972e175fb37bced8716e20ac8bb0f76b70aa0c2c5e04 +size 8617252736 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00005-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00005-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..c00e66447bca5fd0ab6a7d91376a1471ace0a696 --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00005-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:374d11215e15ce040358bbe47b933bb6e9591902dcd20f867c02e9a7ed880235 +size 9948949728 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00006-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00006-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..104457e4518abd5df00611dd1c810c5ad8a2417b --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00006-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e48cece1028496f4e4f8279bb93a7a5aa6d8d8c496ed8cc2dd0b519723974dbf +size 8617252736 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00007-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00007-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..83adc5244ceac21a99799d8758525b9ee79cd33a --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00007-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3622e120912cac6afbdf698b20bf2d2c4ffc567c74fa6ceef47bac46c1712311 +size 9948949760 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00008-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00008-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..ace3068914162d65c6426818ed6edd7a7b2fd3b4 --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00008-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1a04b78b04433386c30083d08273a4cbaa47a7ac37f85ea118fe260ccccff192 +size 8617252768 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00009-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00009-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..310874f1bc34e1fee3eaaa98a605d96f216be43b --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00009-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:105ac05c6b88aafff778aacc436a5678bc9de1419a77ebdbe5437658768bcc1e +size 9948949760 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00010-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00010-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..13dada57b74eb5e276d314a53a9846889c7cd206 --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00010-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:01816af0079690d7b234e06f8dd4f908c3e3426c7c1411a41ec9f5fa75c686fd +size 8617252768 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00011-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00011-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..f2364a02b540970ca64b97de3c723df9bc0c84ff --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00011-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1edf98a37d627507a4362aaf4e3204f62054f2b68ed5138b9d1e386846cf0d7e +size 9948949760 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00012-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00012-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..40e3b457b146e5c17dbc36f84bedef6af8797ab6 --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00012-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a0ec3a67ced9e5b1b64a857112b035adf7abc61ddb894875b241927a1e393cee +size 8617252768 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00013-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00013-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..35a4ac0615fee891207f16161cf89eaa2244cabd --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00013-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1499d94b103562620f3d3e11e997a1f5ffbcae3342d8c56bd87be8ea61b4b74b +size 9948949760 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00014-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00014-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..d3cd72a26bf254a86be8c9c06ada8fecb7722f5e --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00014-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:058f00a21c21d9e29daade4de6edc25d693b13ca71f673b961c21476764e7393 +size 8617252768 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00015-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00015-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..539412a1bb74c453d627ce4f419eeb557edd0880 --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00015-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7bfc7224b4a4fba90768539b6288566af24d0ca090b2dc0156dc0ad28d1e1e54 +size 9948949760 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00016-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00016-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..5a434bee45d071b862d4c2a437bc3f4d6e874e8c --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00016-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bdcae6cc2f677c801fa779a1b72824d88b43eb0675bcefd593bc383df5fb3d1d +size 8617252768 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00017-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00017-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..7dc693a7b915971a2eb94627465f57bc5bac61aa --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00017-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4deacfdd0e4e2847557de3edd5bc23671650e4d485bc69512e537afeff2f32de +size 9948949760 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00018-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00018-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..a93d51a00572d5d6a9ed9557cadb4521418c921c --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00018-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:91176b135c1b39df8a5a6dd9a2a670a0940e094397c6b0c01373049f03059801 +size 8617252768 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00019-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00019-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..0bb1205ec17b96eb93d9487454d44f916d2af2cb --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00019-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9a30e0ac0adfe9cfe09252ebb3d47905e81563f23475a3e1b2a97891ed59347d +size 9948949760 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00020-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00020-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..6d69f940a0aaa8eac9afb6cb513215942bb52803 --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00020-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:90203e0063ac2e55146be952fef72c46157a0003acaa79b5cadfbf153dd5610e +size 8617252768 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00021-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00021-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..d776b7d73a77ceed650b1be008f19b95637f65dd --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00021-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0de55a070ad26138e56e1b2751f9ffed85d3517205711ac90a12ca1c71be3b18 +size 9948949760 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00022-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00022-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..0f796541124aa14cbd9caf2bbad7f9f7d727805e --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00022-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:dd06e743c8f9fcb0994b138ac2ca1e2d329fe2ba657f93bfee9c9068941e638b +size 8617252768 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00023-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00023-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..82068adb287b563dac3bfcd8cab801f2287d253b --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00023-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:48ad29c027ad4bac585f893b27bb28871ed71942bc072696cec386a309534fa9 +size 9948949760 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00024-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00024-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..6551b3506b0aab896c72e7f2d80925407fac143e --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00024-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2df7120f7f10e6fefe19bd6b8408ba545494b6f7002eba8c0061b513ee98c23c +size 8617252768 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00025-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00025-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..b8d971790026f62c22e3aedd6e946edf76d5ca9f --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00025-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ee95d938025869a4370b18c010cb4086531d1d2016238f42f0294dd9eb514979 +size 9948949760 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00026-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00026-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..51b9271c8837f53f9fdd29ea70b5c840f84c7667 --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00026-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cf2575afdb3fd1ccf1ebccd034d0edbddaa96f2e98447d7152011b28b2a1d5e3 +size 8617252768 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00027-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00027-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..5051ef046df6e96c727a98f41389fe64ea5d9433 --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00027-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:64cd13368f1917e2cb5d112a40e335029e272aeba359f3d4226245aec578d0aa +size 9948949760 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00028-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00028-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..65a4d78bab30340ce6974ed6ff330d95f364a9fa --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00028-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c0b9a43bb71229ba2ca79a82c5517a23fe00387c0567382473942608f66778ee +size 8617252768 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00029-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00029-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..b26de4e45fe9d24cd6f64a51869f15613c456526 --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00029-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4ebd0f387ea4fe1786b044a1157caf3ac0ff06f79b8db2ded0427883b9f92537 +size 9948949760 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00030-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00030-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..905d49a87d4b5a7769fbb004400e180aba0efc8e --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00030-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:779609dee1912e1d221703664ad475f60b65f5ac61e7039806fd83d07a4edc90 +size 8617252768 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00031-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00031-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..1a55176757ff1416b01581d4a57371643da267f5 --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00031-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9331130671cc488fe886aba3920d9d5dbf894265d8ea2659d1e38dcb23e78aaa +size 9948949760 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00032-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00032-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..6572ccd83f0042c09b441d71f3f28b3b479ba893 --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00032-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b05fa04617fd6b85a58287b91b45c31e26026f6d63e8c3a2ff45dc4a86c61f60 +size 8617252768 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00033-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00033-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..b7eaa65ce27f60379c611d151f256ba5f2340450 --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00033-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:42a0ee9eb9314c7f396b0888f10695bd006039f8460cf1ca00953775dd975b58 +size 9948949760 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00034-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00034-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..fe9d758306ec1f7aecf4832e272f9e52f5e55cab --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00034-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d34619a41bbade9280cde541feaf08da1ebf6a652dd539c43ca4ba524253f595 +size 8617252768 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00035-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00035-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..d8d20ec710ba6907cfb45113d91a3adb1513873c --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00035-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a872922e55ca3b1019999cbcfcb566df172b9b4e8d5502e39b107b63f3fed28f +size 9948949760 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00036-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00036-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..da6604214f3a58da094dba35c1da26b15e101ba7 --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00036-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c24a8791d61c5c3768b09449571f498a2002425c53e9133f1843e3a2eb8f071c +size 8617252768 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00037-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00037-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..95d723cd6e4be61886a6e3278763bd95bd2ddabc --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00037-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c5bab60ac972190ab568261ca86262c8d0f37ba2a6a5ed0eb8a5caf1114b62a2 +size 9948949760 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00038-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00038-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..a3328682f5399722991afa759fcafa5dda446787 --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00038-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cce9d7d66c9173d5c62dca5a6ecf562ca73156f12035a5e34f69ca7e979e82d1 +size 8617252768 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00039-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00039-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..c9cc33d816c0b5158dcfd18b83cf8a3150d45ffc --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00039-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a7e1c01f52b9471d6156e7b2f2aa503c2712c067b805e83acea7a34e9c61b06b +size 9948949760 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00040-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00040-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..5d1106d39278e4348aa57321c5f1e0913e86877b --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00040-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:11b0f28e4676c3d1c8982f9478fa02c191d0c0e26c1b20a0f1975d0f4f9e8757 +size 8617252768 diff --git a/Q2_K-GGUF/Q2_K-GGUF-00041-of-00041.gguf b/Q2_K-GGUF/Q2_K-GGUF-00041-of-00041.gguf new file mode 100644 index 0000000000000000000000000000000000000000..ac5b3ee1ea18c23c627333eecf743f2f2c805fd9 --- /dev/null +++ b/Q2_K-GGUF/Q2_K-GGUF-00041-of-00041.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:70aee54af148b62a45f50c002362a18224cf816868eb92f094687bb5348b0b22 +size 3720049152 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00001-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00001-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..e4bec8c798df32d905042e91dec957981ebbe63f --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00001-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a65b9d921e69c01eb388f56e3472d7814e7f3391011fc88b65c7c649543d3ef6 +size 8108227360 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00002-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00002-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..374f804fb2e91d8370a975a114a8970360cb59d7 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00002-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9c23cde2247c43502940698d52226d75394d07068353dbc3751635fbe0e60da2 +size 8805551360 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00003-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00003-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..9426b67beaafca8ce414b9d071cc6ee2335fbf85 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00003-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:46559c3bc1b26438beb39f487ea83c3c43cb1c993265b3bc3455ea3815074e5c +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00004-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00004-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..c33df620ac9c4e5317d1961f09b2223c1329b2a6 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00004-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:56a425c49874ca86750d4de936d0b5853595b6dfc908494ae33050c1568400b8 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00005-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00005-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..54e19c0e2a718008c2e045f6c09c2b744c140394 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00005-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:14e8eb5ece7a5fda6d60f9146a65275291cfba542e1b36a2c0292a46fdad9b67 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00006-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00006-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..3f493678e0e825b52f377e3cdd243620d0381408 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00006-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bb83db38163351e8a9003a317010bafc06816424a6cd1fcc7005db33509db596 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00007-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00007-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..28e00904be66b3c5989c18d1b5b783d240292d0d --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00007-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:31d512168fbc2547fd738f81fb847b8bd8d4ba5b055dbaebbde1ff276171fbb6 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00008-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00008-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..af560d3682ed8e6927852cbf5450b10cc54a5253 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00008-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6889700cdef4d9d40a32434e28fdcea51aa9be2fd75c9399bd63f8a3f0eef405 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00009-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00009-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..e5110eff74214e2a6c17ce1b55ebb50abe7ef06a --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00009-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e808dc5af1049e2109dbc452aef29520fe461eacfea948a7a35c19d5e9499880 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00010-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00010-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..0b6dad9162f25c7c6df4c94cba9a54d45cce3cd6 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00010-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:aa492589a7a0eb16ba47d621a9b8afe26b6656ef562d4c54c27b689a287a366a +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00011-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00011-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..790d91bbf2dc43aff1a8fcd376724b15bc48e57e --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00011-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2560cf469817d221b8b18fc7469111d7016a2221c3630eb062be630bef8698c5 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00012-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00012-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..3235ea231c9f75f74ad93087040894793c49071b --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00012-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:dd90e31b2aaddaddb06187a1d2b72fa850fbe0b4494301ba904e6ccaa0d33764 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00013-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00013-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..4f94b9dee6fb5429e3bd12e87a229d6d37b291ab --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00013-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2add5229232a505fda6481b527516178394ff3a7acfaf011a8d23d7108dba61a +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00014-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00014-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..d2059622bc1c310e43eed1bc1aa7d0891be65b19 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00014-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b4f6d3e84e180bcf24e161bd42da05950d2cfc812a2a8ca094422e8bf4e63168 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00015-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00015-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..83fe74abbc33ea9cad6459413cb60ee5773f50d6 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00015-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0ea4964599ac8947ec35b227fba8db08716d957ae4d9e9148ffa4a44386f3820 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00016-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00016-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..56fb33ce6ac9ea278a0d80d5182218eefdefc090 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00016-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2891ffb121abbb848f20d9a058b9dc774731c380ed543e615d430d0e1a8a5fcd +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00017-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00017-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..35ec4b51e9081cf1cd401e56b4bb20c1afe60ac8 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00017-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:354d0d74b7c66ce24a23a2a8b60223e571d8855c6a4a9277cd078b616e76b885 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00018-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00018-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..bacc1295025f98503c9007e386e3552567dba79b --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00018-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:79d6261dcbc992436df211fc3917463852ec700ff52109ce15879724cca5e78c +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00019-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00019-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..06a1d8ad53a917665c5f8140e50bd4f59e0d5055 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00019-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1d4ad87194818933a3ae08c5159b9b107a1ac1cdcd3a8d1565a1ebe7f0a737a3 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00020-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00020-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..ed0ced2ee6b7ee8ce7255a897e93498d95696be6 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00020-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8b46c5493e68be07bf02ba47fb0afec04286ac3f2a36971fff9f7f68e4dce161 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00021-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00021-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..345692183059a1159c0405331481057e95889f5b --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00021-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:919cab524a7471c82abcff554bb08bde3cfc5f9d6901908e6f51c4d2e9766a8c +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00022-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00022-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..306cfe3511bababe9bfc0abe2733a91df1bf6d3e --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00022-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a1cd6d33662d21d3ae03b78aa7822d5e8cf6f4637f5a08986834abce0f58b3df +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00023-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00023-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..65b3eb08f6bf2f0a91e6e311fc81c46a7c9301aa --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00023-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:dda8df73432602335bc1cf5ad6196dd56c1ee7e39aa5e332fddc77c116300093 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00024-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00024-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..5285b33fe9a455bc5310fb4706966d79f3b68650 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00024-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:569dfccab611c047b84a8cb2ce76ee6af683f553be55fbd2375f25a6efd77a73 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00025-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00025-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..ce9bf053faebbca313e3d543f4f1306a163193ca --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00025-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2561939c5ae290ef378bce56b6d531cb7e66c0513dae1404e2886ee8e62c1d16 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00026-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00026-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..38471591eb063a2a481bf0b46e47ea2f532f1ff9 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00026-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a69a1d227b8a77b67bebcfaba7efbb1ada683bc685549da4b3e0b1d78b0d996b +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00027-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00027-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..d49c9e1df14deb0a89e586d6af556a5b67949610 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00027-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4f8ef8999417d2e7e2e2d5b7b9edb4431bee65e9a2e2f6fa48fb53d1873028f9 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00028-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00028-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..9cdcdefae59b7c3912797156c1f1ad4c6c5aba85 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00028-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cb516f4f3977e598580c20591832be6974e12708ca2fcd1303602df094100195 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00029-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00029-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..e8a4445bb7d724b2c7d21bb0362f0e2627207e35 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00029-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4db01da269583b6d9c1e37bdf596438a7b17bf6df49f6c375fe90a8e58a8cb28 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00030-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00030-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..cd399419809fee857256ea1f8c87b70b70844246 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00030-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:552657b340043833bce6a00c5a115aca1640b06261f7174f83ef981ed10038a5 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00031-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00031-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..e81b2b368ff830de9fda7b780314b9fd609a5630 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00031-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5a23989dc6c9193b87a1d86ea7a2adf396265f438d66da86bd20346fb7b324fd +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00032-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00032-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..0869b702eeeafddd7d688cb08208672fc316f3df --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00032-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fc2f4848c04b236d69e3827f5040f053bbf4a8557a6896c294a4e7785ec4ded7 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00033-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00033-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..396f9ec43d6a7d09214284da8b72b5b9c31eb750 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00033-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:12fec933a0776b46ec2da9636b0a768104edaad1ef0e521350c6d323f54d8293 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00034-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00034-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..9d21eb1273fa4bf9d1498d4abd764b2f96b9d472 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00034-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0d56affb2400f587dbaabd00c217897423e0936a2458a28c113251e8cecbef8a +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00035-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00035-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..f535eec0170f56420cbaf233e166162663f59306 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00035-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e8a88e6836a770f5fb950278b8ddd9f46e59f8e408f4843486a4d35aafb2ce52 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00036-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00036-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..b84399760fc792066f5ffba122396e264cf50936 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00036-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:941f7c43dd4e8a84e684c65e77a8b877b3ce66838f2f12046ecc2101d9307c93 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00037-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00037-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..9b7f6b40fabff5a7622cf0b3f66a0d29d4099286 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00037-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4b7e1d3416769b11db897887daf5d304cbf62adbad499f4b69e5e7aceecfc226 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00038-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00038-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..e8cfc663a8af2dcf6be7512c972f30e739a47eea --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00038-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fc76b1c368b83eb6819b626eb083af18addf78346d33179aae3162bf15a591a3 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00039-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00039-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..0efd312a7319eff02e91e56371a0b5c9177118a7 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00039-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3335fd6fb32fcc4ece47c591a45377630be54c30f0201cf8987ddc10c4a0fc7e +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00040-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00040-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..5233c1d01ae1aee7646f65248192ee93aa4defcf --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00040-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bf90a2d6f95b0da3cd45bb86a0d28faacf2ae655201e09a4fa96594b93f4c3be +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00041-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00041-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..475ada0bbc26ff033f5357415b01981ed564de1e --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00041-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bd8cf2623d3431ec5bdabd1173e79eb35c1d4e77cf14bb6591433ab2e219bddf +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00042-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00042-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..2caeac72c3d797d102f3c7826f3d4b66178544aa --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00042-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:aae13547efc3ebb56a784923395db237875e2e5436de44eeee5262d96f4ac66a +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00043-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00043-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..d77f31ac798b3efa6035845189fb476711d081ee --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00043-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:18f1d7dca888a4ba37abb62c0b8eccf63b97003f272dab154cbbaac642b12075 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00044-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00044-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..a2b85036e524cb8c30970d093b237472948167c3 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00044-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:07a072c96b6d8c472641810fc1f1aa0471aac9705199e274c45c64453c1dfe67 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00045-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00045-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..74d0749f64650e8845bca2599e1a01bd907a2e11 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00045-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2bbaf65b86208736400b15a501b8725ab819fc86bb24a979aa8c329735e95f6f +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00046-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00046-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..050726d1f2927a1b17e64e26fb8c80e8dc651d9e --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00046-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3ce05dc8ed469e9bc63e26c8f58f13aea13d2564f0d33e1943fe349d336b7728 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00047-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00047-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..8794e40cf4d2fb62abd167d55d7520882ca24c55 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00047-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:81793401f24fcef39cf9519d05b6d499640ab9fc8dbd4c2a125cb634df18a8e5 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00048-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00048-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..67e8e66c14e6aa38cad40d0a827325c1365d78d5 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00048-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d72e0cca20f05a1fae1528b96728d428d65c74c93d03982ed26c91e09a1ee69c +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00049-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00049-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..4a12470461927765881010e121c0902e631daa21 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00049-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ed8891f3bcf1ec6767e37b47fe7bd7b87a4678fb37ff64c4a497fc40983dfce4 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00050-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00050-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..ce327e3635e43cfa2d9a9f6938b6330c3d505013 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00050-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8cb8d2201733a277a7a2ddfb19b063ef067e9a4c479383227cc4c6a7e848058d +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00051-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00051-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..d9445a5ef1e9d186e53d62c79e435f5932aa0e9b --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00051-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3bcc6f0f802d0dfab1ec7231e61154541e16942621237661f08bf4c8f7ca7e65 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00052-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00052-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..27aed26bf40b6c9849290069a6974ed99b2f01af --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00052-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ed3479c00f28bd96c9d3c369b8d69de096996751567c222d93056268bcbb0cc6 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00053-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00053-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..e8fa8a75a1ec014a5e1ccc7fb7167c99e5ccc35b --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00053-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:196b124f60fdadddfda54bbe0532d6022e7e20f286f0f448f0598fae951ec9d2 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00054-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00054-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..4a8456ebcc956dcfccc5f3dcd94513fa7637a29e --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00054-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:eae46ef0d6d9ba364a5e307e8514b2f848afa082eda2a3142057413b73814d1f +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00055-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00055-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..be74b846bda21371c2822841154f008dde3e6eab --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00055-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b2025c290a264afff9b38931a168abfb579543313aad1c32f375c3909dab6b76 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00056-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00056-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..84d55532e72ed7a6e24c1b0ef2cdb2e3bc9cf9d8 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00056-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:01f5d72feb18dc999c6161ba4430f8e1a8d6ba43901eb814da59005c35fa574d +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00057-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00057-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..407250fd4f0caaf300cae613f1a6db9045ce971b --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00057-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c5fe760c64a22ca5f9af4886b2f6ff9240c185b4b4a13aa9eedc238df912d2fa +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00058-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00058-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..108924e86c87e5a50e45e841e58685c4539696b8 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00058-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2e636a717b9112659f0b2bcc9818806a5cbbe03ea26ede311b0d67db3e03af5c +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00059-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00059-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..5202fe94c1bb4242d5d39a707dfc093a5fe084a7 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00059-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:03ec6cf30e7755ff4b85e76c29bd6b638cbff815109e3f16411036bf41f64961 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00060-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00060-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..d1c9575f036f4941bbd127c3c8c3c46c89b6de24 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00060-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1baa1ebd824bdd25fbc5176fb56be8c04e2395423e20cc38d2bb472402ea0fa1 +size 8099073280 diff --git a/Q3_K-GGUF/Q3_K-GGUF-00061-of-00061.gguf b/Q3_K-GGUF/Q3_K-GGUF-00061-of-00061.gguf new file mode 100644 index 0000000000000000000000000000000000000000..a8485868e83b7b946b5e3835ff745f64a06dac12 --- /dev/null +++ b/Q3_K-GGUF/Q3_K-GGUF-00061-of-00061.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b233878298fc78ee0d3161c55c07073393c8dc8069686e90154de1bb5d237d84 +size 2428518656 diff --git a/README.md b/README.md new file mode 100644 index 0000000000000000000000000000000000000000..aeed7f4ebcd17159149f3678935b36e5089c510b --- /dev/null +++ b/README.md @@ -0,0 +1,103 @@ +--- +license: other +license_name: modified-mit +library_name: transformers +pipeline_tag: image-text-to-text +base_model: +- moonshotai/Kimi-K2.5 +tags: +- abliterated +- uncensored +- GGUF + +--- + +# huihui-ai/Huihui-Kimi-K2.5-BF16-abliterated-GGUF + + +This is an uncensored version of [moonshotai/Kimi-K2.5](https://huggingface.co/moonshotai/Kimi-K2.5) created with abliteration (see [remove-refusals-with-transformers](https://github.com/Sumandora/remove-refusals-with-transformers) to know more about it). + +## Download and merge + +[Q2_K](https://huggingface.co/huihui-ai/Huihui-Kimi-K2.5-BF16-abliterated-GGUF/tree/main/Q2_K-GGUF) + + +[Q3_K](https://huggingface.co/huihui-ai/Huihui-Kimi-K2.5-BF16-abliterated-GGUF/tree/main/Q3_K-GGUF) + +Use the [llama.cpp](https://github.com/ggml-org/llama.cpp) split program to merge model (llama-gguf-split needs to be compiled.), + +``` +huggingface-cli download huihui-ai/Huihui-Kimi-K2.5-BF16-abliterated-GGUF --local-dir ./huihui-ai/Huihui-Kimi-K2.5-BF16-abliterated-GGUF --token xxx + +llama-gguf-split --merge huihui-ai/Huihui-Kimi-K2.5-BF16-abliterated-GGUF/Q2_K-GGUF/Q2_K-GGUF-00001-of-00041.gguf huihui-ai/Huihui-Kimi-K2.5-BF16-abliterated-GGUF/Q2_K.gguf +``` + +## Process image + +``` +llama-mtmd-cli -m huihui-ai/Huihui-Kimi-K2.5-BF16-abliterated-GGUF/Q2_K.gguf --mmproj huihui-ai/Huihui-Kimi-K2.5-BF16-abliterated-GGUF/mmproj-model-f16.gguf -c 40960 --image cars.jpg -p "Describe this image" + +``` + + +# Tool Calling + +By using llama-serve and the opencode test Tool Calling, it is evident that the performance is excellent. + +``` +llama-server -m huihui-ai/Huihui-Kimi-K2.5-BF16-abliterated-GGUF/Q3_K.gguf --port 8080 --host 0.0.0.0 -c 262144 +``` +The following are the relevant configurations for openconde.json used in a Docker environment. + +``` +{ + "$schema": "https://opencode.ai/config.json", + "provider": { + "llama-server": { + "npm": "@ai-sdk/openai-compatible", + "name": "llama-server", + "options": { + "baseURL": "http://host.docker.internal:8080/v1" + }, + "models": { + "Huihui-Kimi-K2.5-BF16-abliterated-Q3_K": { + "name": "Huihui-Kimi-K2.5-BF16-abliterated-Q3_K", + "tools": true, + "reasoning": false, + "options": { + "num_ctx": 262144 + } + } + } + } + } +} +``` + +### Usage Warnings + + + - **Risk of Sensitive or Controversial Outputs**: This model’s safety filtering has been significantly reduced, potentially generating sensitive, controversial, or inappropriate content. Users should exercise caution and rigorously review generated outputs. + + - **Not Suitable for All Audiences**: Due to limited content filtering, the model’s outputs may be inappropriate for public settings, underage users, or applications requiring high security. + + - **Legal and Ethical Responsibilities**: Users must ensure their usage complies with local laws and ethical standards. Generated content may carry legal or ethical risks, and users are solely responsible for any consequences. + + - **Research and Experimental Use**: It is recommended to use this model for research, testing, or controlled environments, avoiding direct use in production or public-facing commercial applications. + + - **Monitoring and Review Recommendations**: Users are strongly advised to monitor model outputs in real-time and conduct manual reviews when necessary to prevent the dissemination of inappropriate content. + + - **No Default Safety Guarantees**: Unlike standard models, this model has not undergone rigorous safety optimization. huihui.ai bears no responsibility for any consequences arising from its use. + + +### Donation + +If you like it, please click 'like' and follow us for more updates. +You can follow [x.com/support_huihui](https://x.com/support_huihui) to get the latest model information from huihui.ai. + +##### Your donation helps us continue our further development and improvement, a cup of coffee can do it. +- bitcoin(BTC): +``` + bc1qqnkhuchxw0zqjh2ku3lu4hq45hc6gy84uk70ge +``` +- Support our work on Ko-fi (https://ko-fi.com/huihuiai)! diff --git a/mmproj-model-f16.gguf b/mmproj-model-f16.gguf new file mode 100644 index 0000000000000000000000000000000000000000..6921e5d365d7d1f3b053a72447339c880932f4c8 --- /dev/null +++ b/mmproj-model-f16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:174d059abd167a5e151f0e7ab6a4c08dc7b3132a65c8701a27f939066931dce2 +size 952572096