Upload README.md with huggingface_hub

README.md

@@ -0,0 +1,150 @@
+
+---
+
+license: apache-2.0
+tags:
+- merge
+- TIES
+- Llama3
+- BestMix
+- Chemistry
+- Einstein
+- instruction-following
+- conversational
+- long-form-generation
+- scientific
+base_model:
+- bunnycore/Best-Mix-Llama-3.1-8B
+
+---
+
+[![QuantFactory Banner](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeiuCm7c8lEwEJuRey9kiVZsRn2W-b4pWlu3-X534V3YmVuVc2ZL-NXg2RkzSOOS2JXGHutDuyyNAUtdJI65jGTo8jT9Y99tMi4H4MqL44Uc5QKG77B0d6-JfIkZHFaUA71-RtjyYZWVIhqsNZcx8-OMaA?key=xt3VSDoCbmTY7o-cwwOFwQ)](https://hf.co/QuantFactory)
+
+
+# QuantFactory/Llama3.1-BestMix-Chem-Einstein-8B-GGUF
+This is quantized version of [ZeroXClem/Llama3.1-BestMix-Chem-Einstein-8B](https://huggingface.co/ZeroXClem/Llama3.1-BestMix-Chem-Einstein-8B) created using llama.cpp
+
+# Original Model Card
+
+
+
+# **ZeroXClem/Llama3.1-BestMix-Chem-Einstein-8B**
+
+**Llama3.1-BestMix-Chem-Einstein-8B** is an innovative, meticulously blended model designed to excel in **instruction-following**, **chemistry-focused tasks**, and **long-form conversational generation**. This model fuses the **best qualities** of multiple Llama3-based architectures, making it highly versatile for both general and specialized tasks. 💻🧠✨
+
+## 🌟 **Family Tree**
+
+This model is the result of merging the following:
+
+- [**bunnycore/Best-Mix-Llama-3.1-8B**](https://huggingface.co/bunnycore/Best-Mix-Llama-3.1-8B): A balanced blend of top Llama models, optimized for general performance across reasoning, instruction-following, and math.
+- [**USTC-KnowledgeComputingLab/Llama3-KALE-LM-Chem-1.5-8B**](https://huggingface.co/USTC-KnowledgeComputingLab/Llama3-KALE-LM-Chem-1.5-8B): A model specialized in **scientific knowledge** and **chemistry**, excelling in chemistry benchmarks.
+- [**Weyaxi/Einstein-v6.1-Llama3-8B**](https://huggingface.co/Weyaxi/Einstein-v6.1-Llama3-8B): Fine-tuned for **long-form generation**, **conversation-heavy tasks**, and optimized with cutting-edge techniques for efficient memory usage and fast performance.
+
+---
+
+## 🧬 **Model Lineage**
+
+### **A: bunnycore/Best-Mix-Llama-3.1-8B**
+
+- A masterful **blend** of several Llama3 models like **Aurora_faustus**, **TitanFusion**, and **OpenMath2**.
+- Provides a **balanced performance** in a variety of tasks such as reasoning, math, and instruction-following.
+- Key contributor to the **overall versatility** of the merged model.
+
+### **B: USTC-KnowledgeComputingLab/Llama3-KALE-LM-Chem-1.5-8B**
+
+- Specializes in **chemistry** and **scientific knowledge**, outperforming many larger models in **chemistry benchmarks**.
+- Adds **scientific rigor** and domain-specific expertise to the merged model, making it perfect for scientific and academic tasks.
+
+### **C: Weyaxi/Einstein-v6.1-Llama3-8B**
+
+- Fine-tuned on a wide range of **instructive** and **conversational datasets** like **WizardLM**, **Alpaca**, and **ShareGPT**.
+- Optimized for **long-form text generation** and enhanced with **xformers attention** and **flash attention** techniques for better performance.
+- Key player in **dialogue-based tasks** and **long conversation generation**.
+
+---
+
+## 🛠️ **Merge Details**
+
+This model was merged using the **TIES merge method**, ensuring a smooth integration of the key strengths from each contributing model. Here's the configuration used:
+
+```yaml
+yaml
+Copy code
+models:
+  - model: bunnycore/Best-Mix-Llama-3.1-8B
+    parameters:
+      density: [1, 0.7, 0.5]
+      weight: 1.0
+
+  - model: USTC-KnowledgeComputingLab/Llama3-KALE-LM-Chem-1.5-8B
+    parameters:
+      density: 0.6
+      weight: [0.3, 0.7, 1.0]
+
+  - model: Weyaxi/Einstein-v6.1-Llama3-8B
+    parameters:
+      density: 0.4
+      weight:
+        - filter: mlp
+          value: 0.5
+        - filter: self_attn
+          value: 0.7
+        - value: 0.5
+
+merge_method: ties
+base_model: bunnycore/Best-Mix-Llama-3.1-8B
+parameters:
+  normalize: true
+  int8_mask: true
+dtype: float16
+
+```
+
+---
+
+## 🎯 **Key Features & Capabilities**
+
+### **1. Instruction Following & General Reasoning**:
+
+With the foundation of **Best-Mix**, this model excels in **general-purpose reasoning**, instruction-following, and tasks that require high adaptability.
+
+### **2. Scientific & Chemistry Expertise**:
+
+Thanks to the contribution from **KALE-LM-Chem**, this model shines in **scientific research**, particularly **chemistry-focused tasks**, making it ideal for academic and research purposes.
+
+### **3. Long-Form & Conversational Mastery**:
+
+With **Einstein-v6.1**, the model handles **long-form generation** effortlessly, excelling in extended conversations and structured dialogue applications.
+
+---
+
+## 🚀 **Performance Benchmarks**
+
+While still in its early stages, **Llama3.1-BestMix-Chem-Einstein-8B** is expected to perform well across a variety of benchmarks, including:
+
+- **Chemistry-focused benchmarks** (KALE-LM-Chem)
+- **Instruction-following tasks** (Best-Mix)
+- **Conversational AI** and **long-form text generation** (Einstein-v6.1)
+
+Further testing and evaluation will continue to refine this model's capabilities.
+
+---
+
+## 📜 **License**
+
+This model is open-sourced under the **Apache-2.0 License**, allowing free use and modification with proper attribution.
+
+---
+
+## 💡 **Tags**
+
+- `merge`
+- `TIES`
+- `BestMix`
+- `Chemistry`
+- `Einstein`
+- `instruction-following`
+- `long-form-generation`
+- `conversational`
+
+---