--- base_model: mistralai/Mistral-7B-Instruct-v0.3 tags: - peft - lora - federated-learning - flower - medical --- # FlowerTune Medical LoRA Model This is a LoRA adapter for mistralai/Mistral-7B-Instruct-v0.3 fine-tuned with Flower federated learning framework on medical NLP datasets. ## Model Performance - PubMedQA: 0.5440 - MedMCQA: 0.5520 - MedQA: 0.5440 - CareQA: 0.4980 - Average: 0.5345 ## Training Details - Domain: Medical - Training method: Federated LoRA fine-tuning with FlowerTune - Framework: Flower This model is a LoRA adapter fine-tuned on mistralai/Mistral-7B-Instruct-v0.3 using the Flower federated learning framework. It was trained on medical NLP datasets through distributed learning. The model achieved scores of PubMedQA: 0.5440, MedMCQA: 0.5520, MedQA: 0.5440, CareQA: 0.4980, with an average score of 0.5345. ## Links - FlowerTune Homepage: [https://huggingface.co/zjudai/FlowerTune](https://huggingface.co/zjudai/FlowerTune) - FlowerTune Collection: [https://huggingface.co/collections/zjudai/flowertune-lora-collection-67ecd5d0dae6145cbf798439](https://huggingface.co/collections/zjudai/flowertune-lora-collection-67ecd5d0dae6145cbf798439)