Spaces:
Running
Running
File size: 1,469 Bytes
c1b7fff | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 | # MedSight AI 🧠





MedSight AI is a multimodal medical diagnostic platform powered by deep learning. It fuses vision (chest X-ray analysis via DINOv2) and NLP (clinical note extraction via BioBERT) to deliver zero-shot disease classification and RAG-augmented medical reports.
## Features
- **Vision Module:** Anomaly detection & Grad-CAM visualizer using frozen DINOv2.
- **NLP Module:** Medical NER and zero-shot disease classification.
- **Multimodal Fusion:** Image-text alignment via BiomedVLP.
- **RAG Chatbot:** BioGPT streaming assistant grounded in PubMed abstracts.
## Tech Stack
- **Backend:** FastAPI, SQLAlchemy 2.0 (async), Pydantic v2
- **Frontend:** Next.js 14 (App Router), TailwindCSS
- **ML/Data:** PyTorch 2.2, HuggingFace Transformers, ChromaDB, SQLite/PostgreSQL
## Quick Start
```bash
conda activate medsight
pip install -r backend/requirements.txt
cp .env.example .env
alembic upgrade head
uvicorn backend.main:app --reload --port 8000
```
## API Docs & Deployment
API Documentation available locally at `/docs` via Swagger UI.
Deploys automatically to Render.com (Backend) and Vercel (Frontend).
|