This project is an enhanced medical imaging and diagnostic assistant that uses HealthGPT models to improve low-resolution medical images, convert between imaging modalities, and generate diagnostic reports.
- Image Enhancement: Improve the resolution and clarity of low-quality medical images
- Modality Conversion: Convert between CT and MRI scans
- Diagnostic Report Generation: Analyze medical images and provide detailed diagnostic reports
- Python 3.10+
- Node.js 16+
- CUDA-compatible GPU (recommended for faster processing)
-
Clone the repository:
git clone https://github.com/yourusername/HealthGPT-main.git cd HealthGPT-main -
Create and activate a Python virtual environment:
conda create -n HealthGPT python=3.10 conda activate HealthGPT
-
Install the required Python packages:
pip install -r requirements.txt
-
Download the required model weights:
cd weights python download_weights.py
-
Navigate to the frontend directory:
cd frontend -
Install the required Node.js packages:
npm install
- Start the backend server:
python app.py
-
In a separate terminal, navigate to the frontend directory:
cd frontend -
Start the Next.js development server:
npm run dev
-
Open your browser and navigate to
http://localhost:3000
- Select a task type (Image Enhancement, CT to MRI Conversion, MRI to CT Conversion, or Generate Diagnosis)
- Upload a medical image
- Click "Process Image" to start the processing
- View the results in the output section
The application provides the following API endpoints:
POST /api/process-scan: Process a medical image based on the selected task type- Request body:
scan: The medical image filetaskType: The type of task to perform (enhance,ct2mri,mri2ct, ordiagnosis)
- Response:
result: The processed image (as base64) or diagnostic text
- Request body:
This project uses the following HealthGPT models:
- HealthGPT-XL32: For image enhancement, modality conversion, and diagnostic report generation
- HealthGPT-M3: For image generation tasks
This project is licensed under the MIT License - see the LICENSE file for details.
- HealthGPT for providing the pre-trained models
- Next.js for the frontend framework
- Tailwind CSS for styling