GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
Sunanhe
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
Sunanhe
Model Tree
OpenGVLab/InternVL-Chat-V1-2
Input Modalities
Output Modalities
Supported Functionality
MedDr is a large-scale generalist vision-language model for healthcare. It is built upon InternVL and trained using a diagnosis-guided bootstrapping strategy that leverages both image and label information to construct high-quality vision-language datasets.
MedDr supports diverse medical imaging modalities:
During inference, MedDr employs a retrieval-augmented medical diagnosis strategy to enhance generalization ability.
This model is built on InternVL. Please follow the INSTALLATION.md to set up the environment.
python
# Clone the GitHub repository# git clone https://github.com/sunanhe/MedDr.git # Edit demo.py and set model_path to your local checkpoint directory# Then run:# python3 demo.pySee demo.py in the GitHub repository for a full example.
If you find MedDr useful in your research, please consider citing:
bibtex
@article{he2024meddr, title={MedDr: Diagnosis-Guided Bootstrapping for Large-Scale Medical Vision-Language Learning}, author={He, Sunan and Nie, Yuxiang and Chen, Zhixuan and Cai, Zhiyuan and Wang, Hongmei and Yang, Shu and Chen, Hao}, journal={arXiv preprint arXiv:2404.15127}, year={2024}}This work builds upon InternVL. We thank the InternVL team for their outstanding contributions to the open-source VLM community.
@article{he2024meddr, title={MedDr: Diagnosis-Guided Bootstrapping for Large-Scale Medical Vision-Language Learning}, author={He, Sunan and Nie, Yuxiang and Chen, Zhixuan and Cai, Zhiyuan and Wang, Hongmei and Yang, Shu and Chen, Hao}, journal={arXiv preprint arXiv:2404.15127}, year={2024}}