# Tsiphen/Multimodal-RAG-for-Medical-Consultation

<https://repo.masters-masters.com/en/repos/Tsiphen/Multimodal-RAG-for-Medical-Consultation>

[Home](https://repo.masters-masters.com/en) › [Tsiphen](https://repo.masters-masters.com/en/owners/Tsiphen) › [Multimodal-RAG-for-Medical-Consultation](https://repo.masters-masters.com/en/repos/Tsiphen/Multimodal-RAG-for-Medical-Consultation)

Tsiphen/Multimodal-RAG-for-Medical-Consultation has 181 stars on GitHub. Its RepoMasters card: Prototype tier. 我提出了一个集成文本、图像文本多模态、图像的三维医学问诊系统：3DMed-RAG，该系统能够同时…

| Field | Value |
| --- | --- |
| Owner | [Tsiphen](https://repo.masters-masters.com/en/owners/Tsiphen) |
| Stars | 181 |
| Forks | 2 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | None |
| Created | 2025 |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [Tsiphen/Multimodal-RAG-for-Medical-Consultation](https://github.com/Tsiphen/Multimodal-RAG-for-Medical-Consultation) |

## Repository

我提出了一个集成文本、图像文本多模态、图像的三维医学问诊系统：3DMed-RAG，该系统能够同时处理文本、图像、图像文本三种query形式，并做出高质量医学诊断。我们基于经典的RAG，在检索排位部分提出领域对齐负面拒绝机制，二次判断问诊的专业性；对于官方专家导诊文档（文档末尾一般有流程图概述），我们增强该流程图的数据，使llm在回答导诊路线相关回答时能更加详细。 对于医学图像，我们尝试基础的VQA-MedRAG模型，使用文本-图像对眼科描述问题进行尝试，为了提升准确性，使用Multimodal-RAG对index的文本、图像编码进行加权处理，对未知的患者图像进行有效的医学信息描述。

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## Nearby in Python

- [FlagOpen/InsertAny3D · ★ 181 · Python · Prototype](https://repo.masters-masters.com/en/repos/FlagOpen/InsertAny3D)
- [Badtheorylabs/interference-search · ★ 181 · Python · Prototype](https://repo.masters-masters.com/en/repos/Badtheorylabs/interference-search)
- [lemonadesaltbagel/crab · ★ 181 · Python · Prototype](https://repo.masters-masters.com/en/repos/lemonadesaltbagel/crab)
- [jacobian/django-googlecharts · ★ 181 · Python · Prototype](https://repo.masters-masters.com/en/repos/jacobian/django-googlecharts)
- [twonds/punjab · ★ 181 · Python · Prototype](https://repo.masters-masters.com/en/repos/twonds/punjab)
- [aplpy/aplpy · ★ 181 · Python · Prototype](https://repo.masters-masters.com/en/repos/aplpy/aplpy)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.