Comparative Study on Response Efficacy of Generative Artificial Intelligence for Elderly Diabetes Mellitus

Corresponding author: LIU HAIXIA, 742631571@qq.com

DOI: 10.12201/bmr.202503.00019

•  

  Abstract: Objective/significance To evaluate the response accuracy of different generative artificial intelligence (GAI) chat robots to the common problems of elderly diabetes, so as to compare the performance differences of various AI large-scale language models in the quality of medical information service. Methods/Process A standardized assessment question bank containing 10 elderly diabetes related questions was constructed, and then four GAI chat robots were used to score the accuracy of the answers. In addition, the problem is summarized into two dimensions of "diagnosis and evaluation" and "control and treatment", and the situation of the above four GAI in these two dimensions is analyzed. Results/Conclusion In general, Kimi and Doubao AI have significantly better response performance than DeepSeek and iFLYTEK spark AI for common problems of elderly diabetes, with higher accuracy and stability, but there is no significant difference in response performance between Kimi and Doubao AI. In addition, in the dimensions of "diagnosis and evaluation", "control and treatment", kimi and Doubao AI has better performance than DeepSeek and iFLYTEK spark AI.

  Key words: generative artificial intelligence; chat robot; large language model; senile diabetes; medical informatics

  Submit time: 26 May 2025

  Copyright: The copyright holder for this preprint is the author/funder, who has granted biomedRxiv a license to display the preprint in perpetuity.
• html

• 图表

• Exploration of Medical Video Creation Path Based on Generative Artificial Intelligence. 2025. doi: 10.12201/bmr.202508.00005

  Meng Dongqing, LV Wenjuan. Research on the Path of Constructing Knowledge Services in Medical Libraries Empowered by Generative Artificial Intelligence. 2025. doi: 10.12201/bmr.202510.00039

  rui chen, chen yueqi, li jinbin, zhang shengfa. Progress and Trend of the Application of Artificial Intelligence in the Basic Health Management of Type 2 Diabetes. 2025. doi: 10.12201/bmr.202506.00072

  shisenzhong. Analysis of the Risks and Governance Strategies for the Application of Generative Artificial Intelligence (GAI) in Primary Healthcare. 2024. doi: 10.12201/bmr.202408.00053

  GE Xiaoling. Application of Artificial Intelligence Large Models in Healthcare:a Survey. 2024. doi: 10.12201/bmr.202408.00039

  ZhengYanli, Han Fuhai, LI Shuyu, SU Wenxing. Application Status and Prospect of Artificial Intelligence Large Models in Medicine. 2023. doi: 10.12201/bmr.202312.00027

  Li Rili, PAN Jiaming, RONG Shiqiang, SUN Xiaocui, YI Faling. Advances in Integrating Knowledge Graphs and Large Language Models for Health Management of Diabetes. 2025. doi: 10.12201/bmr.202508.00035

  yanwencheng, lijunzhen, chenmei, 卢艳红. Artificial Intelligence for Stomatology: Application in Dental Endodontics. 2021. doi: 10.12201/bmr.202102.00003

  niuyuxiang, geshanshan, wanglihua. Exploration and research of electronic medical record generation technology from traditional NLP to large language model. 2024. doi: 10.12201/bmr.202412.00080

  wusijing, xubinbin, huangfeng. Development Status and Policy Suggestions of Medical Artificial Intelligence in Zhejiang Province. 2021. doi: 10.12201/bmr.202101.00015

• ID	Submit time	Number	Download
  1	2025-03-06	10.12201/bmr.202503.00019V1	Download

• Public  Anonymous  To author only Submit Comments