Table 4 A comparison of four AI models in terms of knowledge and case-based reasoning
Knowledge/Case | #number Questions | #total ChatGPT 4 Correct | #total Llama 3 70B Correct | #total Gemini 1.5 Pro Correct | #total Command R + Correct |
|---|---|---|---|---|---|
Basic Medical Sciences | |||||
Knowledge | 98 | 85 | 73 | 76 | 47 |
Case | 22 | 18 | 15 | 13 | 9 |
Clinical Medical Sciences | |||||
Knowledge | 68 | 61 | 58 | 57 | 34 |
Case | 52 | 49 | 44 | 41 | 30 |
Total | 240 | 213 | 190 | 187 | 120 |