Introduction

Recently ChatGPT cleared the USMLE exams [1, 2]. The findings astonished the world. In this article, we research whether ChatGPT can conduct USMLE exams.

Method and Results

Multiple prompts were used to assess the knowledge and instructional capabilities of ChatGPT.


USER INPUT: Tell instructions to candidates for USMLE exams.


ChatGPT OUTPUT:

The instructions for USMLE exams may vary slightly depending on the specific exam and the location where it is being administered. However, here are some general instructions that are typically provided to candidates:

  1. 1.

    Bring your government-issued photo ID: Candidates must bring a valid government-issued photo ID such as a passport or driver's license to the exam center.

  2. 2.

    Arrive on time: Candidates must arrive at the exam center at least 30 min before the scheduled exam start time.

  3. 3.

    Bring permitted items: Candidates are allowed to bring certain items into the testing room, such as a sweater or jacket, eyeglasses, hearing aids, and medication. However, all items will be inspected before entry, and candidates may not bring any electronic devices or personal items into the testing room.

  4. 4.

    Follow exam rules: Candidates must follow all exam rules and instructions provided by the test administrator. Failure to do so may result in dismissal from the testing center and cancellation of the exam.

  5. 5.

    Understand the exam format: Candidates should be familiar with the format of the exam they are taking, including the number of questions, time limits, and scoring system.

  6. 6.

    Take breaks when allowed: Depending on the exam, candidates may be allowed to take breaks during the testing period. It is important to use these breaks wisely to rest and refocus.

  7. 7.

    Report any issues: If candidates experience any technical issues or other problems during the exam, they should immediately report them to the test administrator.

It is important for candidates to review the specific instructions provided by the NBME or FSMB for the exam they are taking to ensure they understand all requirements and expectations.


USER INPUT: Provide some MCQs for USMLE step 1 exams.


ChatGPT OUTPUT:

  1. 1.

    Which of the following is the most common cause of bacterial meningitis in adults?

    1. (A)

      Streptococcus pneumoniae

    2. (B)

      Neisseria meningitidis

    3. (C)

      Haemophilus influenzae

    4. (D)

      Listeria monocytogenes

    5. (E)

      Staphylococcus aureus

  2. 2.

    Which of the following is the most common cause of community-acquired pneumonia?

    1. (A)

      Mycoplasma pneumoniae

    2. (B)

      Streptococcus pneumoniae

    3. (C)

      Legionella pneumophila

    4. (D)

      Haemophilus influenzae

    5. (E)

      Chlamydophila pneumoniae

  3. 3.

    Which of the following is the most common cause of primary hyperaldosteronism?

    1. (A)

      Adrenal adenoma

    2. (B)

      Adrenal carcinoma

    3. (C)

      Adrenal hyperplasia

    4. (D)

      Pituitary adenoma

    5. (E)

      Ectopic ACTH production

  4. 4.

    Which of the following medications is contraindicated in patients with a history of sulfonamide allergy?

    1. (A)

      Furosemide

    2. (B)

      Hydrochlorothiazide

    3. (C)

      Spironolactone

    4. (D)

      Triamterene

    5. (E)

      Amiloride

  5. 5.

    A 25-year-old woman presents with fever, chills, and pain in her right lower quadrant. On physical examination, she has rebound tenderness and guarding. Which of the following imaging studies is most appropriate for confirming the diagnosis?

    1. (A)

      Abdominal X-ray

    2. (B)

      Abdominal ultrasound

    3. (C)

      CT scan of the abdomen and pelvis with contrast

    4. (D)

      MRI of the abdomen and pelvis

    5. (E)

      HIDA scan


USER INPUT: Provide answers with explanations for above MCQs.


ChatGPT OUTPUT:

Here are the answers with explanations for the MCQs I provided:


(A) Streptococcus pneumoniae is the most common cause of bacterial meningitis in adults. While Neisseria meningitidis is the most common cause of meningitis in children and young adults, S. pneumoniae is more commonly responsible for meningitis in older adults and those with underlying medical conditions.


(B) Streptococcus pneumoniae is the most common cause of community-acquired pneumonia. Other common causes include Haemophilus influenzae, Mycoplasma pneumoniae, and Chlamydophila pneumoniae, but S. pneumoniae is the most common overall.


(A) Adrenal adenoma is the most common cause of primary hyperaldosteronism, accounting for about 60–70% of cases. Adrenal hyperplasia is the next most common cause, followed by adrenal carcinoma and ectopic ACTH production.


(A) Furosemide is contraindicated in patients with a history of sulfonamide allergy. Furosemide is a loop diuretic, but it contains a sulfonamide moiety, which can cross-react with other sulfonamide-containing medications and cause an allergic reaction.


(C) CT scan of the abdomen and pelvis with contrast is the most appropriate imaging study for confirming the diagnosis of acute appendicitis. While abdominal ultrasound can also be used to visualize the appendix, it is less sensitive and specific than CT. Abdominal X-ray, MRI, and HIDA scan are not typically used to diagnose appendicitis.

Conclusion

Thus we see that ChatGPT can provide assistance in USMLE exams. Also It can be used to generate practice questions banks for USMLE and many other exams of any field.