Medical Expert (AI Clinical Evaluation)
- Role
- Research
- Employment
- Contract
Open to Worldwide. Set where you work from to check your eligibility.
No BS summary
Create and evaluate challenging medical questions for AI systems, focusing on diagnosis, disease mechanisms, pharmacology, clinical guidelines, and medical reasoning. Requires medical expertise and strong research skills.
Required languages
About Us
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.
Role Overview
We are looking for medical students, residents, physicians, and professionals with equivalent biomedical expertise to create and evaluate challenging medical questions designed to test advanced AI systems. The work focuses on diagnosis, disease mechanisms, pharmacology, clinical guidelines, and medical reasoning , with a strong emphasis on evidence-based research and clinically defensible answers.
CONTRACT: Contractor assignment
COMMITMENT: Subject to minimum weekly task submissions
LOCATIONS: Remote, GLOBAL
HOURLY RATE: $40-$90/h
Responsibilities
Create high-difficulty medical questions and answers across clinical and biomedical topics. Develop questions that require synthesis and clinical reasoning rather than simple factual recall. Research and verify answers using primary literature, clinical guidelines, and authoritative medical sources . Document supporting rationale and references clearly. Evaluate AI-generated responses for clinical accuracy, reasoning quality, and completeness. Identify questions that are too straightforward and refine them to increase appropriate difficulty. Ensure questions and answers are precise, unambiguous, and medically defensible. Review content involving diagnosis, mechanisms, pharmacology, guidelines, and clinical decision-making. Incorporate reviewer feedback and revise submissions according to project standards.
Requirements
Current medical student, medical resident, practicing physician , or equivalent biomedical professional. Strong ability to research and interpret primary medical literature and clinical guidelines. Ability to develop medically accurate questions requiring advanced reasoning and synthesis. Strong understanding of clinical medicine, biomedical science, or a relevant medical specialty. Ability to verify medical claims using reliable and authoritative sources. Strong written English with the ability to communicate medical reasoning clearly. Ability to produce detailed, accurate, and well-supported independent work. Availability to meet the project's minimum weekly task requirements.
What you'll do
- Create high-difficulty medical questions and answers across clinical and biomedical topics.
- Develop questions that require synthesis and clinical reasoning rather than simple factual recall.
- Research and verify answers using primary literature, clinical guidelines, and authoritative medical sources.
- Evaluate AI-generated responses for clinical accuracy, reasoning quality, and completeness.
- Review content involving diagnosis, mechanisms, pharmacology, guidelines, and clinical decision-making.
What they require
- Current medical student, medical resident, practicing physician, or equivalent biomedical professional.
- Strong ability to research and interpret primary medical literature and clinical guidelines.
- Ability to develop medically accurate questions requiring advanced reasoning and synthesis.
- Strong understanding of clinical medicine, biomedical science, or a relevant medical specialty.
- Strong written English with the ability to communicate medical reasoning clearly.
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.