Psychiatry Expert
- Role
- Research
- Experience
- Senior
- Employment
- Part-time10h/week
Open to Anywhere in EU + US, GB, AU. Set where you work from to check your eligibility.
No BS summary
Board-certified psychiatrists needed for an AI project assessing psychiatric scenario reasoning. Develop cases, create reference answers, and identify AI weaknesses. Must have completed residency and be board-certified/eligible with 3+ years of independent practice. US, UK, Europe, or Australia based.
Optional skills
Required languages
This role is for one of our clients Compensation: $150 per hour We are seeking board-certified psychiatrists to support an expert evaluation project with a leading AI research organization. The project focuses on assessing how effectively advanced AI systems reason through complex psychiatric scenarios. As a Psychiatry Expert, you will use your clinical expertise to develop challenging, expert-level diagnostic and reasoning tasks, establish authoritative reference answers, and identify common weaknesses in AI-generated clinical reasoning. Psychiatrists from a range of practice settings are welcome, with particular interest in professionals with specialized expertise in psychiatry subspecialties. Requirements Key Responsibilities Develop expert-level psychiatric cases and reasoning challenges designed to test advanced AI systems. Create accurate, clinically rigorous, gold-standard answers supported by clear diagnostic and clinical reasoning. Evaluate nuanced psychiatric scenarios, including complex differentials, edge cases, and risk-assessment considerations. Review AI-generated responses and identify clinical inaccuracies, reasoning gaps, unsupported conclusions, and common failure patterns. Provide structured feedback to help research teams understand and improve AI performance on advanced psychiatric tasks. Collaborate directly with AI research teams and other subject-matter experts. Apply current clinical knowledge and professional judgment consistently when evaluating model outputs. Required Qualifications Completed psychiatry residency through an ACGME, AOA, or recognized national-equivalent program. Current trainees do not qualify. Medical degree: MD or DO. International medical degrees from recognized institutions are also eligible. Active board certification in psychiatry , such as: ABPN FRCPC MRCPsych FRANZCP Recognized national equivalent Board-eligible or lapsed certifications do not meet the requirement. Active, unrestricted medical license with no current suspension, revocation, or open disciplinary action. 3+ years of independent clinical practice after residency , either currently or within the past two years. Residency and fellowship training do not count toward this requirement. Current or recent practice in an accredited or government-licensed clinical setting , including hospitals, academic medical centers, community clinics, private practices, or telehealth organizations. Must be based in the United States, United Kingdom, Europe, or Australia . US-based candidates are preferred. Psychiatry must be the primary area of professional practice. Preferred Qualifications The following qualifications are valued but are not mandatory: 10+ hours per week of direct patient care , currently. Specialized expertise in one or more of the following areas: Addiction Psychiatry Child & Adolescent Psychiatry Forensic Psychiatry Geriatric Psychiatry Consultation-Liaison Psychiatry Subspecialty expertise demonstrated through a fellowship, subspecialty board certification, or at least two years of relevant clinical practice. Experience developing or administering OSCEs , including examiner or assessment-development experience. Current or recent faculty appointment within a psychiatry department . Experience reviewing, evaluating, grading, or developing clinical or medical educational content. Role Responsibilities As part of the engagement, you may be asked to: Develop clinically challenging psychiatric scenarios for AI evaluation. Produce authoritative answers with transparent and well-structured clinical reasoning. Focus on nuanced differentials, psychiatric risk assessment, diagnostic uncertainty, and clinical edge cases . Evaluate model responses for clinical accuracy, reasoning quality, and appropriate judgment. Identify recurring failure modes in AI reasoning and communicate them clearly to research teams. Collaborate with other psychiatric and clinical experts to maintain consistent evaluation standards. Screening Process Qualified candidates will complete a 20–30 minute structured interview . The screening conversation will focus on your clinical background, independent practice experience, psychiatric specialization, and relevant subspecialty expertise. Engagement Details Role: Psychiatry Expert Work Arrangement: Fully Remote Engagement Type: Independent Contractor Location Eligibility: US, UK, Europe, or Australia Projects may be extended, shortened, or concluded based on project requirements and performance. Payments are made weekly based on services rendered through available payment platforms. The engagement does not require access to confidential or proprietary information belonging to any current or former employer, client, or institution. H-1B and STEM OPT candidates are not currently supported.
What you'll do
- Develop expert-level psychiatric cases and reasoning challenges designed to test advanced AI systems.
- Create accurate, clinically rigorous, gold-standard answers supported by clear diagnostic and clinical reasoning.
- Evaluate nuanced psychiatric scenarios, including complex differentials, edge cases, and risk-assessment considerations.
- Review AI-generated responses and identify clinical inaccuracies, reasoning gaps, unsupported conclusions, and common failure patterns.
- Provide structured feedback to help research teams understand and improve AI performance on advanced psychiatric tasks.
- Collaborate directly with AI research teams and other subject-matter experts.
- Apply current clinical knowledge and professional judgment consistently when evaluating model outputs.
- Develop clinically challenging psychiatric scenarios for AI evaluation.
- Produce authoritative answers with transparent and well-structured clinical reasoning.
- Focus on nuanced differentials, psychiatric risk assessment, diagnostic uncertainty, and clinical edge cases.
- Evaluate model responses for clinical accuracy, reasoning quality, and appropriate judgment.
- Identify recurring failure modes in AI reasoning and communicate them clearly to research teams.
- Collaborate with other psychiatric and clinical experts to maintain consistent evaluation standards.
What they require
- Completed psychiatry residency through an ACGME, AOA, or recognized national-equivalent program.
- Current trainees do not qualify.
- Medical degree: MD or DO.
- International medical degrees from recognized institutions are also eligible.
- Active board certification in psychiatry , such as: ABPN FRCPC MRCPsych FRANZCP
- Board-eligible or lapsed certifications do not meet the requirement.
- Active, unrestricted medical license with no current suspension, revocation, or open disciplinary action.
- 3+ years of independent clinical practice after residency , either currently or within the past two years.
- Residency and fellowship training do not count toward this requirement.
- Current or recent practice in an accredited or government-licensed clinical setting , including hospitals, academic medical centers, community clinics, private practices, or telehealth organizations.
- Must be based in the United States, United Kingdom, Europe, or Australia .
- US-based candidates are preferred.
- Psychiatry must be the primary area of professional practice.
- 10+ hours per week of direct patient care , currently.
- Subspecialty expertise demonstrated through a fellowship, subspecialty board certification, or at least two years of relevant clinical practice.
- Qualified candidates will complete a 20–30 minute structured interview .
- The screening conversation will focus on your clinical background, independent practice experience, psychiatric specialization, and relevant subspecialty expertise.
- H-1B and STEM OPT candidates are not currently supported.
Weekday AI is a Y Combinator-backed startup transforming the hiring landscape with outreach tools and a database of white-collar talent, delivering recruitment solutions.