Work Hard Everywhere logo Work Hard Everywhere

Physician (MD/DO) - Put Medical AI to the Test, Remote

Mindrift
📍 USA Only 💰 🕑 Americas timezone
Full-time Mid-level Engineering Full-Stack Programming

Job Description

Headquarters: Idaho, United States

URL: https://jobs.workable.com/company/r7muFeAbcksMFWASJu45jA/jobs-at-mindrift

About the company

Paid per approved task, about $100/hr equivalent. One flat rate for every approved task.

Built to fit around a clinical practice:

- Tasks estimated at about 10-20 hrs/week while the project is active; you choose when and how much to contribute

- Contribute anytime, from anywhere

- No patient contact, no malpractice exposure: you review written clinical cases

- All reviewers are license-verified physicians

- $50 one-time onboarding reward, paid once your first production task is approved

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based.

What this opportunity involves

We’re looking for actively practicing physicians (MD/DO) with an active, unrestricted US medical license to evaluate clinical EHR vignettes for a medical AI evaluation project. General and internal medicine are the main focus. On this project, contributors may:

- Evaluate clinical EHR vignettes paired with a question, a proposed answer, and a distractor “trap” answer across diagnosis and treatment tasks, spanning cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems;

- Score the clinical reasoning quality of benchmark items: vignette accuracy and completeness, whether the vignette gives the answer away, answer correctness and gradeability, and trap quality;

- Check whether the reasoning chain reaches the answer from vignette facts alone, correct reasoning traces, and write short rationales;

- Work within three independent blind reads, followed by physician adjudication. Real clinical complexity only. You’re improving the AI tools you’ll eventually use yourself.

If you’re a practicing physician ready to take on this challenging and engaging project,...