Structured Grading: Score AI agent responses against a pre-defined rubric, applying the highest-priority criteria consistently across a large volume of items.
Safety Review: Identify responses that could cause patient harm missed red flags, unsafe advice, failure to escalate or signpost to care.
Clinical Accuracy: Assess factual correctness, completeness and guideline alignment of clinical content.
Written Feedback: Provide brief, specific rationale for each failed response and general guidance on how it could be improved.
Licensure: Active RN license for US
Experience: Minimum 2 years of clinical nursing practice.
Knowledge: Strong grounding in clinical guidelines, patient safety and scope-of-practice boundaries.
Attention to detail: Proven accuracy and consistency in clinical documentation or review work.
Technical proficiency: Comfortable using structured review tools and digital platforms.
Language: Native or near-native written English.
You will have the right to work in your country of residence.
You will work as an independent contractor.
Flexible Work Arrangements: Part-time, remote and fully asynchronous.
Competitive Compensation: Hourly rate
Professional Development: Hands-on experience in AI evaluation and model fine-tuning, shaping how AI is deployed in patient care.
...their families What We're Looking For Experience as a Caregiver, CNA, Certified Nursing Assistant, Certified Nurse Aide, HHA, or PCA preferred; willing to train the right candidate Must be at least 18 years of age Compassionate, dependable, and professional...