Behavioral Health Expert, AI Safety and Model Evaluation Job at AuraOne, San Jose, CA

TXR3Z1EzSFk0ZTB3dGc5eENuZVdManluc1E9PQ==
  • AuraOne
  • San Jose, CA

Job Description

Category: AI Safety & Red Teaming · Pay: $45–$70 / hr · Location: Remote — US-eligible · Contractor

Behavioral Health Expert, AI Safety and Model Evaluation is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety team can patch the gap.

Why this role matters

Adversarial evaluation is how AuraOne hardens AI models before they ship to customers. Reviewers think like attackers and write up failures with enough rigor that the modeling team can reproduce, fix, and regress-test them.

Responsibilities

  • Design adversarial prompts that probe known weakness classes (jailbreak, policy bypass, prompt injection) for Behavioral Health Expert, AI Safety and Model Evaluation assignments.
  • Document every successful attack with reproduction steps and the policy clause it violated.
  • Score model defenses across single-turn and multi-turn conversations.
  • Triage emerging attack vectors and route them to the safety team with severity ratings.
  • Maintain a personal library of attack patterns and propose new red-team rubrics.
  • Calibrate against the broader red-team cohort to keep coverage and severity consistent.

Qualifications

  • Demonstrated experience red-teaming AI systems, security research, or adversarial ML work for Behavioral Health Expert, AI Safety and Model Evaluation work.
  • Strong written communication — your reports become the patch ticket.
  • Comfort working in policy-grey areas with clear documentation of what was attempted and why.
  • Familiarity with prompt-injection, jailbreak, and policy-bypass taxonomies.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Construct a 5-turn adversarial conversation that bypasses a specific policy clause and write up the patch ticket.
  • Score a model's defenses against a known jailbreak pattern across 20 variants.
  • Propose a new red-team rubric category after spotting an emerging attack vector.
  • Reproduce a failure another reviewer reported and confirm the severity tag.

Nice to have

  • Background in offensive security, AppSec, or trust & safety operations.
  • Experience publishing or reproducing public adversarial-ML research.
  • Multilingual fluency for cross-language attack testing.

Skills

  • Adversarial prompting
  • Red-team analysis
  • Policy taxonomy
  • Failure documentation
  • Behavioral Health AI Safety and Model Evaluation evaluation

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

$45–$70 / hr

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Job Tags

Contract work, For contractors, Remote work, 10 hours per week

Similar Jobs

Advanced Sciences and Technologies (AS&T)

AS and T Future Consideration Job at Advanced Sciences and Technologies (AS&T)

 ...skills: Configuration Management Specialists, Testers, System Engineers, Software Engineers, etc. Must be eligible for US Security Clearance, which requires US Citizenship. AS&T is an EOE/AA Disability/Veteran AS&T is committed to providing a work environment... 

Instacart

Remote Account Manager Job at Instacart

 ...work. Why this role is on the menu Were hiring an Account Manager II to make Instacart Ads the place CPG advertisers and agencies...  ...synthesizing customer feedback and business insights #LI-Remote Instacart provides highly market-competitive... 

Winhomeinspection

Growth Marketing Specialist (100% Remote - Chicago Area Preferred) Job at Winhomeinspection

 ...Job Description for Growth Marketing Specialist (100% Remote Chicago Area Preferred): Were hiring a Growth Marketing Specialist to build and optimize...  ...high-performing email campaigns, landing pages, and digital content to help attract new franchisees and clients. This... 

ATD Technology LLC

Sonographer - Travel Job at ATD Technology LLC

 ...explains the procedure in easy-to-understand terms performs ultrasound procedures, relieve patients of pre-testing anxiety and directly...  .... Required Skills & Experience: -Experienced Sonographer to perform high quality Adult Echo studies as per ASE & IAC Guidelines... 

BODYBAR Pilates - Dallas

Sales Associate Job at BODYBAR Pilates - Dallas

 ...members through sales and customer service responsibilities. The SA position is a part-time position requiring occasional weekend, early morning, and/or evening work and reports to the Studio Manager. Responsibilities Implement studio sales process including lead...