Operations Associate (LLM Human Data Collection)

Expected compensation: $30.00 – $40.00 per hour

HireArt is helping a cutting edge AI research and deployment company hire Operations Associates (Human Data Collection). In this role, you will support the effectiveness of the company’s human data collection by measuring performance, resolving process and tooling challenges, training AI trainers, and improving data quality and AI training outcomes.

We’re looking for candidates with experience in data labeling operations and a passion for process improvements, to help build a system that efficiently teaches AI models how to understand difficult questions and execute complex instructions. You should have excellent communication skills, be highly analytical, and take a hands-on, proactive approach to scoping and forecasting the needs of the program.

As An Operations Associate You’ll:

• Perform quality audits and provide feedback based on audit performance.
• Maintain workflow and test new tools for effectiveness.
• Work cross-functionally to align on goals and standards of accuracy.
• Work with labelers and engineers to identify and/or escalate bugs to maintain steady throughput.
• Identify potential annotators for up-leveling or special assignment.
• Support other team members and provide training as needed.

Requirements:

• Experience in data labeling operations
• Comfortable with SQL and/or JSON
• Enjoys thinking in systems and processes, utilizing a systematic approach to work
• Ability to communicate clearly and concisely
• Collaborative and focused on helping others get things done
• Action-oriented with a deeply curious mindset, often becoming a power user of software and tools
• Ability to support specific areas such as coding, creative writing, law, medicine, or an ability to speak multiple (3+) languages

Nice To Have Skills:

• Experience in content design or creative writing

Benefits:

• Pre-tax commuter benefits
• Employer (HireArt) Subsidized healthcare benefits
• Flexible Spending Account for healthcare-related costs
• HireArt covers all costs for short and long term disability and life insurance
• 401k package

Commitment: This is a full-time, 6 month, ongoing contract position staffed via HireArt. It is hybrid and open to candidates local to the San Francisco, CA area.

HireArt values diversity and is an Equal Opportunity Employer. We are interested in every qualified candidate who is eligible to work in the United States. Unfortunately, we are not able to sponsor visas or employ corp-to-corp.