Integrity Operations Specialist
Our Product Integrity Operations team is responsible for ensuring we are complying with responsible AI laws and regulations, enforcing our Acceptable Use Policy (AUP) and Terms of Service and performing related red team testing of our models and safeguards. As an Integrity Operations Specialist, you will be reviewing user activity on our platform and the use of our various models to determine if policy violative actions are occurring. You will also be performing red team testing of our models and safeguards and helping address safety issues before those models are finalized and shipped. You will work closely with internal teams (product, engineering, legal, etc.) and external organizations globally to prevent bad actors from misusing our products and services. The ideal candidate is comfortable with technology and has experience working in fraud, abuse or similar investigative work and is comfortable working at a fast pace on a variety of tasks. Please note that this role may involve exposure to explicit content and topics, including those of a sexual, violent, or psychologically disturbing nature.
Responsibilities:
- Perform reviews of user activity, ensuring consistent and accurate action is taken related to user activity on our platform.
- Conduct Red Teaming exercises, developing and executing offensive tactics and techniques to identify and exploit new modelsβ vulnerabilities
Respond to concerns related to our products while also conducting root cause analysis to prevent recurrence of confirmed violative incidents.
- Adhere to metrics and KPIs related to workflow, volume, response times, accuracy, and overall operational effectiveness, providing data and content-driven insights
- Stay current on industry best practices for trust and safety enforcement programs and develop skills and understand new technologies
- Partner with internal and external stakeholders in identifying best practices, new approaches, and providing thought leadership for AI safety operational practices.
Qualifications:
- 3+ years experience working in Trust & Safety, Fraud, Abuse Prevention or similar investigative roles, preferably in the technology industry.
- Solid understanding of bad actor/ adversarial behavior and abuse prevention mechanisms
- Basic SQL skills.
- Analyze large volumes of transactional and user data to identify suspicious patterns or behaviors. Recommend controls when identifying exceptions or trends.
- Highly organized and able to manage competing priorities in time-sensitive situations
- Experience working in fast paced environments, where you have had to adapt to rapid changes, navigate ambiguity and take ownership for solving any problems that arise.
- Experience handling highly sensitive topics and customer concerns
- Experience collaborating with cross-functional teams including legal, compliance, product, and engineering
- Excellent written and verbal communication skills
- A true passion for AI
Similar AI Jobs
Head of Finance & Operations Merantix AI Fund
at Merantix
πGermany
Apply Now6 months agoSenior Data Scientist, Cloud Operations Products
at Atlassian
πUSA
Apply Now6 months agoSenior Director, Generative AI Solutions and Operations
at Tripadvisor
πUSA
Apply Now6 months agoAI Strategy & Operations, Information
at Stripe
πUSA
π°$134,300 - $201,500/Yearly
Apply Now7 months agoMachine Learning Operations Engineer
at Squarespace
πUSA
π°$110,500 - $178,200/Yearly
Apply Now8 months agoStrategy & Operations Senior Manager
at Placer.ai
πUSA
π°$140,000 - $160,000/Yearly
Apply Now8 months agoSenior ML Operations Engineer
at SiriusXM
πUSA
π°$135,000 - $209,500/Yearly
Apply Now8 months agoPrincipal Machine Learning Operations Engineer
at Integral Ad Science
πFrance
Apply Now8 months agoManager of AI Data Operations
at OpenSesame
πUSA
π°$130,000 - $160,000/Yearly
Apply Now9 months ago