Content Adversarial Red Team Analyst, Trust and Safety

Minimum qualifications:

• Bachelor's degree or equivalent practical experience.
  
• 4 years of experience in technology, red teaming, policy, cybersecurity, anti-abuse, Trust and Safety, or related fields.

Preferred qualifications:

• Master's degree in relevant field.
  
• Experience in adversarial testing, red teaming, GenAI safety, GenAI ethics/responsibility, or similar.
• Experience working with Google's products and services, particularly GenAI products.
• Experience working with large datasets and data analysis tools.
• Experience in multiple languages, including those relevant to Google's global user base.
• Familiarity with different AI model architectures and their vulnerabilities and understanding of content moderation policies and best practices.

About the job

Trust & Safety team members are tasked with identifying and taking on the biggest problems that challenge the safety and integrity of our products. They use technical know-how, excellent problem-solving skills, user insights, and proactive communication to protect users and our partners from abuse across Google products like Search, Maps, Gmail, and Google Ads. On this team, you're a big-picture thinker and strategic team-player with a passion for doing what’s right. You work globally and cross-functionally with Google engineers and product managers to identify and fight abuse and fraud cases at Google speed - with urgency. And you take pride in knowing that every day you are working hard to promote trust in Google and ensuring the highest levels of user safety.

As a Content Adversarial Red Team Analyst, you will be a key contributor in identifying and mitigating emerging content safety risks within Google's GenAI products. You will lead the charge in uncovering unknown generative AI issues, threats and vulnerabilities that are not captured by traditional testing methods. Your understanding of AI safety and ability to think strategically will be instrumental in shaping the future of AI development, ensuring that Google's AI products are safe, fair, and unbiased.

At Google we work hard to earn our users’ trust every day. Trust & Safety is Google’s team of abuse fighting and user trust experts working daily to make the internet a safer place. We partner with teams across Google to deliver bold solutions in abuse areas such as malware, spam and account hijacking. A team of Analysts, Policy Specialists, Engineers, and Program Managers, we work to reduce risk and fight abuse across all of Google’s products, protecting our users, advertisers, and publishers across the globe in over 40 languages.

The US base salary range for this full-time position is $110,000-$157,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about benefits at Google.

Responsibilities

• Own and lead red teaming projects, end-to-end, for Google’s Generative AI products, using novel strategies to identify unknown content safety risks. Develop and execute innovative red teaming strategies, collaborating with cross-functional teams, reviewing raw results, and analysis.
• Develop and implement other Communication Access Real-time Translation strategic programs to improve AI safety and security, including defining and developing new programs, and developing and promoting best practices.
• Provide thought leadership and expertise in AI safety, including advocating AI safety initiatives and building relationships with stakeholders.