AI Evaluations & Red Team Lead
Tasks
- Assess AI risks for governance
- Communicate evaluation findings
- Conduct red teaming exercises
- Define AI evaluation strategy
- Design evaluations for high risk agents
- Establish evaluation standards
- Integrate scoring into SDLC
- Lead evaluation team
Perks/Benefits
- N/A
Skills/Tech-stack
AI Governance | Agentic AI | Artificial Intelligence | Compliance | Evaluation methodology | Language Models | Large Language Models | Machine Learning | Probabilistic Models | Quality Assurance | RAG | Red Teaming | Retrieval-Augmented Generation | Security Testing
Education
N/A
Roles
AI | AI Engineer | AI Safety Engineer | Engineer | Lead | Red Team Lead | Safety Engineer | Team Lead
Related jobs
-
AWS | Adversarial Machine Learning | Amazon SageMaker | Anonymization | AzureCutting-edge AI security work | Flexible working hours | Fully remote | Global cross-functional collaboration | Opportunity to shape AI security best practicesSenior-level Full TimeIndia R7h ago
-
Senior-level Full TimePune, India22h ago
-
API Integration | Active Directory | Amazon Web Services | Automation | Cloud SecurityCareer growth | Collaborative culture | Continuous learning | Equal opportunity | Exposure to international customersSenior-level Full TimeIndia1d ago
-
AI Governance | AI RMF | AI Security | AI content | AI content filteringSenior-level Full TimeHyderabad, India1d ago
-
Data Engineer / Analyst INR 3000K-3500KAI | AWS | Apache Kafka | Apache Spark | AzureFlexible work hours | Hybrid work schedule | Medical, dental, and vision coverage | Paid bonus program | Paid parental leaveSenior-level Full TimeIndia, Bengaluru1d ago
-
AI Evaluations & Red Team Lead INR 3000K-5000KAgentic AI | Artificial Intelligence | Evaluation methodology | LLM | Machine LearningSenior-level Full TimeIN Gurugram, India1d ago
-
Product Security Engineer INR 4443K-7998K.NET | AI | AWS | C# | CI/CDBonuses | Disability insurance | Employee resource groups | Life insurance | Paid parental leaveSenior-level Full TimeRemote, India R3d ago
-
Cloud Security Engineer INR 3000K-4000KAWS | AWS Secrets | AWS Secrets Manager | Access Analyzer | Admission controllersSenior-level Full TimeBengaluru, India; Chennai, India; Hyderabad, India; …4d ago
-
Cyber AI and Automation Engineer (IND) INR 3417K-5000KAPI Integration | Agentic AI | Amazon Web Services | Amazon Web Services (AWS) | Automation frameworksHybrid work environmentSenior-level Full TimeQ8 - Bangalore, India4d ago
-
Security Engineer INR 2000K-3465KAPI Security | AWS | Access Management | Application Firewall | AuthenticationCareer growth | Hybrid work | Meaningful impactSenior-level Full TimeBangalore, India4d ago
-
Associate Director – Cyber Threat Analytics INR 700K-900KAI Governance | AI RMF | AI/ML | Anomaly Detection | Artificial IntelligenceMid-level Full TimeHyderabad, India4d ago
-
AI Software Engineer INR 3584K-4408KAWS | Agent Orchestration | Azure | Benchmarking | CI/CDContinuing education program | Continuous learning | Family-friendly perks | Flexible time off | Health care coverageEntry-level Full TimeIN - HYDERABAD ORION, India4d ago
-
Principal Security Research Engineer INR 3672K-4600KAI machine learning | Adversarial Simulation | Application Telemetry | C# | CVEHybrid work | Industry conferences support | Learning opportunities | Remote work optionSenior-level Full TimePune, India4d ago
-
Senior Application Security Engineer INR 2500K-4500KAI incident response | Adversarial Testing | Agent Sandbox | Agent sandboxing | AnthropicHybrid work | Remote workSenior-level Full TimeIndia - Bengaluru4d ago
-
SOC L3 Analyst INR 2000K-3500KAWS GuardDuty | Application Security | Application Security Testing | Defender for Endpoint | Digital forensicsSenior-level Full Time Part Timehosur road bangalore, India4d ago
-
SOC L3 Analyst INR 2000K-3500KAWS GuardDuty | Application Security | Application Security Testing | Azure Sentinel | Cloud platformSenior-level Full Time Part Timehosur road bangalore, India4d ago
-
Senior Software Engineer INR 3700K-4800KAWS | Agentic Systems | Amazon Web Services | Distributed Systems | ExperimentationDental insurance | Disability insurance | Employee assistance program | Equity stock options | Health insuranceSenior-level Full TimePune4d ago
-
Product Security Engineer (Devsec Ops) INR 1000K-2200KAWS | Application Security Testing | Azure | Bash | Burp SuiteMid-level Full TimeGurugram, Haryāna, India5d ago
-
VAPT - Appsec / Red Teaming INR 500K-900KApplication Security | Penetration Testing | Pentesting | Red Teaming | SASTEntry-level Full TimeMumbai, Maharashtra, India5d ago
-
AI Act | AI Governance | AI RMF | AI Risk | AI auditingSenior-level Full TimeHyderabad, TG, India5d ago
-
Associate Director, Principal Security INR 800K-1600KAD Attack Techniques | API Security | AWS Cloud | AWS Cloud Security | Active DirectoryMid-level Full TimeIN - GURUGRAM DLF DOWNTOWN BLOCK …5d ago
-
Global Head, Architecture INR 3000K-3584KAI analytics | AML | AWS | Access Management | Anomaly DetectionCompany-matched student loan contribution | Continuing education program | Continuous learning resources | Family-friendly perks | Financial wellness programsSenior-level Full TimeIN - GURUGRAM DLF DOWNTOWN BLOCK …5d ago
-
Global Head, Architecture INR 3000K-4000KAWS | Analytics | Anomaly Detection | Architecture | AzureCompany-matched student loan contribution | Continuing education program | Continuous learning resources | Family-friendly perks | Financial wellness programsSenior-level Full TimeIN - GURUGRAM DLF DOWNTOWN BLOCK …5d ago
-
Associate Director, Principal Security INR 800K-1600KAWS | Active Directory | Bash | BloodHound | Burp SuiteMid-level Full TimeIN - GURUGRAM DLF DOWNTOWN BLOCK …5d ago
-
ARM Templates | Agile methodology | Automated testing | Azure Boards | Azure DevOpsFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeKolkata Y-14, India5d ago