AI Evaluations & Red Team Lead
Tasks
- Assess AI risks for governance
- Communicate evaluation findings
- Conduct red teaming exercises
- Define AI evaluation strategy
- Design evaluations for high risk agents
- Establish evaluation standards
- Integrate scoring into SDLC
- Lead evaluation team
Perks/Benefits
- N/A
Skills/Tech-stack
AI Governance | Agentic AI | Artificial Intelligence | Compliance | Evaluation methodology | Language Models | Large Language Models | Machine Learning | Probabilistic Models | Quality Assurance | RAG | Red Teaming | Retrieval-Augmented Generation | Security Testing
Education
N/A
Roles
AI | AI Engineer | AI Safety Engineer | Engineer | Lead | Red Team Lead | Safety Engineer | Team Lead
Related jobs
-
Senior-level Full TimeBengaluru, KA, India7h ago
-
Senior Software Engineer INR 2500K-4000KAPI Gateway | AWS | Azure OpenAI | Bitbucket | CI/CDEducation support | Generous time off | Lifestyle support | Wellness supportSenior-level Full TimeBangalore,India19h ago
-
AWS | Admission control | Azure | CI/CD | CI/CD SecurityContinuous learning | Inclusive, diverse culture | Remote-friendly | Technical growthMid-level Full TimeIndia1d ago
-
Product Security Engineer INR 3384K-4600KAI Agents | AI machine learning | AWS | Architecture Review | By DesignHealth benefits | Paid time off | Parental leave | Retirement savingsSenior-level Full TimeIndia R1d ago
-
Security Engineer - Microsoft 365 Security Administration INR 2695K-2695KAI Governance | Anti-phishing | Anti-spam | Cloud Security | Conditional AccessSenior-level Full TimeHyderabad, India1d ago
-
Security Engineer III INR 2000K-3285KAWS | Agentic Systems | Application Security Testing | Authentication | Authorization3 days in office collaboration | Hybrid work model | Training for developersSenior-level Full TimeBangalore, Karnataka, India1d ago
-
Security Architect INR 2000K-3500KAI Search | AI Services | Access Control | Asynchronous programming | Azure AISenior-level Full TimeBengaluru, BDC7A, India1d ago
-
Security Engineer INR 2000K-3487KAPI Security | Access Management | Application Firewall | CI/CD | Cloud Access Security BrokerSenior-level Full TimeBangalore, India1d ago
-
IN-Senior Associate_AI ML_Digital Integration_Advisory_Bangalore INR 2000K-3200KAdvanced Security | Application Security Testing | CI/CD | CodeQL | Composition analysisSenior-level Full TimeBengaluru Millenia, India1d ago
-
IN-Senior Associate_AI ML_Digital Integration_Advisory_Bangalore INR 2000K-3200KAdvanced Security | Application Security Testing | CI/CD | CodeQL | Composition analysisFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India1d ago
-
Application Security Engineer INR 2000K-3500KAI Security | AWS | Ansible | Application Security | ArtifactorySenior-level Full TimeBangalore, Karnataka, India1d ago
-
Sr. AI Security Engineer – AppSec INR 2000K-3500KAdversarial Attacks | Adversarial Robustness | Adversarial Robustness Toolbox | DAST | Data poisoningDisability insurance | Donation matching | Employee assistance program | Hybrid working | Life insuranceSenior-level Full TimeBengaluru, India1d ago
-
Sr Associate Cybersecurity - AI Security INR 1000K-1500KAI Act | AI Governance | AI RMF | AI Security | Adversarial Machine LearningMid-level Full TimeHyderabad, India1d ago
-
Lead Security Logging & Monitoring Response Analyst INR 1244K-3500KAdversary Emulation | Antivirus | Control Assessment | Detection engineering | EDRCareer development | Training and mentorshipSenior-level Full TimePune, India1d ago
-
Lead Software Engineer (IAM) - Java Full Stack INR 2000K-3200K.NET | AI Governance | API Gateway | AWS | Access ControlSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India1d ago
-
Senior Security Engineer INR 2475K-3465KAPI Security | AWS | Application Security | Attack Path | Attack Path AnalysisSenior-level Full TimeGurugram, India4d ago
-
AI Security Architect INR 2000K-4000KAPI Design | API Security | Access Management | Application Security | Artificial IntelligenceSenior-level Full TimeIndia4d ago
-
Staff System Test Engineer - Cybersecurity (SaaS & On-Prem) INR 1500K-2500KAPI Testing | AWS | Ansible | Azure | BashSenior-level Full TimeBengaluru, Karnataka, India; Pune, Maharashtra, India4d ago
-
Lead Software Engineer INR 2500K-5710KAI-assisted coding | AWS | Agile | Ansible | Assisted codingCollaborative office space access | Flexible time off | Hybrid work model | Medical Dental Vision and Disability Insurance | Monthly Educational ProgramsSenior-level Full TimeBengaluru-KA, Hybrid R4d ago
-
Senior-level Full TimeBangalore, IN, 5600664d ago
-
Senior DevSecOps Engineer INR 3000K-3500KAccess Management | Alerting | Azure DevOps | Bash | Branching strategySenior-level Full TimeBangalore - RGA Tech Park, India4d ago
-
Principal, Software Engineer INR 2000K-4000KAPIs | Artificial Intelligence | Big Data | Cloud Computing | Data GridSenior-level Full TimePune, India4d ago
-
Technical Support Engineer INR 1400K-1700KApplication Security Testing | Cloud | Composition analysis | Dynamic Application Security | Dynamic Application Security TestingDental insurance | Flexible hours | Health insurance | Remote work | Unlimited paid time offMid-level Full TimeIndia - Gurugram4d ago
-
Senior Platform Engineer I (Security) INR 3000K-4500KAdvanced Security | Application Security Testing | Artifact Security | Bash | Black-DuckCareer development | Global collaboration | Learning opportunities | Work from anywhereSenior-level Full TimeIndia R4d ago
-
Staff Software Development Engineer in Test (Staff SDET) INR 1632K-2500KAPI Testing | Agile | Bicep | C# | CI/CDSenior-level Full TimeBangalore, India4d ago