AI Evaluations & Red Team Lead
Tasks
- Build mentor and manage evaluation team
- Communicate evaluation results to stakeholders
- Define AI evaluation strategy
- Design and execute evaluations for high risk AI agents
- Establish evaluation standards and scoring criteria
- Influence product roadmaps
- Integrate evaluations into SDLC release gates
- Lead red teaming for critical deployments
- Present evaluation risk assessments to governance
Perks/Benefits
- N/A
Skills/Tech-stack
Agentic AI | Artificial Intelligence | Evaluation methodology | LLM | Machine Learning | Probabilistic Reasoning | Quality Assurance | RAG | Red Teaming | Retrieval-Augmented Generation | SDLC | Security Testing
Education
N/A
Roles
AI | AI Evaluation Lead | Evaluation Lead | Lead | Red Team Lead | Team Lead
Related jobs
-
AWS | Adversarial Machine Learning | Amazon SageMaker | Anonymization | AzureCutting-edge AI security work | Flexible working hours | Fully remote | Global cross-functional collaboration | Opportunity to shape AI security best practicesSenior-level Full TimeIndia R6h ago
-
AI Governance | AI RMF | AI Security | AI content | AI content filteringSenior-level Full TimeHyderabad, India1d ago
-
Associate Director – Cyber Threat Analytics INR 700K-900KAI Governance | AI RMF | AI/ML | Anomaly Detection | Artificial IntelligenceMid-level Full TimeHyderabad, India4d ago
-
AI Software Engineer INR 3584K-4408KAWS | Agent Orchestration | Azure | Benchmarking | CI/CDContinuing education program | Continuous learning | Family-friendly perks | Flexible time off | Health care coverageEntry-level Full TimeIN - HYDERABAD ORION, India4d ago
-
SOC L3 Analyst INR 2000K-3500KAWS GuardDuty | Application Security | Application Security Testing | Defender for Endpoint | Digital forensicsSenior-level Full Time Part Timehosur road bangalore, India4d ago
-
SOC L3 Analyst INR 2000K-3500KAWS GuardDuty | Application Security | Application Security Testing | Azure Sentinel | Cloud platformSenior-level Full Time Part Timehosur road bangalore, India4d ago
-
Senior-level Full TimePune, India7d ago
-
Senior-level Full TimeNavi Mumbai, India (Finicity)8d ago
-
Application Security Engineer (Tech Lead) ID71665 INR 2500K-4000KApplication Security | CI/CD | Cloud Security | Code review | DevSecOpsEducation budget | Global clients | Innovative projects | Legal compliance in India | Local team connectionSenior-level Full TimeHyderabad, India11d ago
-
Senior-level Full TimeMumbai, Maharashtra, India13d ago
-
Gen AI Full-Stack Engineer INR 1800K-3000KAI Search | ARM | App Service | Asynchronous programming | AutogenHealth benefits | Hybrid remote work | Professional development | Work-life balanceMid-level Full TimeBengaluru, Karnataka14d ago
-
Principal Engineer - AI INR 3000K-5000KAWS SageMaker | Amazon Bedrock | Amazon S3 | CI/CD | FaissMeaningful equity | Medical insurance | Unlimited leave | Wellness benefitsSenior-level Full TimeBengaluru15d ago
-
AI Security Specialist INR 2829K-5000KAI Foundry | AI Services | API Integration | Access Control | AuditabilitySenior-level Full TimeIN Pune, India15d ago
-
IN_Senior Associate_Cloud Security_Cyber Engineering & Automation_Advisory_Bangalore INR 1500K-3300KAWS | Artificial Intelligence | Artificial Intelligence Security | CI/CD | CNAPPSenior-level Full TimeBengaluru Millenia, India16d ago
-
Team Lead - Brand Protection Services INR 2000K-4000KBrand Impersonation | Brand Monitoring | Brand impersonation detection | Counterfeit detection | Data AggregationSenior-level Full TimeGurugram, Haryana, India (Hybrid) R18d ago
-
Senior-level Full TimeBangalore - RGA Tech Park, India19d ago
-
AI Security Architect INR 2520K-3380KAI RMF | AI Security | AWS | Access Control | Access ManagementSenior-level Full TimeBangalore or Remote, KA, IN R19d ago
-
AI Security Engineer INR 2000K-3500KAI Foundry | API Security | Access Management | Application Security | AzureGenerous annual leave policy | Medical insurance | Remote work flexibilitySenior-level Full TimeMumbai, MH, India R19d ago
-
Site Reliability Engineering Lead INR 1492K-2695KAIOps | AWS FIS | Amazon CloudWatch | Anomaly Detection | AutomationReward and recognition | Volunteering opportunities | Wellness programs | Work-life balanceSenior-level Full TimeHyderabad, India20d ago
-
Lead Software Engineer(Release Management, CI/CD) INR 2000K-3500KCI/CD | Cause analysis | Code review | Incident Management | Integration TestingSenior-level Full TimePune, India22d ago
-
AI Automation Lead – Enterprise Platforms INR 2500K-4000KAPI Integration | Access Control | Agent Orchestration | Copilot Studio | EDIGlobal wellbeing initiatives | Night shift allowance | Remote-first work modelSenior-level Full TimeIndia R25d ago
-
Senior AI Security Engineer [EOR] INR 3799K-5572KAccess Control | Agent Orchestration | Agent systems | Agentic AI | Application SecuritySenior-level Full TimeIndia - Field25d ago
-
Vice President, Application Security INR 1500K-5199KAPI Security | AWS | Amazon Elastic Kubernetes Service | Application Security | Attack PathProfessional development opportunities | Security trainingExecutive-level Full TimeBengaluru26d ago
-
Information Security Technical Lead INR 1753K-2772KAWS | Cloud Security | Endpoint Security | Hybrid Infrastructure | IT ComplianceFlexible work-from-home days | In-person collaborationSenior-level Full Time11071 Ameriprise India - Hyderabad26d ago
-
Cloud Security Specialist INR 2000K-3500KAccess Management | Amazon Web Services | Application Security | Azure | CASBSenior-level Full TimeBangalore - HO, India26d ago