Senior Machine Learning Engineer, Model Risk Management
Bay Area, CA, United States of America
USD 160K-283K Senior-level Full Time
Tasks
- Build LLM agent validation tooling
- Challenge model owners
- Connect explainability to model and product decisions
- Define acceptance thresholds
- Define validation standards for production AI
- Evaluate ML systems end to end
- Hunt silent model errors
- Orchestrate parallel agents
- Prove issues before production
- Reproduce model results
- Select robust evaluation methods
Perks/Benefits
Skills/Tech-stack
Agentic Systems | Amazon Web Services | Benchmarking | CI/CD | Cloud platform | Databricks | Decision Trees | Deep learning | Experiment design | Generative AI | GitHub | Google Cloud | Google Cloud Platform | Holdout Validation | Jira | LLM | LightGBM | MLflow | Machine Learning | Model Evaluation | Model calibration | NumPy | Pandas | Prefect | PyTorch | Pytest | Python | Regression | Reproducible Code | Ruff | SQL | Scikit-learn | Snowflake | Statistical modeling | Stress Testing | Uncertainty Quantification | Vertex AI | Web Services | XGBoost
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Systems Engineer - Linux USD 135K-183KAdvanced Security | Ansible | Bash | CI/CD | ChefHybrid work schedule | On-call rotationSenior-level Full TimeReston,Virginia,United States5h ago
-
Senior Network Security Engineer USD 166K-220KAWS CDK | Adversary Tradecraft | Cloud Security | Go | Incident ResponseTS Clearance EligibilitySenior-level Full TimeCosta Mesa, California, United States; Seattle, …8h ago
-
Sr. Embedded Security Engineer USD 138K-184KAnti-rollback | Applied cryptography | Authenticated Boot | Authentication | Bare MetalEmployee resource groups | Flexible hours | Flexible time off | Medical, dental & vision coverage | Monthly social eventsSenior-level Full TimeSan Francisco11h ago
-
Staff AI Security Engineer USD 208K-251KAI Security | Access Management | Adversarial Testing | Audit Logging | CI/CD401k match | Child care support | Donation matching | FSA | Fertility care supportSenior-level Full TimeSeattle, WA (hybrid) R12h ago
-
AI | AWS IAM | Active Directory | Active Directory Certificate Services | AnsibleSenior-level Contract Full TimeChicago, Illinois, United States13h ago
-
Senior-level Full TimeFoster City, CA13h ago
-
Senior Cybersecurity Engineer USD 130K-175KAWS | Access Management | Alerting | CI/CD | Cloud Native Services401k | Flexible time off | HSA FSA DCFSA | Life and ADND Insurance | Long-term disabilitySenior-level Full TimeAtlanta, GA | NYC,NY13h ago
-
Senior Security Engineer USD 150K-185KAPI Security | Application Telemetry | Automation | CI/CD | Cloud Security401k contribution | Access to Baseball Tickets | Accidental death insurance | Disability benefits | Employee Assistance Programs EAPSenior-level Full TimeRemote, USA R14h ago
-
Cybersecurity Systems Engineer Navy Mission USD 135K-230K800-53 | ACAS | ATO | Access Control | AnsibleMid-level Full TimeSan Diego, CA15h ago
-
Staff Backend Software Engineer USD 156K-215KBrowser Extension | Browser extension development | Endpoint Security | Extension development | Google Chrome401k match | Dependent care FSA | Employee assistance program | Flexible time off | Gender neutral parental leaveSenior-level Full TimeUnited States - Remote R15h ago
-
Senior Cloud Developer Engineer USD 118K-196K800-37 | 800-53 | 800-53A | ARM Templates | AWSCorporate holidays | Dental insurance | Flexible time off | Health insurance | Home internet allowanceSenior-level Full TimeChantilly, VA15h ago
-
Security Platform Engineer USD 120K-170KAWS | AWS Well Architected | Amazon EKS | Argo Workflows | ArgoCDAsync culture | Remote workMid-level Full TimeRemote- United States R16h ago
-
Senior-level Full TimeWork from home, VA, United States R17h ago
-
Analytic Engineer USD 124K-166KAWS | Anomaly Scoring | Apache Airflow | Apache Spark | Cloud platformSecurity ClearanceSenior-level Full TimeFAIRFAX, VA, United States17h ago
-
Security Automation Lead USD 250K-350KAdmission Controller | Bash | CI/CD | Cedar | CloudFormation401k savings program with employer match | Fully-paid health care benefits | Mental and physical wellness programs | Parental and family leave | Tuition assistanceSenior-level Full TimeNew York, NY18h ago
-
Senior Cloud Engineer USD 118K-196KARM Templates | Amazon Web Services | Ansible | Application Gateway | Azure CLI12 corporate holidays | Flexible time off | Group dental insurance | Group medical insurance | Home internet allowanceSenior-level Full TimeChantilly, VA18h ago
-
Principal Platform Engineer USD 147K-211KAWS | Ansible | Azure | CI/CD | CrossplaneOn site work 1 to 2 days per week | Security clearance TS SCI requiredSenior-level Full TimeSan Antonio, TX, Augusta, GA, or …18h ago
-
Anomaly Detection | Ansible | BGP | Bash | CI/CDSenior-level Full TimeSanta Ana, California, United States19h ago
-
Senior Security Engineer USD 160K-185KAWS | Application Security | Bash | Cloud Security | Data Loss Prevention401k match | Flexible benefits | Fully paid parking | Global team events | Paid time offSenior-level Full TimeAustin, Texas20h ago
-
AI Systems Engineer USD 99K-176K800-171 | AI Governance | AI RMF | Agent Orchestration | Air-gappedMid-level Full TimeAnnapolis Junction, MD21h ago
-
Senior DevSecOps Engineer - Tech Lead USD 184K-230KAWS | AWS CDK | ArgoCD | CI/CD | DASTRemote work flexibilitySenior-level Full TimeUSA (Remote) R22h ago
-
Security Engineer, Cloud Threat and Abuse Detection USD 147K-211KC++ | Computer Security | Design review | Detection Systems | Host ForensicsMid-level Full TimeSunnyvale, CA, USA22h ago
-
Software Engineer, AI/ML, Chronicle Security USD 147K-211KC++ | Data Processing | Data Storage | Debugging | Distributed SystemsMid-level Full TimeSunnyvale, CA, USA22h ago
-
Cybersecurity Engineer USD 107K-195KAccess Control | Access Control Lists | Agile | Agile Development | Authorization and AccreditationSenior-level Full TimeHanscom AFB, MA, United States1d ago
-
Senior-level Full TimeHanscom AFB, MA, United States1d ago