Senior Machine Learning Engineer, Model Risk Management
Bay Area, CA, United States of America
USD 160K-283K Senior-level Full Time
Tasks
- Build LLM agent validation tooling
- Challenge model owners
- Connect explainability to model and product decisions
- Define acceptance thresholds
- Define validation standards for production AI
- Evaluate ML systems end to end
- Hunt silent model errors
- Orchestrate parallel agents
- Prove issues before production
- Reproduce model results
- Select robust evaluation methods
Perks/Benefits
Skills/Tech-stack
Agentic Systems | Amazon Web Services | Benchmarking | CI/CD | Cloud platform | Databricks | Decision Trees | Deep learning | Experiment design | Generative AI | GitHub | Google Cloud | Google Cloud Platform | Holdout Validation | Jira | LLM | LightGBM | MLflow | Machine Learning | Model Evaluation | Model calibration | NumPy | Pandas | Prefect | PyTorch | Pytest | Python | Regression | Reproducible Code | Ruff | SQL | Scikit-learn | Snowflake | Statistical modeling | Stress Testing | Uncertainty Quantification | Vertex AI | Web Services | XGBoost
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Systems Engineer - Linux USD 135K-183KAdvanced Security | Ansible | Bash | CI/CD | ChefHybrid work schedule | On-call rotationSenior-level Full TimeReston,Virginia,United States4h ago
-
Senior Network Security Engineer USD 166K-220KAWS CDK | Adversary Tradecraft | Cloud Security | Go | Incident ResponseTS Clearance EligibilitySenior-level Full TimeCosta Mesa, California, United States; Seattle, …7h ago
-
Staff AI Security Engineer USD 208K-251KAI Security | Access Management | Adversarial Testing | Audit Logging | CI/CD401k match | Child care support | Donation matching | FSA | Fertility care supportSenior-level Full TimeSeattle, WA (hybrid) R11h ago
-
AI | AWS IAM | Active Directory | Active Directory Certificate Services | AnsibleSenior-level Contract Full TimeChicago, Illinois, United States11h ago
-
Senior-level Full TimeFoster City, CA11h ago
-
Senior Security Engineer USD 150K-185KAPI Security | Application Telemetry | Automation | CI/CD | Cloud Security401k contribution | Access to Baseball Tickets | Accidental death insurance | Disability benefits | Employee Assistance Programs EAPSenior-level Full TimeRemote, USA R13h ago
-
Staff Backend Software Engineer USD 156K-215KBrowser Extension | Browser extension development | Endpoint Security | Extension development | Google Chrome401k match | Dependent care FSA | Employee assistance program | Flexible time off | Gender neutral parental leaveSenior-level Full TimeUnited States - Remote R14h ago
-
Senior Cloud Developer Engineer USD 118K-196K800-37 | 800-53 | 800-53A | ARM Templates | AWSCorporate holidays | Dental insurance | Flexible time off | Health insurance | Home internet allowanceSenior-level Full TimeChantilly, VA14h ago
-
Security Platform Engineer USD 120K-170KAWS | AWS Well Architected | Amazon EKS | Argo Workflows | ArgoCDAsync culture | Remote workMid-level Full TimeRemote- United States R15h ago
-
Senior-level Full TimeWork from home, VA, United States R16h ago
-
Analytic Engineer USD 124K-166KAWS | Anomaly Scoring | Apache Airflow | Apache Spark | Cloud platformSecurity ClearanceSenior-level Full TimeFAIRFAX, VA, United States16h ago
-
Security Automation Lead USD 250K-350KAdmission Controller | Bash | CI/CD | Cedar | CloudFormation401k savings program with employer match | Fully-paid health care benefits | Mental and physical wellness programs | Parental and family leave | Tuition assistanceSenior-level Full TimeNew York, NY17h ago
-
Senior Cloud Engineer USD 118K-196KARM Templates | Amazon Web Services | Ansible | Application Gateway | Azure CLI12 corporate holidays | Flexible time off | Group dental insurance | Group medical insurance | Home internet allowanceSenior-level Full TimeChantilly, VA17h ago
-
Principal Platform Engineer USD 147K-211KAWS | Ansible | Azure | CI/CD | CrossplaneOn site work 1 to 2 days per week | Security clearance TS SCI requiredSenior-level Full TimeSan Antonio, TX, Augusta, GA, or …17h ago
-
Anomaly Detection | Ansible | BGP | Bash | CI/CDSenior-level Full TimeSanta Ana, California, United States18h ago
-
Senior Security Engineer USD 160K-185KAWS | Application Security | Bash | Cloud Security | Data Loss Prevention401k match | Flexible benefits | Fully paid parking | Global team events | Paid time offSenior-level Full TimeAustin, Texas19h ago
-
AI Systems Engineer USD 99K-176K800-171 | AI Governance | AI RMF | Agent Orchestration | Air-gappedMid-level Full TimeAnnapolis Junction, MD20h ago
-
Security Engineer, Cloud Threat and Abuse Detection USD 147K-211KC++ | Computer Security | Design review | Detection Systems | Host ForensicsMid-level Full TimeSunnyvale, CA, USA21h ago
-
Software Engineer, AI/ML, Chronicle Security USD 147K-211KC++ | Data Processing | Data Storage | Debugging | Distributed SystemsMid-level Full TimeSunnyvale, CA, USA21h ago
-
Software Engineer, Security & Privacy USD 170K-230KAPI Security | AWS CDK | AWS Security | Amazon Web Services | AuthenticationCompany holidays | Flexible PTO | Hybrid work model | Medical, dental & vision coverageSenior-level Full TimeNew York, NY1d ago
-
Entry-level ContractNew York, NY1d ago
-
AWK | Agile methodology | Bash | C# | C++401k matching | Employee resource groups | Flex Time Off | Flexible schedule | Health & wellness programsEntry-level Full TimeScottsdale, AZ, United States1d ago
-
Senior Software Engineer, Generalist USD 191K-253KBackend Development | C++ | CI/CD | Data Modeling | Data PipelinesSenior-level Full TimeCosta Mesa, California, United States1d ago
-
Forward Deployed Engineer USD 150K-230KAI | Automation | Cloud Security | Data Engineering | Data PipelinesGrowth opportunities | Health benefits | Professional developmentMid-level Full TimeKansas City, MO SOC1d ago
-
Staff Forward Deployed Engineer USD 148K-215KAmazon Web Services | Architecture | Cloud Computing | Cloud platform | Data PipelinesSenior-level Full TimeKansas City, MO SOC1d ago