Data Engineer II - Getting Customers Ready for AI
Tasks
- Apply data governance lineage and auditing
- Build and maintain telemetry pipelines and metrics systems
- Build feature pipelines for training data preparation
- Collaborate with AI engineers on RAG pipelines
- Design and develop scalable data pipelines
- Design and evolve data models and schemas
- Develop and optimize ETL/ELT workflows
- Implement data ingestion frameworks
- Implement data validation quality checks observability
- Implement monitoring and alerting for pipeline health
- Maintain data partitioning retention lifecycle strategies
- Write clean, maintainable, well-tested code
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Flink | Apache Kafka | Apache Spark | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Synapse | Azure Synapse Analytics | C# | C++ | Data Contracts | Data Governance | Data Lake Storage | Data Lineage | Data Modeling | Data Observability | Data Quality | Databricks | ELT | ETL | Feature Engineering | Feature Store | Java | JavaScript | Python | RAG | SQL | Scala | Streaming Data | Synapse Analytics
Education
Roles
Related jobs
-
Infrastructure Security Monitoring Engineer USD 165K-208KAI Risk | AI Risk Assessment | Agent Orchestration | Bias Mitigation | Computer NetworkingMid-level Full TimeMenlo Park, CA6h ago
-
Staff Software Engineer, Cloud Security USD 207K-301KAPI Development | Access Control | Authorization | C++ | Data StructuresBonus | Equity | Health insurance | Paid time off | Retirement planSenior-level Full TimeSunnyvale, CA, USA; San Francisco, CA, …6h ago
-
Access Control | Bash | Cloud Security | Compliance | EncryptionBonus | Equity | Travel opportunitiesSenior-level Full TimeReston, VA, USA; Boulder, CO, USA6h ago
-
Access Control | Bash | CNAPP | Cloud Native | Cloud SecurityBenefits package | Top Secret clearance ability | Travel to customer sitesSenior-level Full TimeReston, VA, USA; Boulder, CO, USA6h ago
-
Senior Security Engineer, External API Security USD 174K-253KAPI Security | Access Control | Artificial Intelligence | Authorization | Automated Code RefactoringSenior-level Full TimeNew York, NY, USA6h ago
-
DevSecOps Lead USD 155K-190KAWS | Access Management | Application Security | Bash | CI/CDConference participation | Flexible working setup | International and English speaking workplace | Opportunities for growth learning and professional development | Training budgetSenior-level Full TimeTampa, United States R7h ago
-
System Engineer 1 (TS/SCI with Poly) USD 160K-198KAttribute Based Access Control ABAC | Attribute-Based Access Control | Attribute-based access | Confluence | Entitlements management401k | Dental insurance | Employee discount program | Flexible spending account | Flexible work scheduleMid-level Full TimeFORT MEADE, MD, US11h ago
-
Database Administrator USD 94K-209KASM | Ansible | Autonomous Database | Chef | Data CompressionFlexible medical benefits | Life insurance | Retirement options | Volunteer programsMid-level Full TimeUnited States11h ago
-
ATO | AWS GovCloud | Azure Government | Batch Processing | CI/CDActive secret clearance | Federal compliance documentationSenior-level Full TimeSilver Spring, MD, US16h ago
-
API Testing | Agile | Amazon Web Services | CI/CD | ConfluenceOnsite work | Remote Days Per WeekMid-level Full TimeAnnapolis Junction, MD R17h ago
-
Senior Site Reliability Engineer USD 125K-145KAWS | Azure | Bash | CI/CD | Chaos EngineeringDental insurance | Education assistance | Employee assistance program | Employee referral bonus | Family support benefitsSenior-level Full TimeLehi, Utah18h ago
-
System Engineer 2 (TS/SCI with Poly) USD 160K-198KAWS | Access Control | Authentication | Authorization | Container SecurityDental insurance | Employee discount program | Employee referral rewards | Flexible work schedule | Health insuranceMid-level Full TimeFORT MEADE, MD, US19h ago
-
Senior-level Full TimeCosta Mesa, California, United States; Washington, …21h ago
-
Staff DevOps Engineer USD 133K-190KAIOps | AWS | Alertmanager | Ansible | CI/CDEducation reimbursement | Health plans | Hybrid work | Parental leave | Retirement optionsSenior-level Full TimeSan Jose, California, USA21h ago
-
Algorithms | C# | C++ | DNS | Data StructuresEducation reimbursement | Health plans | Hybrid work model | In-office perks | Paid time offSenior-level Full TimeSan Jose, California, USA21h ago
-
Cyber Security Engineer USD 99K-192KAccess Management | Ansible | Automation | Azure | CI/CDCommunity service time | Employee resource groups | Flexible family care | Medical dental prescription coverage | Paid HolidaysSenior-level Full TimeUnited States R22h ago
-
Staff Site Reliability Engineer USD 122K-175KARP | Ansible | Bash | DHCP | DockerEducation reimbursement | Health plans | Hybrid work model | Parental leave options | Retirement optionsSenior-level Full TimeSan Jose, California, USA23h ago
-
C# | C++ | CI/CD | Containerization | Data PipelinesMid-level Full TimeRedmond, WA, US23h ago
-
Agentic AI Engineer USD 130K-170KAgentic AI | Concurrency | Context engineering | Data Compression | Data IngestionCareer growth | Health and well-being programs | Remote work | Supportive teamMid-level Full TimeRemote - United States R23h ago
-
API Integration | Agentic Systems | Automation | Azure | C#Collaborative team environment | Growth mindset culture | MentorshipSenior-level Full TimeRedmond, WA, US1d ago
-
AI Security Engineer USD 140K-170KAI Act | AI Governance | AI RMF | Agent Orchestration | Anomaly Detection401k plan with company matching | Employee assistance program | Employee discount program | Health, dental, and vision care | HolidaysSenior-level Full TimeRemote - Nationwide, United States R1d ago
-
Cyber Systems Engineer USD 185K-200KACAS | AWS | Active Directory | Ansible | Azure GovCloud401k with company matching | Bereavement | Disability insurance | Employee assistance program | Employee discount programSenior-level Full TimeSan Diego, CA, United States1d ago
-
Security & Compliance Engineer USD 100K-160KAWS CloudTrail | AWS Config | AWS IAM | AWS KMS | AWS SecurityMid-level Full TimeUnited States (Remote) R1d ago
-
Cyber Security Platform Engineer - Cyber Defense USD 97K-190KAnsible | Bash | CI/CD | Cloud Run | Cloud platformEmployee resource groups | Flexible family care | Immediate dental coverage | Immediate medical coverage | Paid HolidaysSenior-level Full TimeUnited States R1d ago
-
SOFTWARE ENGINEER - HPC /Splunk - 12+ yrs of Experience - TS/SCI w/Poly clearance is required - ID A USD 25KAgile | Ansible | C plus plus | C# | CI/CD401k match | Dental insurance | Health insurance | Life insurance | Paid time offMid-level Full TimeAnnapolis Junction, United States1d ago