Data Engineer
Tasks
- Build automated validation testing and observability for pipelines
- Design build optimize data pipelines for telemetry logs events
- Develop and maintain data lineage documentation and codebooks
- Implement data retention partitioning and storage optimization
- Implement schemas mappings ETL ELT data models
- Integrate new data sources and normalize enrichment
- Mentor junior engineers and improve data engineering practices
- Monitor data quality latency completeness and reliability
- Troubleshoot production incidents and support evidentiary exports
Perks/Benefits
Skills/Tech-stack
Apache Flink | Apache Spark | Batch Processing | CI/CD | Cloud Data | Cloud Data Warehouse | Data Lake | Data Lineage | Data Modeling | Data Quality | Data Warehouse | ELT | ETL | Elasticsearch | Infrastructure as Code | Java | Kafka | Logging | Metrics | Observability | Python | Scala | Schema Design | Splunk | Stream processing | Tracing | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Engineering | Master of Science | PhD
Roles
Related jobs
-
API Design | CI/CD | Component design | Distributed Systems | Frontend architectureDental insurance | Financial benefits | Medical insurance | Vision insuranceSenior-level Full TimeSanta Clara, California, United States R13h ago
-
API Integration | AWS | Ansible | Azure | CI/CDSenior-level Full TimeSanta Clara, California, United States13h ago
-
AWS | Ansible | Azure | CI/CD | CertificatesSenior-level Full TimeSanta Clara, California, United States14h ago
-
Ansible | Autoscaling | CI/CD | Cloud Native | ContainerizationSenior-level Full TimeSanta Clara, California, United States R14h ago
-
API Integration | CI/CD | Component design | Design Systems | GraphQLDental insurance | Financial benefits | Medical insurance | Other benefits | Vision insuranceSenior-level Full TimeSanta Clara, California, United States14h ago
-
DevSecOps Engineer USD 98K-206KAWS | Backup | CI/CD | Compliance | Container OrchestrationFlexible time off | Learning resourcesMid-level Full Time376 SARASOTA FL, United States17h ago
-
Linux System Administrator - AWS Cloud (C2S) USD 86K-181KAWS CloudWatch | AWS IAM | AWS Lambda | Active Directory | Amazon EC2Continuing education | Flexible time off | Healthcare | Learning and development | RetirementMid-level Full Time147 CHANTILLY VA (COMMONWEALTH BUILDING A), …17h ago
-
AI machine learning | API Security | AWS | Azure | CI/CD401k plan | Adoption reimbursement | Disability benefits | Employee assistance program | Employee discountsSenior-level Full TimeUSA:NC:Charlotte / Ibm Dr - Adm:8505 …17h ago
-
Senior Machine Learning Engineer - Cybersecurity USD 80K-200KAnomaly Detection | Behavioral analytics | Cyber Threat | Cyber Threat Detection | CybersecuritySenior-level Full TimeSan Jose, CA, United States19h ago
-
Software Engineer SME (TS/SCI with Poly Required) USD 187K-318KAWS | Apache NiFi | CI/CD | DevOps | ETLSenior-level Full TimeDulles, Virginia, United States19h ago
-
Software Engineer SME (TS/SCI with Poly Required) USD 187K-318KAPI | API Key | Amazon Kinesis | Amazon Web Services | Apache AirflowMid-level Full TimeChantilly, Virginia, United States20h ago
-
Software Engineer SME (TS/SCI with Poly Required) USD 187K-318KAWS | Anaconda | Apache NiFi | Azure | Azure MicroservicesMid-level Full TimeMcLean, Virginia, United States20h ago
-
Mid-level Full TimeOmaha, NE20h ago
-
API Integration | CI/CD | Frontend Development | Frontend architecture | GraphQLSenior-level Full TimeSanta Clara, California, United States R20h ago
-
Staff Production Engineer (Cloud Platform & Reliability – Machine Identity Security) - hybrid USD 181K-226KAKS | AWS | Ansible | ArgoCD | AzureSenior-level Full TimeSanta Clara, California, United States R21h ago
-
API Design | AWS | Azure | CI/CD | Certificate managementSenior-level Full TimeSanta Clara, California, United States21h ago
-
Mid-level Full TimeFrisco, TX, United States R21h ago
-
Senior AI Security & Automation Engineer USD 110K-120KAccess Management | Azure Logic | Azure Logic Apps | Azure OpenAI | Bash401k matching | Dental insurance | Flexible working arrangements | Health insurance | Paid time offSenior-level Full TimeNew York, NY, United States22h ago
-
APIs | Distributed Systems | Go | Integration Testing | JavaDental insurance | Financial benefits | Health insurance | Mentorship | Vision insuranceMid-level Full TimeSanta Clara, California, United States22h ago
-
DevSecOps and Cloud Integration Engineer, Senior USD 170K-170K.NET | AWS CodePipeline | AWS Lambda | Agile | Amazon ECS401k match | Dental coverage | Employee assistance program | Flexible spending account | Health insuranceSenior-level Full TimeUT, US22h ago
-
Senior-level Full TimePortland, Oregon, United States22h ago
-
ACME | API | Concurrency | Data Modeling | Distributed SystemsDental insurance | Equity benefits | Medical insurance | Vision insuranceSenior-level Full TimeSanta Clara, California, United States1d ago
-
Senior-level Full TimeNeedham, Massachusetts, United States1d ago
-
IAM Software Engineer USD 100K-130KAdaptiveAuthentication | AuthenticationPolicies | Bash | CI/CD | JSONMid-level Full TimeChicago, Illinois1d ago
-
IAM Software Engineer USD 110K-135KAccess Management | Adaptive Authentication | Bash | CI/CD | Identity and Access ManagementMid-level Full TimeAtlanta, Georgia1d ago