Data Engineer
Tasks
- Build automated validation testing and observability for pipelines
- Design build optimize data pipelines for telemetry logs events
- Develop and maintain data lineage documentation and codebooks
- Implement data retention partitioning and storage optimization
- Implement schemas mappings ETL ELT data models
- Integrate new data sources and normalize enrichment
- Mentor junior engineers and improve data engineering practices
- Monitor data quality latency completeness and reliability
- Troubleshoot production incidents and support evidentiary exports
Perks/Benefits
Skills/Tech-stack
Apache Flink | Apache Spark | Batch Processing | CI/CD | Cloud Data | Cloud Data Warehouse | Data Lake | Data Lineage | Data Modeling | Data Quality | Data Warehouse | ELT | ETL | Elasticsearch | Infrastructure as Code | Java | Kafka | Logging | Metrics | Observability | Python | Scala | Schema Design | Splunk | Stream processing | Tracing | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Engineering | Master of Science | PhD
Roles
Related jobs
-
C++ | Cloud Security | Compliance | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeNew York, NY, USA; Sunnyvale, CA, …1h ago
-
Senior Software Engineer, Google Cloud Security USD 174K-252KAlgorithms | C++ | Cloud platform | Data Processing | Data QualitySenior-level Full TimeReston, VA, USA; New York, NY, …1h ago
-
Staff Software Engineer – .NET Framework (Windows / On-Prem Platform) hybrid in Salt Lake City, Utah USD 156K-189K.Net Framework | Backward Compatibility | By Design | C# | Certificate managementDental insurance | Disability insurance | Health insurance | Paid time off | Retirement planSenior-level Full TimeSalt Lake City, Utah, United States9h ago
-
AKS | AWS | Access Management | Azure | CI/CD401k match | Dental insurance | Fully covered certifications and training | Home office support | Life insuranceSenior-level Full TimeCharlottesville, VA (with Arlington, VA office …11h ago
-
EW Systems Engineer USD 86K-179KAds | CST | Cameo | Detection theory | Electronic Warfare401k | Autonomy | Dental insurance | Health insurance | Inclusive work environmentSenior-level Full TimeEl Segundo, CA12h ago
-
Sr Lead, Cybersecurity Engineering USD 114K-194KAzure DevOps | Change Management | Cloud apps | Communication Compliance | DSPMSenior-level Full TimeChicago, IL, United States12h ago
-
Product Security Engineer USD 130K-215KApplication Security | Code review | Django | Flask | Penetration Testing401k retirement planning | Disability insurance | Flexible PTO | Free onsite meals | Health insuranceMid-level Full TimeSan Francisco13h ago
-
Senior Product Security Engineer USD 180K-285KAuthentication | Authorization | C# | C++ | Code review401k retirement planning | Disability insurance | Flexible PTO | Free catered meals | HealthcareSenior-level Full TimeSan Francisco13h ago
-
Red Team Security Engineer USD 130K-205KApplication Security | Burp Suite | Cobalt Strike | Covert operations | Incident Response401k retirement plan | Disability insurance | Equity compensation | Flexible PTO | Free on-site mealsMid-level Full TimeSan Francisco15h ago
-
Enterprise Solutions Engineer, Central Corp USD 155K-205KAPI | Access Control | Active Directory | Cloud Security | DHCPCommuter benefits | Fertility benefits | Flexible PTO | Flexible spending account | Health Saving AccountMid-level Full TimeAustin, TX United States15h ago
-
ME00563-Systems Engineer 3 USD 170K-235KAWS EBS | AWS EC2 | AWS EFS | AWS Lambda | AWS RDSDental insurance | Life insurance | Long-term disability | Medical insurance | Paid HolidaysMid-level Full TimeAnnapolis Junction, MD15h ago
-
Security Software Engineer - Endpoint Security USD 113K-171KAndroid | C plus plus | C# | CI/CD | EBPFCommuter benefits | Family planning and parenting support | Generous time off | Healthcare benefits | Income protectionMid-level Full TimeAshville, Ohio, United States15h ago
-
Support Engineer USD 81K-174KAKS | Azure Kubernetes | Azure Kubernetes Service | CI/CD | IISOn-call rotationEntry-level Full TimeMontvale, New Jersey, United States15h ago
-
Support Engineer USD 81K-174KAzure Kubernetes | Azure Kubernetes Service | CI/CD | Cause analysis | IISOn-call rotationEntry-level Full TimeDallas, Texas, United States15h ago
-
Senior Data Engineer USD 160K-195KAWS Lambda | AWS Step Functions | Alerting | Amazon EMR | Amazon KinesisSenior-level Full TimeRemote - US R15h ago
-
Information Security Engineer USD 85K-126KC# | C++ | CIS | CSPM | DLP401k with company match | Charitable giving platform with company match | Commuter benefits | Dental insurance | Employee discount programsMid-level Full TimeAustin, Texas15h ago
-
Security Accreditation Lead USD 100K-100KAccess Control | CI/CD | Client Side Data Protection | Client side | Cloud Native401k retirement plan | Dental insurance | Disability coverage | Flexible spending account | Health insuranceSenior-level Contract Full TimeRemote, United States R15h ago
-
Technical Support Engineer USD 65K-93KAPI troubleshooting | Cloud Computing | Confluence | Cortex SOAR | CrowdStrikeSenior-level Full TimeRemote - USA R16h ago
-
Software Engineer - New College Graduate USD 120K-280KAutomated testing | C++ | Data Management | Data Structures | DatabasesEmployee recognition program | Generous time away from work | Health insurance | Life insurance | Retirement savings planEntry-level Full TimeAustin, TX or Remote R16h ago
-
Senior AppSec Engineer USD 130K-180KBurp Suite | CI/CD | CORS | Containers | GitHub Actions401k match | Company equipment | Company in person events | Disability benefits | Flexible PTOSenior-level Full TimeAtlanta, GA preferred, Remote R16h ago
-
Senior-level Full TimeSan Diego, CA16h ago
-
AWS Cloud Engineer / Administrator USD 120K-139KAWS | AWS Bedrock | AWS Lake Formation | AWS Lambda | Amazon CloudWatchEmployee assistance program | Employee stock purchase plan | Life, accident, and disability insurance | Medical/Dental/Vision insurance | Paid sick leaveMid-level Full TimeSan Jose, CA, United States16h ago
-
Async-std | Async/Await | CI/CD | Concurrency | ContainerizationEducation reimbursement | Health plans | Hybrid work model | In-office perks | Parental leaveSenior-level Full TimeSan Jose, California, USA17h ago
-
ARM | Bare Metal | Bare Metal Firmware Emulation | Bare metal firmware | C#Active Secret clearance eligibility | Top secret clearance eligibilityMid-level Full TimeWoburn, MA17h ago
-
Application Developer Senior (TS/SCI with Poly Required) USD 107K-179KAWS | Apache NiFi | CI/CD | ETL | ElasticsearchSenior-level Full TimeChantilly, Virginia, United States17h ago