Senior Data Engineer
Tasks
- Automate data workflows
- Build and maintain ETL/ELT pipelines
- Collaborate with engineering teams on data requirements
- Conduct code reviews
- Design scalable data architectures schemas and models
- Harvest dataset metadata
- Implement data traceability and lineage
- Ingest transform and load data into data lake
- Monitor pipelines and data quality
- Optimize pipeline performance and reliability
- Troubleshoot pipeline failures and data anomalies
- Write pipeline and system documentation
Perks/Benefits
Skills/Tech-stack
AWS | Amazon Redshift | Azure | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Synapse Analytics | CI/CD | Cloud | Cloud platform | Data Architecture | Data Lake Storage | Data Lineage | Data Modeling | Data Pipelines | Data Quality | ELT | ETL | Google BigQuery | Google Cloud | Google Cloud Platform | MLOps | Machine Learning | Metadata Management | Microsoft Azure | Microsoft Azure Synapse | Microsoft Azure Synapse Analytics | MySQL | PostgreSQL | Python | SQL | SQL Server | Semantic Modeling | Synapse Analytics
Education
Roles
Related jobs
-
Cybersecurity Engineer USD 123K-165KA and A | Access Control | Access Control Lists | Accreditation A and A | Agile401k | Dental insurance | Health insurance | Life insurance | Paid time offSenior-level Full TimeHanscom Afb, United States4h ago
-
Lead Security Engineer II, Architect and Cyber ICAM SME USD 107K-188KAccess Management | Active Directory | Azure AD | Azure Active Directory | ICAMSenior-level Full TimeArlington/Rosslyn, Virginia, United States5h ago
-
Project- Platform Software Engineer USD 95K-159KAWS GovCloud | Accreditation | Agile | Ansible | AuthenticationMid-level Full TimeColorado Springs, Colorado, United States5h ago
-
Research Engineer, Frontier Safety Mitigations, DeepMind USD 174K-253KAI control | Adversarial Machine Learning | Adversarial Robustness | Anomaly Detection | Artificial IntelligenceMid-level Full TimeSan Francisco, CA, USA; Mountain View, …6h ago
-
Algorithms | C++ | Data Structures | Debugging | Distributed SystemsBonus target | Equity | Health insurance | Paid time off | Retirement planMid-level Full TimeRaleigh, NC, USA; Durham, NC, USA6h ago
-
Artificial Intelligence | Cloud Security | Cloud Security Incident Response | Cyber Security | Cyber ThreatBenefits | Full scope polygraph clearanceSenior-level Full TimeMaryland, USA6h ago
-
IT Systems Engineer – Classified Build Room USD 123K-170KAPT | Air-gapped | Air-gapped networks | Ansible | BashSenior-level Full TimeWoburn,MA12h ago
-
Full Stack Software Engineer-Principal USD 170K-220KAnsible | Apache | Apache Superset | Cloud Migration | ElasticsearchSenior-level Full TimeAnnapolis Junction, Maryland, United States13h ago
-
Cloud Network Engineer USD 120K-166KAWS | Application Modernization | Azure | Cloud Networking | Cloud infrastructure401k match | Flexible spending plan | Life insurance | Local support staff | Medical insuranceSenior-level Full TimeAustin, TX, United States13h ago
-
Risk Management Support Task Lead USD 107K-165K800-37 | ACAS | ATO | AV | Apache401k match | Long-term disability | Medical/Dental/Vision insurance | Paid Holidays | Paid time offSenior-level Full TimeScott Air Force Base, IL, US13h ago
-
DevSecOps Lead USD 165K-200KBranch protection | CI/CD | Code Scanning | Code review | Container Image401k match | Flexible vacation | Flexible work hours | Learning reimbursement | Parental leaveSenior-level Full TimeUS Remote R16h ago
-
Principal Security Engineer -DLP AI Security Automation USD 145K-180KAI | AWS | Access Management | Agent-based | Agent-based systemsEducation reimbursement | Flexible work arrangements | Hybrid work arrangement | Maternity & paternity leave | Medical, dental, and vision coverageSenior-level Full TimeUnited States16h ago
-
Senior-level Full TimeSan Francisco, CA | New York …16h ago
-
Senior DevSecOps Engineer USD 100K-170K800-53 | Advanced Security | Agile | App Service | Application Gateway401k match | Dental insurance | Health insurance | PTO | Paid parental leaveSenior-level Full TimeArlington, VA / Remote R17h ago
-
DevSecOps Solution Architect USD 100K-185K800-53 | AKS | Advanced Security | App Service | Application Gateway401k company match | Dental insurance | Health insurance | PTO | Paid parental leaveSenior-level Full TimeArlington, VA / Remote R17h ago
-
Data Platform Administrator USD 59K-72KAccess Management | Apache Spark | Automation | CI/CD | Data Governance401k employer matching | Birthday leave | Commuter benefits program | Educational assistance | Employer-paid health insuranceSenior-level Full TimeRockville, MD, US18h ago
-
Technology Control Automation Specialist USD 175K-225KAI RMF | API Integration | AWS | Agent Frameworks | Application SecuritySenior-level Full TimeUnited States19h ago
-
Security Engineer, Core Command USD 200K-300KAWS | Architecture Analysis | Audit | Authentication | AuthorizationCommuter benefits | Fertility benefits | Flexible PTO | Flexible spending account | Health savings accountSenior-level Full TimeSan Mateo, CA United States19h ago
-
Staff+ Security Engineer, Developer Tools USD 200K-300KAWS | Architecture Analysis | Bug Bounty | Code review | Design reviewCommuter benefits | Flexible PTO | Flexible spending account | Health Saving Account | Healthy lunchesSenior-level Full TimeSan Mateo, CA United States19h ago
-
Sr Lead Security Engineer USD 177K-215KARM | Assembly | C# | Channel analysis | Common CriteriaBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimePlano, TX, United States19h ago
-
Senior Vulnerability Specialist (Infra) USD 96K-135KAPIs | Bash | CI/CD | CMDB | Cloud SecurityEducation reimbursement | Flexible work arrangements | Maternity leave | Medical, dental, and vision insurance | Paid time offSenior-level Full TimeUnited States20h ago
-
Senior Security Software Engineer, IAM USD 269K-326K.NET | Access Control | Access Management | Attribute-Based Access Control | Attribute-based accessSenior-level Full TimeSan Mateo, CA, United States R20h ago
-
Staff Information Security Engineer - AI First USD 170K-220KAI Agents | AWS | Access Management | Artificial Intelligence | CSPM401k match | Career development opportunities | Caregiver leave | Employee assistance program | HSA contributionsSenior-level Full TimeUnited States - Remote R20h ago
-
Principal Security Engineer - SaaS Security Posture Mgt USD 135K-180KAPI Security | Access Management | Automation | CIS Controls | FederationEducation reimbursement | Flexible work arrangements | Maternity and paternity leave | Medical, dental, and vision coverage | Paid time offSenior-level Full TimeUnited States21h ago
-
IT Data Center Engineer USD 84K-116KBash | Capacity Planning | Cause analysis | Change Management | Copper Termination401k match | EAP | Employee assistance program | Flexible time off | Gym reimbursementMid-level Full TimeHillsboro, Oregon, United States; Oregon; Washington21h ago