Senior Data Engineer
Tasks
- Automate data workflows
- Build and maintain ETL/ELT pipelines
- Collaborate with engineering teams on data requirements
- Conduct code reviews
- Design scalable data architectures schemas and models
- Harvest dataset metadata
- Implement data traceability and lineage
- Ingest transform and load data into data lake
- Monitor pipelines and data quality
- Optimize pipeline performance and reliability
- Troubleshoot pipeline failures and data anomalies
- Write pipeline and system documentation
Perks/Benefits
Skills/Tech-stack
AWS | Amazon Redshift | Azure | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Synapse Analytics | CI/CD | Cloud | Cloud platform | Data Architecture | Data Lake Storage | Data Lineage | Data Modeling | Data Pipelines | Data Quality | ELT | ETL | Google BigQuery | Google Cloud | Google Cloud Platform | MLOps | Machine Learning | Metadata Management | Microsoft Azure | Microsoft Azure Synapse | Microsoft Azure Synapse Analytics | MySQL | PostgreSQL | Python | SQL | SQL Server | Semantic Modeling | Synapse Analytics
Education
Roles
Related jobs
-
Security Engineer USD 130K-175KAccess Management | Application Firewall | C# | C++ | Cloud SecurityOnsite work | Required background checkMid-level Full TimeCape Canaveral, FL12h ago
-
Security Engineer USD 130K-180KAccess Management | Application Firewall | C# | C++ | Cloud Security401k retirement plan | Access to long-term incentives | Employee stock purchase plan | Life insurance | Medical, dental, and vision insuranceMid-level Full TimeHawthorne, CA12h ago
-
Senior Compliance Automation Engineer USD 135K-195K800-171 | 800-53 | API | AWS Config | AWS Config RulesSenior-level Full TimeDenver, CO or Long Beach, CA …17h ago
-
Senior-level Full TimeDallas, TX, United States18h ago
-
Staff Product Security Engineer USD 184K-241KAI Security | AWS | Automation | Azure | CI/CD401k matching | Commuter benefits | Disability insurance | Family planning support | Fertility supportSenior-level Full TimeNew York City19h ago
-
Staff Product Security Engineer USD 184K-241KAI Security | AWS | Automation | Azure | CI/CD401k match | Commuter benefits | Dental insurance | Disability insurance | Fertility and family planning supportSenior-level Full TimeAtlanta, Georgia, United States19h ago
-
Senior-level Full TimePortland, OR, United States21h ago
-
AWS | ArcSight | Azure | Cisco Firepower | Cloud platformOnsite position | US citizen or green card requiredSenior-level ContractWashington, United States1d ago
-
API Integration | AWS | Access Control | Attack Path | Attack Path AnalysisCorporate holidays | Dental insurance | Flexible time off | Home internet allowance | Medical insuranceMid-level Full TimeRemote R1d ago
-
SYSTEM ENGINEER - Data Management - 10+ yrs of Experience - TS/SCI w/Poly clearance is required - ES A USD 168K-173KCybersecurity | Data Analysis | Data Modeling | Data Objects | Data Science401k | Dental insurance | Disability insurance | Life insurance | Medical insuranceMid-level Full TimeLinthicum Heights, United States1d ago
-
Security Engineer III (Pen Tester) USD 102K-179KAccess Control | Adversary Emulation | Application Security | Authentication and Authorization | BashMentorship | Professional development | Reasonable accommodationsSenior-level Full TimeArlington/Rosslyn, Virginia, United States1d ago
-
Access Control | Archer Collaborate | Data Feeds | Data Imports | Data ManagementSenior-level Full TimeArlington/Rosslyn, Virginia, United States1d ago
-
CNO Reverse Engineer USD 141K-236KAssembly | Atlassian Confluence | Atlassian Crucible | Atlassian Jira | C#Disability insurance | Health insurance | Holiday pay | Learning and development | Life insuranceSenior-level Full TimeUSA-MD-Hanover1d ago
-
Senior Software Engineer, Front End, Google Cloud Web3 USD 174K-252KAI Agents | Angular | BigQuery | Blockchain | Cloud SQLSenior-level Full TimeSunnyvale, CA, USA1d ago
-
Senior Staff Software Engineer, AI/ML, Security USD 262K-365KAdversarial Machine Learning | Cloud | Data Privacy | Data Processing | Data StructuresSenior-level Full TimeKirkland, WA, USA; Seattle, WA, USA1d ago
-
Adversarial Testing | Computer Security | Evaluation | Generative Models | GuardrailsMid-level Full TimeMountain View, CA, USA; New York, …1d ago
-
Systems Engineer USD 72K-100KActive Directory | Azure AD | Backup and Restore | Entra ID | Exchange OnlineMid-level Full TimeSan Mateo, Rizal, Philippines R1d ago
-
800-53 | 800-53A | AWS Security | Azure Security | Cloud SecuritySenior-level Full TimeWashington, DC, United States1d ago
-
Senior-level Full TimeUnited States1d ago
-
Oracle Cloud Security Engineer USD 100K-150KBash | CIS Benchmarks | Cloud Compliance | Cloud Guard | Cloud infrastructureMid-level Full TimeUnited States - Remote R1d ago
-
Oracle Cloud Security Engineer USD 100K-150KBash | CIS Benchmarks | Cloud Guard | Cloud infrastructure | Data SafeMid-level Full TimeUnited States - Remote R1d ago
-
Oracle Cloud Security Engineer USD 100K-150KBash | CIS Benchmarks | Cloud Guard | Cloud infrastructure | Data SafeMid-level Full TimeUnited States - Remote R1d ago
-
Oracle Cloud Security Engineer USD 100K-150KBash | CIS Benchmarks | Cloud Guard | Cloud Security | Cloud Security FrameworksMid-level Full TimeUnited States - Remote R1d ago
-
Oracle Cloud Security Engineer USD 100K-150KBash | CIS Benchmarks | Cloud Guard | Cloud infrastructure | Data SafeRemote workMid-level Full TimeUnited States - Remote R1d ago
-
Principal Cybersecurity Network AI USD 155K-261KAI machine learning | API Security | AWS | Athena | Azure401k plan | Adoption reimbursement | Disability benefits | Employee assistance programs | Employee discountsSenior-level Full TimeCharlotte, North Carolina1d ago