ETL/DATA Pipeline Engineer
Tasks
- Design ETL workflows
- Develop data transformation logic
- Implement data validation and quality checks
- Ingest data from IoT streams APIs and legacy systems
- Maintain data lineage tracking and documentation
- Optimize pipeline performance and reliability
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Apache NiFi | Data Cleansing | Data Governance | Data Lineage | Data Quality | Data Transformation | ETL | Python | SQL | Talend
Education
Related jobs
-
Sr Network Security Engineer II USD 112K-185KAWS | AWS Security | AWS Security Hub | Access Control | Azure401k match | Flexible work schedule | Health, dental, vision insurance | Paid Holidays | Paid time offSenior-level Full TimeWashington DC R5h ago
-
Principal Detection and Response Engineer USD 295K-345KAmazon Athena | Apache Flink | Apache Kafka | Apache Spark | C#Equity compensation | Health benefits | Hybrid work environment | On-call rotationSenior-level Full TimeSan Mateo, CA, United States R10h ago
-
Data Platform Engineer USD 130K-175KAccess Control | Alerting | CI/CD | Cloud services | Data LineageMid-level Full TimeMilwaukee, WI13h ago
-
SIEM Infrastructure and Detection Engineer USD 120K-152KAlert Tuning | Ansible | Bash | Carbon Black | ChefClearance support | Healthcare benefits | Hybrid work | Paid time offMid-level Full TimePortland, OR, United States14h ago
-
Information Security Engineer USD 108K-140KAPIs | Access Management | Authentication | Automation | Cloud Security401k match | Company holidays | Dental benefits | Employee discount | Medical benefitsMid-level Full TimeMerriam, KS, United States14h ago
-
Senior Detection and Response Engineer USD 166K-220KAWS | Anomaly Detection | Azure | Behavior analytics | CDKU S Top Secret security clearanceSenior-level Full TimeCosta Mesa, California, United States14h ago
-
Senior Security Engineer II, Vulnerability Management USD 165K-242KAWS | AWS Lambda | Admission control | Automation workflows | Azure401k employer match | Disability insurance | Employee stock purchase program ESPP | Flexible PTO | Flexible spending accountSenior-level Full TimeLivingston, NJ / New York, NY …15h ago
-
Bash | Cloud infrastructure | Cloud infrastructure as code | Cloud platform | Data ProcessingAsynchronous culture | Distributed team | Portfolio support | Remote workMid-level Full TimeMiami, FL, USA17h ago
-
Senior-level Full TimeDallas, TX, United States19h ago
-
Senior Security Engineer USD 167K-219KAWS | AWS Security | AWS Security Hub | Access Log Review | Access ManagementHybrid work | Onsite presence required | Sponsorship available | Work from home flexibilitySenior-level Full TimeNew Haven, CT1d ago
-
Software Engineer (Backend) USD 183K-230KAPI Development | Apache Spark | Distributed Systems | ETL | JavaSenior-level Full TimePalo Alto, CA1d ago
-
Radio Frequency Software Engineer Principal - 1649 USD 157K-218KAir Gapped Development | Air-gapped | Architecture Decision | Architecture Decision Records | Async architectureRemote workSenior-level Full TimeReston, VA - Remote R1d ago
-
Vice President, Information Security USD 83K-200KAPI Integration | Advanced Analytics | Ansible | Artifactory | AutomationExecutive-level Full TimeNew York, NY, United States1d ago
-
Service Management Team Engineer USD 91K-162KAPI Integration | AWS | Automation | Azure | Azure DevOpsContinuous learning access | Education program | Flexible time off | Health care coverage | Retirement planningEntry-level Full TimeUS - NC - RALEIGH 421 …1d ago
-
DevSecOps Mission Systems Software Engineer USD 69K-158KAWS | Angular | Ansible | Automated testing | AzureDependent care | Hybrid work options | Paid leave | Professional development | Remote work optionsMid-level Full TimeUSA, NY, Rome (99 Otis St), …1d ago
-
AWS | Arista Networks | Azure | Bash | Certificate Lifecycle Management401k match | Financial education | Hybrid work flexibility | Life insurance | Long-term disabilitySenior-level Full TimeIN-INDIANAPOLIS, 220 VIRGINIA AVE, United States1d ago
-
Cloud Security Engineer USD 93K-155KAutomation | Cloud Security | Firewalls | Graylog | HTTPCompany-Paid Holidays | Disability insurance | Employee assistance program | Life insurance | Medical/Dental/Vision insuranceMid-level Full TimeAustin - Arboretum Plaza, United States1d ago
-
Mid-level Full TimeUSA - AZ - Chandler, United …1d ago
-
Corporate Sales Engineer, Post-Sales (Remote) USD 75K-115KAI Security | AI machine learning | AWS | Active Directory | Anomaly DetectionEmployee networks | Paid parental leave | Paid vacation and holidays | Professional development | Remote workMid-level Full TimeUSA TX Remote, United States R1d ago
-
Consulting/Principal Software Engineer USD 115K-192KBiometric Authentication | Data Analysis | Data Preprocessing | Deep learning | Face RecognitionCelebratory Allowance or Gifts | Employee assistance program | Family benefits | Flexible benefits plan | Flexible working arrangementsSenior-level Full TimeHome based-Montana, United States R1d ago
-
SkillBridge, Application Security Engineer - Trainee USD 65K-110KAPI Security | Ansible | Authentication and Authorization | CI/CD | CIS BenchmarksEntry-level Full TimeDallas Infomart Office DAI, United States1d ago
-
Oracle Cloud Security Engineer USD 100K-150KBash | CIS | CIS Benchmarks | Cloud Guard | Cloud infrastructureCareer growth | H1B transfers supported | Mentorship | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Security Engineer, Amazon Leo, Amazon Leo USD 159K-202K.NET | Automation | C# | C++ | Code reviewFlexible work hours and arrangements | Training and career growth resources | Work/life balance focusMid-level Full TimeRedmond, Washington, USA1d ago
-
AI Security Engineer USD 100K-150KAccess Controls | Access Management | Adversarial Machine Learning | Application Security | AuthorizationSenior-level Full TimeUnited States - Remote R1d ago
-
Mid-level Full TimeRosslyn, VA, US R1d ago