Principal Data Engineer
Tasks
- Conduct peer reviews of pipeline configurations and schemas
- Deliver Agile Scrum sprint milestones and compliance requirements
- Design secure data movement between Apache NiFi and external systems
- Develop and maintain documentation for pipelines and integration tests
- Implement and validate data transfer reliability
- Support secure data transport architecture with enterprise standards
- Troubleshoot data flow failures across system boundaries
- Validate data formats and schema alignment
Perks/Benefits
Skills/Tech-stack
Access Control | Agile | Apache NiFi | Avro | CI/CD | Data Modeling | DevSecOps | Encryption in Transit | Groovy | Integration Engineering | JSON | Java | Kubernetes | Protobuf | Python | REST API | Schema Validation | Scrum | XML
Education
N/A
Related jobs
-
Software Engineer, Security Command Center Control Plane USD 147K-211KBackend Development | Cloud APIs | Cloud Computing | Data Structures | Data Structures and AlgorithmsMid-level Full TimeKirkland, WA, USA1h ago
-
Cybersecurity Engineer USD 130K-180K800-171 | 800-53 | ATO | Access Control | Authority to Connect401k matching | Free EV charging | Full health coverage | Lunch provided | Paid HolidaysMid-level Full TimeEl Segundo, CA10h ago
-
Risk Development – Software Engineer USD 150K-220KAWS | Concurrency | Dask | Data Modeling | Data PipelinesMid-level Full TimeNew York10h ago
-
CI/CD | Certificate management | Go | GraphQL | JavaDental insurance | Financial benefits | Medical insurance | Paid on-call rotation | Vision insuranceSenior-level Full TimeSanta Clara, California, United States11h ago
-
Senior Information Security Engineer - Incident Response USD 125K-206KAlert triage | Cloud Forensics | EDR | Event Logs | Incident ResponseHealth and wellness programs | Time awaySenior-level Full TimeSunnyvale, CA, United States12h ago
-
Staff Infrastructure Security Engineer USD 152K-248KAuthentication | Big Data | Big Data Security | CI/CD | CI/CD SecurityHybrid work location | Mentorship | Technical growth opportunitiesSenior-level Full TimeSunnyvale, CA, United States12h ago
-
Staff Software Engineer - Trust Incident Management USD 152K-248KAbuse detection | Anomaly Detection | Automation | Big Data | Continuous integrationHealth and wellness programs | Hybrid work | Time awaySenior-level Full TimeMountain View, CA, United States12h ago
-
Software Engineer- Networking USD 123K-200KAnsible | C# | C++ | CI/CD | ContainerizationEmployee stock purchase plan | Health insurance | Life insurance | Paid time off | Restricted stock unitsSenior-level Full TimeMorrisville, NC, US12h ago
-
Lead Cybersecurity USD 150K-215KAccess Management | Agile Scrum | Azure | Identity and Access Management | Identity and access401k plan | Adoption reimbursement | Disability benefits | Employee assistance program | Employee discountsSenior-level Full TimeUSA:TX:Plano / W Plano Pkwy - …12h ago
-
DevOps Engineer USD 91K-156KAnsible | Artifact Repository | CI/CD | Configuration Management | ContainerizationMid-level Full TimeArlington, VA13h ago
-
ME00560-Manual Test Engineer USD 125K-175KAcceptance criteria | Agile | Automated testing | Automated testing tools | BDDGroup medical insurance | Paid Dental Insurance | Paid Holidays | Paid STD LTD Insurance | Paid life insuranceSenior-level Full TimeAnnapolis Junction, MD13h ago
-
Staff Product Security Engineer, Cloud Security USD 151K-297KAWS | Azure | CI/CD | CSPM | CloudFormation401k plan | Employee stock purchase program | Equity | Fertility and adoption assistance | Flexible paid time offSenior-level Full TimeNew York City14h ago
-
DevOps Engineer, Infrastructure & Security USD 236K-295KAWS | Azure | Azure DevOps | Bash | CI/CDCommuter stipend | Comprehensive health, dental and vision coverage | Generous PTO | Learning and development stipend | Retirement benefitsMid-level Full TimeSan Francisco, CA; New York, NY14h ago
-
Software Engineer USD 116K-170KACME | APIs | Automation | CI/CD | Distributed SystemsDental insurance | Discretionary bonus | Equity | Medical insurance | Paid on-call rotationMid-level Full TimeSanta Clara, California, United States15h ago
-
Algorithms | Artificial Intelligence | Authentication | Authorization | C#Employee assistance programs | Health and wellness programs | Paid time offSenior-level Full TimeSunnyvale, CA, United States15h ago
-
IAM Engineer USD 120K-150KAPI Integration | Access Management | Access deprovisioning | Access provisioning | Active Directory401k match | Career advancement opportunities | Dental insurance | Learning and development | Life coachingMid-level Full TimeLos Angeles, CA, United States16h ago
-
Senior AI Security Engineer USD 160K-175KAnchore | Application Security | CI/CD | Cause analysis | CheckovSenior-level Full TimeRemote, OR, United States R16h ago
-
Application Security Engineer USD 165K-275KAWS | Authentication | Authorization | CI/CD | Code AnalysisHybrid work arrangementEntry-level Full TimeWeave - Headquarters (Lehi, UT)16h ago
-
Infrastructure Security Engineer (USA) USD 103K-185KAWS | Ansible | Chef | Cloud platform | Container SecurityFlexible paid time off | Home office support | Parental leave | Team member resource groupsMid-level Full TimeRemote, US R17h ago
-
Software Engineer 1 USD 144K-220KAgile | Ansible | Apache NiFi | Apache Pig | IAVADental insurance | Employee referral bonus | Health savings account | Identity theft protection | Legal protectionMid-level Full TimeLinthicum Heights, Maryland17h ago
-
APIs | AWS | Air Gapped Architecture | Air-gapped | AzureSenior-level Full TimeRemote, United States R17h ago
-
DevSecOps Engineer USD 144K-184KAgile | Alerting | Automated testing | CI/CD | Compliance401k | Continuing education assistance | Dental insurance | Eleven Federal Holidays | Employee assistance programSenior-level Full TimeAlexandria, VA18h ago
-
Mid-level Full TimeSan Jose, California, United States18h ago
-
Security Engineer USD 125K-145KAWS CDK | AWS CloudFormation | AWS CloudTrail | AWS ECS | AWS IAM401k match | Charitable donation matching | Flexible paid time off | Home office setup stipend | Medical, dental & vision coverageMid-level Full TimeRemote - US R18h ago
-
Staff Escalation Engineer USD 129K-185KAWS | Ansible | Authentication Protocols | Azure | BashComprehensive health plans | Education reimbursement | Hybrid work model | In-office perks | Parental leave optionsSenior-level Full TimeSan Jose, California, USA19h ago