Data Platform Engineer (Member of Technical Staff)
Tasks
- Architect data lake indexing storage and query strategies
- Build ETL workflows
- Build enterprise data connectors
- Design data pipelines and indexing strategies
- Enable retrieval-augmented generation
- Extract insights from enterprise data
- Implement batch processing
- Implement semantic search
- Implement streaming systems
- Ingest and normalize enterprise data sources
- Integrate data platform components
- Make build vs buy decisions for data platform tools
- Manage orchestration and deployment workflows
- Run data pipelines
- Taxonomize correlate and deduplicate data
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Flink | Apache Kafka | Data Reliability | Data pipeline | Database Design | Databricks | Distributed Computing | Docker | ETL | Indexing | Information Retrieval | Knowledge graph | Kubernetes | Retrieval-Augmented Generation | SQL | Search | Semantic Search | Streaming Data | Temporal | Terraform
Education
N/A
Regions
Countries
States
Related jobs
-
Staff Security Engineer - Product Security USD 230K-275KAI Risk Management Framework | Access Control | CI/CD | CI/CD hardening | Cloud SecurityHybrid work | Medical, dental, and vision insurance | Paid time offSenior-level Full TimeSouth San Francisco, California, USA9h ago
-
Senior Privacy Software Engineer USD 216K-269KAPI Development | CCPA | Data Auditing | Data Governance | Data PipelinesEquity compensation | Health benefitsSenior-level Full TimeSan Mateo, CA, United States R10h ago
-
Entry-level Full TimeOrlando, FL12h ago
-
DevSecOps Engineer USD 143K-190KAWS | Artifactory | Azure | C++ | CI/CDEmployee ownership | Hybrid work | Onsite 3 days per week | Professional development supportSenior-level Full TimeWarrendale, Pennsylvania, United States15h ago
-
Network Security Engineer USD 220K-260KAWS | Access Controls | Ansible | Cloud Native | Cloud native firewallsMid-level Full TimeRemote, California, United States; Sunnyvale CA … R16h ago
-
Principal AI Security Engineer USD 190K-260KAWS | Anomaly Detection | Audit Logging | CI/CD | Configuration as CodeSenior-level Full TimeRemote, California, United States; Sunnyvale CA … R16h ago
-
Senior Software Engineer, Application Platform USD 140K-180KAgile | Behavior-Driven Development | Cloud Computing | DevOps | DockerRemote work | US citizenship required for federal contractSenior-level Full TimeRemote in the US R16h ago
-
Sr Product Security Engineer USD 135K-202KAPI Security | API Security Top Ten | AWS | Application Security | AuthenticationSenior-level Full TimeRemote United States R21h ago
-
Security Engineer USD 128K-214K800-53 | ACAS | Ansible | Authorization and Accreditation | CNSSI 1253Senior-level Full TimeUSA-VA-Springfield21h ago
-
DevSecOps Lead USD 155K-190KAWS | Access Management | Application Security | Bash | CI/CDConference participation | Flexible working setup | International and English speaking workplace | Opportunities for growth learning and professional development | Training budgetSenior-level Full TimeTampa, United States R1d ago
-
System Engineer 1 (TS/SCI with Poly) USD 160K-198KAttribute Based Access Control ABAC | Attribute-Based Access Control | Attribute-based access | Confluence | Entitlements management401k | Dental insurance | Employee discount program | Flexible spending account | Flexible work scheduleMid-level Full TimeFORT MEADE, MD, US1d ago
-
Database Administrator USD 94K-209KASM | Ansible | Autonomous Database | Chef | Data CompressionFlexible medical benefits | Life insurance | Retirement options | Volunteer programsMid-level Full TimeUnited States1d ago
-
ATO | AWS GovCloud | Azure Government | Batch Processing | CI/CDActive secret clearance | Federal compliance documentationSenior-level Full TimeSilver Spring, MD, US1d ago
-
API Testing | Agile | Amazon Web Services | CI/CD | ConfluenceOnsite work | Remote Days Per WeekMid-level Full TimeAnnapolis Junction, MD R1d ago
-
Sr Principal Software Engineer (L7 Cloud Security) USD 170K-277KAmazon Web Services | BigQuery | Bigtable | C# | Cloud SecuritySenior-level Full TimeSanta Clara, CA1d ago
-
Cloud DevSecOps Engineer USD 133K-166KAKS | AWS | Ansible | Azure | Azure DevOps401k company match | Employee assistance program | Employee volunteer program | Flexible spending account | Health savings accountMid-level Full TimeHoover, AL - Riverchase Operations Center …1d ago
-
Staff Infrastructure Engineer (IAM and Cloud Services) USD 124K-271KAWS | Amazon EKS | Ansible | Ansible Playbooks | Argo CDHybrid work environment | Remote work optionSenior-level Full TimeSan Jose (CA), United States1d ago
-
Embedded Software Engineer II (Onsite) USD 68K-131KC# | C++ | Crypto Algorithms | Docker | Encryption401k match | Adoption Assistance | Child and elder care services | Disability insurance | Employee assistance programMid-level Full TimeUS-NC-MORRISVILLE-907 ~ 951 Aviation Pkwy ~ …1d ago
-
DevSecOps Development Lead (Puerto Rico) USD 107K-204KAWS | Access Management | Ansible | Artifactory | Authentication401k match | Counseling sessions | Dental insurance | Disability coverage | Employee assistance programSenior-level Full TimeUS-PR-SANTA ISABEL-B1 ~ Felicia Industrial Park …1d ago
-
Cyber Software Engineer USD 101K-151KAgile | Atlassian Jira | Bash | Batch | C#Relocation assistance | Travel 10 percentEntry-level Full TimeVACH06, United States1d ago
-
Senior Site Reliability Engineer USD 125K-145KAWS | Azure | Bash | CI/CD | Chaos EngineeringDental insurance | Education assistance | Employee assistance program | Employee referral bonus | Family support benefitsSenior-level Full TimeLehi, Utah1d ago
-
System Engineer 2 (TS/SCI with Poly) USD 160K-198KAWS | AWS Cloud | AWS Cloud Development Kit | AWS cloud development | Alerting401k | Employee discount program | Employee referral rewards | Flexible spending account | Flexible work scheduleMid-level Full TimeFORT MEADE, MD, US1d ago
-
System Engineer 2 (TS/SCI with Poly) USD 160K-198KAWS | Access Control | Authentication | Authorization | Container SecurityDental insurance | Employee discount program | Employee referral rewards | Flexible work schedule | Health insuranceMid-level Full TimeFORT MEADE, MD, US1d ago
-
Senior IAM Engineer - ForgeRock USD 125K-162KCI/CD | Docker | ForgeRock AM | ForgeRock IDM | ForgeRock Identity401k company match | Education reimbursement | Flexible work schedule | Health plan options | Paid Childbearing and Paternal LeaveSenior-level Full TimeRemote - United States R1d ago
-
Senior-level Full TimeCosta Mesa, California, United States; Washington, …1d ago