Data Platform Engineer (Member of Technical Staff)
Tasks
- Architect data lake indexing storage and query strategies
- Build ETL workflows
- Build enterprise data connectors
- Design data pipelines and indexing strategies
- Enable retrieval-augmented generation
- Extract insights from enterprise data
- Implement batch processing
- Implement semantic search
- Implement streaming systems
- Ingest and normalize enterprise data sources
- Integrate data platform components
- Make build vs buy decisions for data platform tools
- Manage orchestration and deployment workflows
- Run data pipelines
- Taxonomize correlate and deduplicate data
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Flink | Apache Kafka | Data Reliability | Data pipeline | Database Design | Databricks | Distributed Computing | Docker | ETL | Indexing | Information Retrieval | Knowledge graph | Kubernetes | Retrieval-Augmented Generation | SQL | Search | Semantic Search | Streaming Data | Temporal | Terraform
Education
N/A
Regions
Countries
States
Related jobs
-
Entry-level Full TimeOrlando, FL12h ago
-
DevSecOps Engineer USD 143K-190KAWS | Artifactory | Azure | C++ | CI/CDEmployee ownership | Hybrid work | Onsite 3 days per week | Professional development supportSenior-level Full TimeWarrendale, Pennsylvania, United States14h ago
-
Senior Software Engineer, Application Platform USD 140K-180KAgile | Behavior-Driven Development | Cloud Computing | DevOps | DockerRemote work | US citizenship required for federal contractSenior-level Full TimeRemote in the US R16h ago
-
Security Engineer USD 128K-214K800-53 | ACAS | Ansible | Authorization and Accreditation | CNSSI 1253Senior-level Full TimeUSA-VA-Springfield21h ago
-
DevSecOps Lead USD 155K-190KAWS | Access Management | Application Security | Bash | CI/CDConference participation | Flexible working setup | International and English speaking workplace | Opportunities for growth learning and professional development | Training budgetSenior-level Full TimeTampa, United States R23h ago
-
System Engineer 1 (TS/SCI with Poly) USD 160K-198KAttribute Based Access Control ABAC | Attribute-Based Access Control | Attribute-based access | Confluence | Entitlements management401k | Dental insurance | Employee discount program | Flexible spending account | Flexible work scheduleMid-level Full TimeFORT MEADE, MD, US1d ago
-
Database Administrator USD 94K-209KASM | Ansible | Autonomous Database | Chef | Data CompressionFlexible medical benefits | Life insurance | Retirement options | Volunteer programsMid-level Full TimeUnited States1d ago
-
ATO | AWS GovCloud | Azure Government | Batch Processing | CI/CDActive secret clearance | Federal compliance documentationSenior-level Full TimeSilver Spring, MD, US1d ago
-
API Testing | Agile | Amazon Web Services | CI/CD | ConfluenceOnsite work | Remote Days Per WeekMid-level Full TimeAnnapolis Junction, MD R1d ago
-
Sr Principal Software Engineer (L7 Cloud Security) USD 170K-277KAmazon Web Services | BigQuery | Bigtable | C# | Cloud SecuritySenior-level Full TimeSanta Clara, CA1d ago
-
Cloud DevSecOps Engineer USD 133K-166KAKS | AWS | Ansible | Azure | Azure DevOps401k company match | Employee assistance program | Employee volunteer program | Flexible spending account | Health savings accountMid-level Full TimeHoover, AL - Riverchase Operations Center …1d ago
-
Staff Infrastructure Engineer (IAM and Cloud Services) USD 124K-271KAWS | Amazon EKS | Ansible | Ansible Playbooks | Argo CDHybrid work environment | Remote work optionSenior-level Full TimeSan Jose (CA), United States1d ago
-
Embedded Software Engineer II (Onsite) USD 68K-131KC# | C++ | Crypto Algorithms | Docker | Encryption401k match | Adoption Assistance | Child and elder care services | Disability insurance | Employee assistance programMid-level Full TimeUS-NC-MORRISVILLE-907 ~ 951 Aviation Pkwy ~ …1d ago
-
DevSecOps Development Lead (Puerto Rico) USD 107K-204KAWS | Access Management | Ansible | Artifactory | Authentication401k match | Counseling sessions | Dental insurance | Disability coverage | Employee assistance programSenior-level Full TimeUS-PR-SANTA ISABEL-B1 ~ Felicia Industrial Park …1d ago
-
Cyber Software Engineer USD 101K-151KAgile | Atlassian Jira | Bash | Batch | C#Relocation assistance | Travel 10 percentEntry-level Full TimeVACH06, United States1d ago
-
Senior Site Reliability Engineer USD 125K-145KAWS | Azure | Bash | CI/CD | Chaos EngineeringDental insurance | Education assistance | Employee assistance program | Employee referral bonus | Family support benefitsSenior-level Full TimeLehi, Utah1d ago
-
System Engineer 2 (TS/SCI with Poly) USD 160K-198KAWS | AWS Cloud | AWS Cloud Development Kit | AWS cloud development | Alerting401k | Employee discount program | Employee referral rewards | Flexible spending account | Flexible work scheduleMid-level Full TimeFORT MEADE, MD, US1d ago
-
System Engineer 2 (TS/SCI with Poly) USD 160K-198KAWS | Access Control | Authentication | Authorization | Container SecurityDental insurance | Employee discount program | Employee referral rewards | Flexible work schedule | Health insuranceMid-level Full TimeFORT MEADE, MD, US1d ago
-
Senior IAM Engineer - ForgeRock USD 125K-162KCI/CD | Docker | ForgeRock AM | ForgeRock IDM | ForgeRock Identity401k company match | Education reimbursement | Flexible work schedule | Health plan options | Paid Childbearing and Paternal LeaveSenior-level Full TimeRemote - United States R1d ago
-
Senior-level Full TimeCosta Mesa, California, United States; Washington, …1d ago
-
Senior Cloud Software Engineer USD 135K-184KAPI Design | AWS | Artifact governance | Automated alerting | AzureSenior-level Full TimeDayton, OH1d ago
-
Staff DevOps Engineer USD 133K-190KAIOps | AWS | Alertmanager | Ansible | CI/CDEducation reimbursement | Health plans | Hybrid work | Parental leave | Retirement optionsSenior-level Full TimeSan Jose, California, USA1d ago
-
Amazon S3 | Amazon SQS | Apache NiFi | Data Ingestion | Data PipelinesHybrid work model | Onsite one to two days per week | Remote workSenior-level Full TimeHerndon, VA R1d ago
-
Amazon S3 | Amazon SQS | Apache Kafka | Apache NiFi | Data IngestionHybrid work | Onsite work 1 to 2 days per week | Remote work | US Citizen | US Secret ClearanceSenior-level Full TimeHerndon, VA R1d ago
-
Software Engineer I USD 137K-205KAPI Design | AWS | Agile | Analytics | Azure401k matching | Employee discounts | Medical/Dental/Vision | Paid time off | Wellness programMid-level Full TimeUnited States, San Diego, CA1d ago