Data Platform Engineer (Member of Technical Staff)
Tasks
- Architect data lake indexing storage and query strategies
- Build ETL workflows
- Build enterprise data connectors
- Design data pipelines and indexing strategies
- Enable retrieval-augmented generation
- Extract insights from enterprise data
- Implement batch processing
- Implement semantic search
- Implement streaming systems
- Ingest and normalize enterprise data sources
- Integrate data platform components
- Make build vs buy decisions for data platform tools
- Manage orchestration and deployment workflows
- Run data pipelines
- Taxonomize correlate and deduplicate data
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Flink | Apache Kafka | Data Reliability | Data pipeline | Database Design | Databricks | Distributed Computing | Docker | ETL | Indexing | Information Retrieval | Knowledge graph | Kubernetes | Retrieval-Augmented Generation | SQL | Search | Semantic Search | Streaming Data | Temporal | Terraform
Education
N/A
Regions
Countries
States
Related jobs
-
Senior-level Full TimeWork from home, VA, United States R3h ago
-
Analytic Engineer USD 124K-166KAWS | Anomaly Scoring | Apache Airflow | Apache Spark | Cloud platformSecurity ClearanceSenior-level Full TimeFAIRFAX, VA, United States3h ago
-
Senior Cloud Security Engineer USD 119K-160KARM Templates | AWS CloudFormation | Active Directory | Automation | AzureOnsite 5 days per weekSenior-level Full TimeCarrollton, United States5h ago
-
AI Systems Engineer USD 99K-176K800-171 | AI Governance | AI RMF | Agent Orchestration | Air-gappedMid-level Full TimeAnnapolis Junction, MD6h ago
-
Staff Forward Deployed Engineer USD 148K-215KAmazon Web Services | Architecture | Cloud Computing | Cloud platform | Data PipelinesSenior-level Full TimeKansas City, MO SOC18h ago
-
Senior Software Engineer, Security Engineering USD 150K-200KAWS | Applied cryptography | Authentication | Authorization | C++Senior-level Full TimeHouston, TX or San Francisco Bay …19h ago
-
Consulting Cyber Systems Engineer USD 183K-274KACAS | ATTACK TREE | Ansible | Anti-tamper | Atlassian SuiteRelocation assistance | TravelSenior-level Full TimeFLME228, United States19h ago
-
Senior Staff Cyber Systems Engineer USD 166K-249KACAS | ATTACK TREE | Ansible | Anti-tamper | AtlassianCompany-Paid Holidays | Disability insurance | Health insurance | Life insurance | Paid time offSenior-level Full TimeFLME228, United States19h ago
-
Principal Software Engineer / Tech Lead USD 131K-237KAgile | Ansible | Automated testing | Bitbucket | CI/CDSenior-level Full Time2652 Arlington VA, United States19h ago
-
Staff IT Systems Engineer USD 110K-178KADFS | Active Directory | Admin SDK | Ansible | Automation PipelinesSenior-level Full TimeSanta Clara, CA19h ago
-
Web Developer Security Engineer USD 105K-135K800-53 | Application Firewall | Application Security | C# | CI/CDComprehensive health coverage | Federal holidays off | Flexible PTO | Professional development support | Tuition reimbursementMid-level Full TimeWashington, D.C. Metro22h ago
-
Security Engineer IC-03 USD 40K-268KAWS | Application Security | Artificial Intelligence | Cloud platform | Containerization401k plan | Company bonus | Equity | Full remote work permitted | Medical, dental, and vision benefitsMid-level Full TimeSouth San Francisco, CA and US-Remote R23h ago
-
Security Engineer IC-02 USD 40K-238KAWS | Azure | C# | Cloud Security | CloudFormation401k plan | Company bonus | Equity | Medical, dental, vision benefits | Remote workMid-level Full TimeSeattle, WA23h ago
-
DevSecOps Engineer USD 98K-189K800-53 | Ansible | Bash | CI/CD | CIS BenchmarksComprehensive health coverage | Federal holidays off | Flexible PTO | Professional development support | Tuition reimbursementMid-level Full TimeWashington, D.C. Metro23h ago
-
Senior Infrastructure Security Engineer USD 170K-220KAccess Management | Admission control | Architecture Reviews | CI/CD | Cause analysisFlexible time tracking policy | Low bureaucracy culture | Ownership and autonomy | Remote-first workSenior-level Full TimeUnited States R23h ago
-
Senior Security Engineer USD 130K-250KAI | API Security | AWS | Application Security | Cloud Security401k match | Backup child elder and pet care | Employer paid family planning tool access | Flexible work from home Fridays | Generous vacation policySenior-level Full TimeNew York, NY, USA; San Francisco, … R23h ago
-
Systems Engineer III USD 115K-195KAPI Integration | Access Management | Active Directory | Ansible | BashTS SCI Clearance with PolygraphSenior-level Full TimeFort Meade, MD23h ago
-
Senior Security Engineer, Platform Security USD 185K-326KAWS | Access Management | Alert triage | CSPM | Cloud IAMFlexible time off | Medical insurance | Modern family planning | Remote work | Retirement savings plansSenior-level Full TimeBay Area, CA, United States of …1d ago
-
Sr. DevSecOps Engineer II (6546) USD 170K-193K800-53 | AWS | Alerting | Ansible | Azure401k match | Dependent care | Employee Assistance and Wellness Programs | Flexible work arrangements | Health, dental, and vision insuranceMid-level Full TimeWashington, DC1d ago
-
Sr. DevSecOps Engineer II (6546) USD 170K-193K800-53 | AWS | Ansible | Azure | Azure DevOps401k match | Company paid training and certifications | Dependent care | Employee Assistance and Wellness Programs | Flexible work arrangementsMid-level Full TimeWashington, DC1d ago
-
Partner 34, Lead, Security Engineering USD 295K-347KAI Security | AWS | Agent governance | Application Security | Cloud Security401k | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeSan Francisco, California, United States1d ago
-
Cloud Security Engineer USD 121K-230KAWS | AWS Resource Control Policies | AWS Service Control Policies | Ansible | Azure401k | Dental insurance | Medical insurance | Paid time off | Short Term Incentive ProgramSenior-level Full TimeAtlanta, GA, United States1d ago
-
AWS | Amazon Elastic Kubernetes Service | CI/CD | Elastic Kubernetes Service | Event DrivenAgile team collaboration | Hybrid work locationSenior-level Contract Full TimeTulsa, OK, United States R1d ago
-
Systems Engineer SME (TS/SCI with Poly Required) USD 164K-274KAPI Gateway | AWS | AWS CDK | AWS CloudFormation | AWS CodeBuildTS SCI polygraph clearance | US citizenshipMid-level Full TimeMcLean, Virginia, United States1d ago
-
API Gateway | AWS | AWS Lambda | Alertmanager | Amazon EC2TS SCI with Polygraph clearance | US citizenship requiredSenior-level Full TimeMcLean, Virginia, United States1d ago