Data Platform Engineer (Member of Technical Staff)
Tasks
- Architect data lake indexing storage and query strategies
- Build ETL workflows
- Build enterprise data connectors
- Design data pipelines and indexing strategies
- Enable retrieval-augmented generation
- Extract insights from enterprise data
- Implement batch processing
- Implement semantic search
- Implement streaming systems
- Ingest and normalize enterprise data sources
- Integrate data platform components
- Make build vs buy decisions for data platform tools
- Manage orchestration and deployment workflows
- Run data pipelines
- Taxonomize correlate and deduplicate data
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Flink | Apache Kafka | Data Reliability | Data pipeline | Database Design | Databricks | Distributed Computing | Docker | ETL | Indexing | Information Retrieval | Knowledge graph | Kubernetes | Retrieval-Augmented Generation | SQL | Search | Semantic Search | Streaming Data | Temporal | Terraform
Education
N/A
Regions
Countries
States
Related jobs
-
Senior-level Full TimeWork from home, VA, United States R2h ago
-
Senior Cloud Security Engineer USD 119K-160KARM Templates | AWS CloudFormation | Active Directory | Automation | AzureOnsite 5 days per weekSenior-level Full TimeCarrollton, United States4h ago
-
Staff Forward Deployed Engineer USD 148K-215KAmazon Web Services | Architecture | Cloud Computing | Cloud platform | Data PipelinesSenior-level Full TimeKansas City, MO SOC17h ago
-
Senior Software Engineer, Security Engineering USD 150K-200KAWS | Applied cryptography | Authentication | Authorization | C++Senior-level Full TimeHouston, TX or San Francisco Bay …18h ago
-
Consulting Cyber Systems Engineer USD 183K-274KACAS | ATTACK TREE | Ansible | Anti-tamper | Atlassian SuiteRelocation assistance | TravelSenior-level Full TimeFLME228, United States19h ago
-
Senior Staff Cyber Systems Engineer USD 166K-249KACAS | ATTACK TREE | Ansible | Anti-tamper | AtlassianCompany-Paid Holidays | Disability insurance | Health insurance | Life insurance | Paid time offSenior-level Full TimeFLME228, United States19h ago
-
Principal Software Engineer / Tech Lead USD 131K-237KAgile | Ansible | Automated testing | Bitbucket | CI/CDSenior-level Full Time2652 Arlington VA, United States19h ago
-
Web Developer Security Engineer USD 105K-135K800-53 | Application Firewall | Application Security | C# | CI/CDComprehensive health coverage | Federal holidays off | Flexible PTO | Professional development support | Tuition reimbursementMid-level Full TimeWashington, D.C. Metro22h ago
-
Security Engineer IC-03 USD 40K-268KAWS | Application Security | Artificial Intelligence | Cloud platform | Containerization401k plan | Company bonus | Equity | Full remote work permitted | Medical, dental, and vision benefitsMid-level Full TimeSouth San Francisco, CA and US-Remote R22h ago
-
Security Engineer IC-02 USD 40K-238KAWS | Azure | C# | Cloud Security | CloudFormation401k plan | Company bonus | Equity | Medical, dental, vision benefits | Remote workMid-level Full TimeSeattle, WA22h ago
-
DevSecOps Engineer USD 98K-189K800-53 | Ansible | Bash | CI/CD | CIS BenchmarksComprehensive health coverage | Federal holidays off | Flexible PTO | Professional development support | Tuition reimbursementMid-level Full TimeWashington, D.C. Metro22h ago
-
Senior Infrastructure Security Engineer USD 170K-220KAccess Management | Admission control | Architecture Reviews | CI/CD | Cause analysisFlexible time tracking policy | Low bureaucracy culture | Ownership and autonomy | Remote-first workSenior-level Full TimeUnited States R22h ago
-
Senior Security Engineer USD 130K-250KAI | API Security | AWS | Application Security | Cloud Security401k match | Backup child elder and pet care | Employer paid family planning tool access | Flexible work from home Fridays | Generous vacation policySenior-level Full TimeNew York, NY, USA; San Francisco, … R22h ago
-
Senior Security Engineer, Platform Security USD 185K-326KAWS | Access Management | Alert triage | CSPM | Cloud IAMFlexible time off | Medical insurance | Modern family planning | Remote work | Retirement savings plansSenior-level Full TimeBay Area, CA, United States of …1d ago
-
Sr. DevSecOps Engineer II (6546) USD 170K-193K800-53 | AWS | Alerting | Ansible | Azure401k match | Dependent care | Employee Assistance and Wellness Programs | Flexible work arrangements | Health, dental, and vision insuranceMid-level Full TimeWashington, DC1d ago
-
Sr. DevSecOps Engineer II (6546) USD 170K-193K800-53 | AWS | Ansible | Azure | Azure DevOps401k match | Company paid training and certifications | Dependent care | Employee Assistance and Wellness Programs | Flexible work arrangementsMid-level Full TimeWashington, DC1d ago
-
Partner 34, Lead, Security Engineering USD 295K-347KAI Security | AWS | Agent governance | Application Security | Cloud Security401k | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeSan Francisco, California, United States1d ago
-
Cloud Security Engineer USD 121K-230KAWS | AWS Resource Control Policies | AWS Service Control Policies | Ansible | Azure401k | Dental insurance | Medical insurance | Paid time off | Short Term Incentive ProgramSenior-level Full TimeAtlanta, GA, United States1d ago
-
AWS | Amazon Elastic Kubernetes Service | CI/CD | Elastic Kubernetes Service | Event DrivenAgile team collaboration | Hybrid work locationSenior-level Contract Full TimeTulsa, OK, United States R1d ago
-
Systems Engineer SME (TS/SCI with Poly Required) USD 164K-274KAPI Gateway | AWS | AWS CDK | AWS CloudFormation | AWS CodeBuildTS SCI polygraph clearance | US citizenshipMid-level Full TimeMcLean, Virginia, United States1d ago
-
API Gateway | AWS | AWS Lambda | Alertmanager | Amazon EC2TS SCI with Polygraph clearance | US citizenship requiredSenior-level Full TimeMcLean, Virginia, United States1d ago
-
Mid-level Full TimeFort Meade, Maryland1d ago
-
Mid-level Full TimeFort Meade, Maryland1d ago
-
Mid-level Full TimeFrisco, TX, United States1d ago
-
Principal DevSecOps Engineer USD 160K-200KAnsible | Bitbucket | Buildroot | CI/CD | CMakeCareer growth opportunities | Employee assistance program | Employer-matched 401k | Low cost medical dental vision options | Paid HolidaysSenior-level Full TimePalmdale, CA; Fort Worth, TX1d ago