Data Platform Engineer (Member of Technical Staff)
Tasks
- Architect data lake indexing storage and query strategies
- Build ETL workflows
- Build enterprise data connectors
- Design data pipelines and indexing strategies
- Enable retrieval-augmented generation
- Extract insights from enterprise data
- Implement batch processing
- Implement semantic search
- Implement streaming systems
- Ingest and normalize enterprise data sources
- Integrate data platform components
- Make build vs buy decisions for data platform tools
- Manage orchestration and deployment workflows
- Run data pipelines
- Taxonomize correlate and deduplicate data
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Flink | Apache Kafka | Data Reliability | Data pipeline | Database Design | Databricks | Distributed Computing | Docker | ETL | Indexing | Information Retrieval | Knowledge graph | Kubernetes | Retrieval-Augmented Generation | SQL | Search | Semantic Search | Streaming Data | Temporal | Terraform
Education
N/A
Regions
Countries
States
Related jobs
-
AWS | AWS ECS | Ansible | Containerization | DockerEducation reimbursement | In-office perks | Parental leave options | Retirement options | Time off plansSenior-level Full TimeCrystal City, Virginia, USA11h ago
-
Cloud Security Engineer USD 140K-225KAWS CloudTrail | AWS GuardDuty | AWS IAM | AWS KMS | AWS VPCAI Stipend | Equity | Flexible time off | Health insurance | Lunch snacks and beveragesSenior-level Full TimeSan Francisco15h ago
-
Google DevSecOps Sr. Principal USD 164K-218K800-171 | 800-53 | AWS CloudFormation | AWS Lambda | Anchore401k match | Flexible work weeks | Health savings accounts | Health, dental, vision insurance | Hybrid workSenior-level Full TimeUSA VA Falls Church - 3150 …15h ago
-
Senior Security Software Engineer, Application Security USD 269K-326KAPIs | Authentication | CI/CD | Code review | Composition analysisSenior-level Full TimeSan Mateo, CA, United States R16h ago
-
Software Engineer I, Privacy USD 79K-127KAPI Design | API frameworks | Authentication | Azure | CI/CDEmployee resource groups | Fitness programs | Learning and development programs | Medical/Dental/Vision insurance | Mental wellness supportMid-level Full TimeSeattle, Washington, United States R17h ago
-
Cloud Security Engineer USD 150K-225KABAC | API Gateway | AWS | Amazon API | Amazon API GatewayEmployee discounts | Matching 401k | Medical/Dental/Vision | Paid time off | Wellness programSenior-level Full TimeUnited States, San Diego, CA17h ago
-
Cloud Security Engineer USD 158K-238KABAC | API Gateway | AWS | Amazon API | Amazon API GatewayEmployee discounts | Matching 401k | Medical, dental, and vision | Paid time off | Wellness programSenior-level Full TimeUnited States, San Mateo, CA17h ago
-
Staff Product Security Engineer USD 17K-231KAWS | Admission Controller | CNAPP | CSPM | Cloud BuildCoworking stipend | Flexible time off | Health insurance covered | Paid parental leave | Phone and internet stipendSenior-level Full TimeUnited States - Remote R17h ago
-
Senior Application Security Engineer USD 180K-210KAPI Security | AWS | Application Security | Burp Suite | CI/CD401k program | Commuter benefits | Flexible time off | Health plans | Parental leaveSenior-level Full TimeUnited States of America R18h ago
-
Systems Engineer - Principal USD 142K-210KAgentic Workflows | Artificial Intelligence | Data Flow | Guardrails | Language Models401k | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeHanover, MD18h ago
-
Software Engineer USD 131K-227KAWS CDK | AWS IAM | AWS Lambda | Amazon DynamoDB | Amazon EC2401k match | Employer Covered Dental Insurance | Employer Covered Disability Insurance | Employer Covered Vision Insurance | Employer-covered health insuranceSenior-level Full TimeChantilly, VA19h ago
-
800-53 | 81001-5-1 | AWS | Artifact signing | AuthenticationHybrid work environment | Relocation assistanceSenior-level Contract Full TimeBurlington, MA, United States20h ago
-
Platform Engineer USD 131K-172KAWS | AWS IAM | Amazon EKS | Autoscaling | CI/CDHybrid work environment | US citizen eligibilityMid-level Full TimeJersey City, New Jersey, United States; …20h ago
-
Senior Security Support Engineer USD 91K-108KActive Directory | CRM | Cryptography | Internet Security | LDAPHybrid work | On-call rotationSenior-level Full TimeSalt Lake City, Utah, United States20h ago
-
Cloud Infrastructure Engineer II USD 112K-151KALB | AWS | Access Federation | Ansible | Availability ManagementMid-level Full TimeMiami Lakes, FL, United States22h ago
-
Software Engineer II USD 95K-120KAmazon Redshift | Data Warehousing | Data pipeline | ELT | ETLMentorship opportunitiesMid-level Full TimeUnited States1d ago
-
Mid-level Full TimeMiami, Sarasota, Toronto (ON), Washington D.C1d ago
-
Senior Technical Support Engineer USD 120K-150KAWS | Azure | Bash | Biometrics | CIAMCareer development opportunities | Collaborative team culture | Flexible work environment | Remote work optionsSenior-level Full TimeUnited States- Remote R1d ago
-
Mid-Level DevSecOps Engineer - DOD USD 135K-160KAKS | Amazon ECS | Ansible | Audit tools | Azure Kubernetes401k match | Educational/training support | Life insurance | Medical/Dental/Vision insuranceMid-level Full TimeHuntsville, Alabama, United States; Colorado Springs, …1d ago
-
Entry-level Full TimeScottsdale, Arizona, United States1d ago
-
800-53 | API Ecosystem | Alerting | Attack detection | Audit toolingSenior-level Full TimeNew York, NY, USA; Cambridge, MA, …1d ago
-
Activation Patching | Causal Inference | Deep learning | Dictionary Learning | Distributed ComputingSenior-level Full TimeMountain View, CA, USA1d ago
-
Backend Engineer (Member of Technical Staff) USD 100K-300KAPI Design | AWS | Azure | CI/CD | ConcurrencySenior-level Full TimeSan Francisco, CA1d ago
-
Fullstack Engineer (Member of Technical Staff) USD 100K-300KAPI Design | AWS | Agile | Angular | AzureSenior-level Full TimeSan Francisco, CA1d ago
-
Cloud Engineer, TS/SCI with Poly USD 176K-282KAWS | ActiveMQ | Agile | Ansible | Apache HadoopBonus plan | On-call rotation | Paid time off | Subsidized benefitsSenior-level Full TimeLaurel, MD, United States1d ago