DataOps Engineer
Tasks
- Apply CI CD for data pipelines
- Automate data pipeline deployments backfills and rollbacks
- Build data models tables and views
- Build infrastructure and orchestration for data workflows
- Design batch data pipelines
- Develop streaming data pipelines
- Enforce data quality validation and schema management
- Implement ETL and ELT processes
- Implement infrastructure as code and access management
- Implement observability and alerting
- Maintain metadata, lineage, and documentation
- Manage production reliability with incident response
- Monitor pipeline health data freshness and SLAs
- Optimize pipeline performance scalability and cost efficiency
Perks/Benefits
Skills/Tech-stack
AWS | Alerting | Apache Airflow | Apache Flink | Apache Kafka | Apache Spark | Apache Spark Streaming | Azure | Azure DevOps | Azure Event | Azure Event Hubs | Azure Resource | Azure Resource Manager | CI/CD | Cloud Data | Cloud Data Warehouses | Cloud platform | CloudFormation | Dagster | Data Compliance | Data Governance | Data Lakes | Data Lineage | Data Modeling | Data Quality | Data Security | Data Warehouses | Data Warehousing | Databricks Workflows | ELT | ETL | Event Hubs | GitHub Actions | GitLab CI | Google Cloud | Google Cloud Platform | Infrastructure as Code | Logging | Metadata | Monitoring | Observability | Prefect | Python | Resource manager | Schema management | Spark Streaming | Terraform | Workflow Orchestration | “as-code”
Education
N/A
Roles
Related jobs
-
Sr. Engineer - Cloud Posture Detection (Hybrid, ISR) ILS 380K-473KAWS | Agile | Bitbucket | CI/CD | CISEmployee networks | Flexible work schedule | Paid adoption leave | Paid parental leave | Professional developmentSenior-level Full TimeTel Aviv (Sky Tower), Israel R4d ago
-
Airflow | Amazon Web Services | CI/CD | Data Integrity | Database BackupAnnual performance bonus | Annual salary review | Birthday leave | HitechZone membership | Hybrid work modelMid-level Full TimeOr Yehuda, Israel R5d ago
-
Sr. Data Engineer - Cloud Security (Hybrid, ISR) ILS 380K-473KAWS | Apache Iceberg | Apache Spark | Cassandra | DockerCompetitive vacation and holidays | Employee networks | Paid adoption leave | Paid parental leave | Professional development opportunitiesSenior-level Full TimeTel Aviv (Sky Tower), Israel R12d ago
-
C# | Debugging | Embedded Systems | GPIO | JiraHybrid work setup | Lab work support | MentorshipMid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R14d ago
-
Mid-level Full TimeIsrael R14d ago
-
Mid-level Full TimeIsrael R18d ago
-
Active Directory | Amazon Web Services | Bash | CI/CD | CloudHome office flexibility | Hybrid work modelMid-level Full TimeIsrael R22d ago
-
Senior Software Engineer - Data & AI Security ILS 341K-443KAWS | Azure | GCP | Go | KafkaFully remote from UK | Mentorship | Technical leadershipSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, Israel R1mo ago
-
Sr Software Development Engineer ILS 341K-443KAPI Integration | AWS | Agile | Alerting | Amazon S3Continual learning | Flexible work arrangements | Team cultureSenior-level Full TimeHybrid Tel Aviv, Israel R1mo ago
-
Bash | Cloud Platforms | EDR | Endpoint Security | FirewallEmployee networks | Office amenities | Parental leave | Professional development | Recognition programsMid-level Full TimeISR Remote, Israel R1mo ago