Sr. Data Engineer (Big Data & Analytics Engineering)
Tasks
- Build and maintain ETL/ELT pipelines
- Contribute to CI CD for data workflows
- Design governed data models
- Develop data processing jobs
- Implement data quality checks and monitoring
- Optimize pipeline performance and cost
- Participate in on call operational rotations
- Publish analysis ready and ML ready datasets
- Support data governance, privacy, and security
- Troubleshoot production issues and drive root cause fixes
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Airflow | Apache Hudi | Apache Iceberg | Apache Kafka | Apache NiFi | Azure | Azure Data | Azure Data Factory | Broadcast Join | Bucketing | CI/CD | Change Data Capture | Cloud platform | Data Capture | Data Factory | Data Modeling | Data Quality | Delta Lake | Git | Google Cloud | Google Cloud Platform | HDFS | Hadoop | Hive | Impala | ORC | Oozie | Parquet | Partitioning | Pentaho | PySpark | Python | SCD Type 1 | SCD Type-2 | SQL | Shuffle Optimization | Spark | Talend | Type 1 | Type 2) | YARN
Education
N/A
Roles
Related jobs
-
Senior Application Security Engineer INR 2000K-3500KAI Security | API Security | API Top 10 | AWS | Adversarial Machine LearningSenior-level Full TimePune, MAHĀRĀSHTRA, India7h ago
-
Mid-level Full TimePune, IN12h ago
-
Cloud Security Architect INR 2200K-3500KAccess Security | Amazon Web Services | Architecture Review | Azure | Best practicesCompany sponsored transportation | Flexible work environment | Generous paid time off | World-class benefitsSenior-level Full TimeHyderabad Atria, India12h ago
-
IN_Senior Associate_SRE DevOps_GCC_Advisory_Bangalore INR 2000K-2700KAWS CloudWatch | AWS IAM | Amazon Elastic Kubernetes Service | Amazon Web Services | AnsibleFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India12h ago
-
IN_Senior Associate_SRE DevOps_GCC_Advisory_Bangalore INR 2000K-2700KAKS | AKS VMSS | AWS CloudWatch | Amazon Web Services | AnsibleSenior-level Full TimeBengaluru Millenia, India12h ago
-
IN_Senior Associate_SRE DevOps_GCC_Advisory_Bangalore INR 2000K-3200KAWS Config | AWS Control Tower | AWS Landing Zone | AWS Organizations | Access ManagementSenior-level Full TimeBengaluru Millenia, India12h ago
-
IN_Senior Associate_SRE DevOps_GCC_Advisory_Bangalore INR 2000K-3200KAWS | AWS Config | AWS Control Tower | AWS Landing Zone | AWS OrganizationsSenior-level Full TimeBengaluru Millenia, India12h ago
-
Senior-level Full TimeIndia - Hyderabad12h ago
-
Senior Application Security Engineer INR 2000K-3500KAI Security | API Security | API Top 10 | Adversarial Machine Learning | Application Security TestingSenior-level Full TimePune, MAHĀRĀSHTRA, India13h ago
-
Cloud Security Architect INR 2200K-3500KAWS Security | Access Security | Amazon Web Services | Architecture Review | AzureCompany sponsored transportation | Exponential career growth | Flexible work environment | Generous paid time off | Rapid growth opportunitiesSenior-level Full TimeHyderabad Atria, India14h ago
-
Associate Principal Engineer - Java INR 1670K-2345KAWS | Ant | Azure | CI/CD | Continuous integrationSecurity and privacy trainingMid-level Full TimeBengaluru22h ago
-
IT Cyber-Security Engineer INR 1200K-1680KApplication Security | Change Management | Cloud Security | DevSecOps | Identity ManagementMid-level Full TimeCoimbatore, India22h ago
-
Entry-level Full TimePune, India23h ago
-
QA Engineer - Endpoint INR 1500K-2300KAPI Testing | Apache JMeter | Application Testing | Bug tracking | CI/CDSenior-level Full TimeBengaluru1d ago
-
Senior Security Engineer INR 3000K-4000KAWS | AngularJS | Apache Spark | CI/CD | Container SecurityCharitable donation match | Flexible time off | Learning & development stipend | Medical insurance | Mental wellbeing supportSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
CSRS Presales and Solutions Head INR 2000K-6000KAWS | Access Management | Cloud Security | Cloud Security Posture | Cloud Security Posture ManagementExecutive-level Full TimeIndia1d ago
-
Security Track Specialist INR 1000K-2500KAccess Control | Active Directory | Azure Active Directory | Azure Key Vault | CIS BenchmarksSenior-level Full TimeIndia1d ago
-
DC Engineer Specialist INR 1300K-2500KAzure CLI | Azure DNS | Azure Firewall | Azure Virtual | Azure Virtual NetworkSenior-level Full TimeIndia1d ago
-
AKS | API Integration | Cloud infrastructure | EKS | FirewallCommunity engagement opportunities | MacBook Pro | Modern engineering tools | Stock options | Training opportunitiesEntry-level Full TimeIndia1d ago
-
Senior-level Full TimeHyderabad, Telangana, India1d ago
-
Product Security Engineer INR 3384K-4600KAI machine learning | AWS | Architecture Review | Cloud Security | DevSecOpsHealth benefits | Paid time off | Parental leave | Retirement savingsSenior-level Full TimeIndia R1d ago
-
Associate Principal/Principal Engineer - Java INR 1670K-2345KAI Development | AI development tools | AWS | Amazon Q | AntMid-level Full TimeBengaluru1d ago
-
Associate Principal Software Engineer - Java INR 2200K-2525KAWS | Ant | Azure | CI/CD | Continuous integrationMid-level Full TimeBengaluru1d ago
-
AI Assisted Development | AWS | Automation | Azure | Cloud SecurityFlexible remote friendly work culture | Flexible working arrangements | Hybrid work options | Inclusive collaborative environment | Learning and development supportSenior-level Full TimeIndia1d ago
-
Mid-level Full TimeHybrid - Bangalore, India R1d ago