Sr. Data Engineer (Big Data & Analytics Engineering)
Tasks
- Build and maintain ETL/ELT pipelines
- Contribute to CI CD for data workflows
- Design governed data models
- Develop data processing jobs
- Implement data quality checks and monitoring
- Optimize pipeline performance and cost
- Participate in on call operational rotations
- Publish analysis ready and ML ready datasets
- Support data governance, privacy, and security
- Troubleshoot production issues and drive root cause fixes
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Airflow | Apache Hudi | Apache Iceberg | Apache Kafka | Apache NiFi | Azure | Azure Data | Azure Data Factory | Broadcast Join | Bucketing | CI/CD | Change Data Capture | Cloud platform | Data Capture | Data Factory | Data Modeling | Data Quality | Delta Lake | Git | Google Cloud | Google Cloud Platform | HDFS | Hadoop | Hive | Impala | ORC | Oozie | Parquet | Partitioning | Pentaho | PySpark | Python | SCD Type 1 | SCD Type-2 | SQL | Shuffle Optimization | Spark | Talend | Type 1 | Type 2) | YARN
Education
N/A
Roles
Related jobs
-
Identity Security DevOps Engineer INR 1000K-1700KAPI Development | Access Management | Audit Logs | Bash | BeyondTrust PasswordSafeMid-level Full TimeIndia10h ago
-
Senior-level Full TimeThane, Maharashtra, India12h ago
-
Ansible | Automation | Bitbucket | CI/CD | Cause analysisSenior-level Full TimeHyderabad, Telangana, India13h ago
-
Senior-level Full TimePune, Maharashtra, India14h ago
-
Cybersecurity Engineer(Autosar + Cyber +SW dev) INR 2156K-4590KASPICE | AUTOSAR | Android | Cybersecurity | Embedded CCreche facility | Employee assistance program | Fitness club access | Food and beverage cards | Higher education opportunitiesSenior-level Full TimeIND - India Tech Center19h ago
-
Senior Engineer, Software Engineering INR 2520K-3380KAWS | AWS Athena | AWS EC2 | AWS EMR | AWS GlueContinuous learning | Family-friendly perks | Flexible time off | Health care coverage | Retirement planningSenior-level Full TimeIN - AHMEDABAD, India19h ago
-
Associate Engineer, Software Engineering (React, OOPS) INR 980K-1050K.NET | ASP.NET MVC | Agile | Behavior-Driven Development | C#Continuing education program | Continuous learning access | Family-friendly perks | Flexible time off | Health care coverageMid-level Full TimeIN - HYDERABAD SKYVIEW, India19h ago
-
AI Software Engineer INR 1753K-2600KAWS | Agent/tool use | Apache Spark | Azure | ContainersContinuing education program | Continuous learning | Family-friendly perks | Financial wellness programs | Flexible time offEntry-level Full TimeIN - HYDERABAD ORION, India19h ago
-
Technical Specialist-App Engg Services INR 1650K-3000KAWS | Agile | Artificial Intelligence | CAD | CybersecuritySenior-level Full TimeINDIA - MUMBAI - BIRLASOFT OFFICE, …19h ago
-
Associate Engineer, Software Engineering (React, OOPS) INR 980K-1050K.NET | ASP.NET MVC | Agile | Behavior-Driven Development | C#Continuous learning | Family-friendly benefits | Flexible time off | Health insurance | Referral incentivesMid-level Full TimeIN - HYDERABAD SKYVIEW, India19h ago
-
Senior Engineer, Software Engineering INR 2520K-3380KAWS | AWS Glue | AWS Lambda | AWS Step Functions | Amazon AthenaContinuing education support | Continuous learning resources | Family-friendly perks | Financial wellness programs | Flexible time offSenior-level Full TimeIN - AHMEDABAD, India19h ago
-
AI Software Engineer INR 1753K-2600KAWS | Agentic AI | Azure | CI/CD | Code reviewContinuing education program | Continuous learning | Family-friendly perks | Financial wellness programs | Flexible time offEntry-level Full TimeIN - HYDERABAD ORION, India19h ago
-
Penetration Tester INR 2829K-3220KACL | API Security | API Top 10 | Access Control | Active DirectorySenior-level Full TimeIndia - Hyderabad19h ago
-
Sr. Principal Security Engineer INR 2092K-4500KAI Security | API Security | API discovery | Adversarial Testing | Artifact validationSenior-level Full TimeBengaluru, Karnātaka, India19h ago
-
Senior Staff Software Engineer Product Security INR 3000K-4500KAccess Management | Aquasec | Architecture | Bash | CI/CDCareer development | Employee resource groups | Flexible work from home | Paid time off | Paid volunteer timeSenior-level Full TimeIndia-Bangalore-Remote R19h ago
-
Senior Developer 2 INR 2156K-4600KAWS | Apache Athena | Azure | Bash | DatabricksEmployee assistance program | Equity for employees | Fertility support | Flexible annual leave | Life insuranceSenior-level Full TimeOffice - IND - Karnataka, Bengaluru, …19h ago
-
Staff Software Engineer INR 2542K-4000KALB | AWS | AWS Config | Amazon MQ | ArgoCDRelocation assistanceSenior-level Full TimeBengaluru, India19h ago
-
Software Engineer INR 1400K-2500KAWS Config | Amazon ECR | Amazon EKS | Amazon MQ | Amazon S3Relocation assistanceMid-level Full TimeBengaluru, India19h ago
-
Python Gen AI developer - Director- Cyber Security Engineering INR 2000K-6000KAPI Integration | Agile | Amazon EKS | BMC Remedy | C#Executive-level Full TimeRMZ Ecoworld - Campus 6A, India19h ago
-
Sr. Data Engineer (Big Data & Analytics Engineering) INR 3000K-3880KAccess Controls | Apache Airflow | Apache Hudi | Apache Iceberg | Apache NiFiOn-call rotations | Operational rotationsSenior-level Full TimePune, India19h ago
-
Analyst, Big Data Analytics & Engineering INR 2516K-3356KBusiness Intelligence | Dashboarding | Data Engineering | Data Visualization | Data analyticsSenior-level Full TimeGurgaon, India19h ago
-
Lead, Big Data Analytics & Engineering INR 3000K-4000KAWS | Apache Airflow | Apache NiFi | Azure | Azure DataSenior-level Full TimePune, India19h ago
-
IAM Identity Engineer INR 1971K-3285KAccess Control | Access Management | Automation | Azure | Azure DevOpsFlexible working | Hybrid working | Work-life balanceSenior-level Full TimeHyderabad Knowledge Park Tower 2, India19h ago
-
Senior Platform Engineer INR 2500K-3500KAWS | Ansible | Architectural Diagrams | Atlassian Confluence | Automation orchestrationOn site three days per weekSenior-level Full TimePune, India19h ago
-
Mid-level Full TimeIndore, INDC1A, India19h ago