Lead Data Engineer
Hyderabad, Telangana, India
INR 1500K-4000K (estimate) Senior-level Full Time
Tasks
- Build reusable ingestion transformation validation publishing frameworks
- Conduct code reviews
- Define standards for schema evolution partitioning compaction metadata management
- Deliver complex data engineering projects
- Design batch and near real time pipelines
- Drive design to production deployment
- Drive observability and monitoring
- Implement and optimize Apache Iceberg
- Implement data quality frameworks
- Lead data engineering initiatives
- Mentor engineers and establish best practices
- Modernize legacy data workloads
- Review architecture and design proposals
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS IAM | AWS Lake Formation | AWS S3 | AWS Step Functions | Amazon Athena | Apache Airflow | Apache Iceberg | Apache Spark | DBT | Data Quality | Data Validation | Lake Formation | Lakehouse | Observability | Partitioning | PySpark | Python | SQL | Schema evolution | Step Functions
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Infrastructure & DevOps Engineer (Technical Marketing) INR 1000K-1910KAWS | Active Directory | Amazon CloudWatch | Amazon EC2 | Amazon IAMMid-level Full TimeBengaluru, Karnataka, India4h ago
-
Product Security Engineer INR 800K-1400KAWS | Amazon Bedrock | Application Security Testing | Artifactory | CI/CDFlexible work options | Remote work option | Training and developmentMid-level Full TimeHyderabad, Telangana, India6h ago
-
Threat Detection Engineer - 2 INR 1392K-2000KAWS | AWS Lambda | Chronicle | Detection engineering | GCPFlexible work | Health insurance | Home office setup | Laptop ownership | Learning and development budgetSenior-level Full TimeIndia, Hyderabad17h ago
-
Senior-level Full TimeChennai, TN, India20h ago
-
IAM Lead INR 1500K-2500KAWS IAM | Access Control | Access Governance | Access Management | Access RecertificationCab facility | Flexible working hours | Free medical insurance | Maternity leave | Meal facilitySenior-level Full TimeGurgaon (SEZ1)21h ago
-
Staff Security Engineer INR 2475K-3465KAWS | Access Management | Adversary Emulation | Application Security | AutomationSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Lead Security Engineer - Python, Cloud INR 2500K-4500KAPI Development | AWS | AWS CloudFormation | Agile methodology | Application ResiliencySenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior Security Engineer (Intake - Hyderabad, India) INR 1567K-3500KAWS | Bash | CI/CD | CIS Benchmarks | Cloud SecuritySenior-level Full TimeHyderabad, India1d ago
-
Senior Software Engineer INR 3000K-5000KAlgorithms | Authentication | Authorization | C# | C++Equity | Flexible hours | Health insurance | Paid time off | Work from home expenseSenior-level Full TimeRemote - India R1d ago
-
Java React Bash GCP IAM Engineering Lead/Senior Associate Director, Software Engineering INR 1000K-1800KAgile | Angular | Ansible | Bash | BigQueryContinuous professional development | Flexible workingMid-level Full TimePune, Maharashtra, India R1d ago
-
Lead Software Engineer INR 1500K-3500KAgile | Amazon Web Services | Ant | Apache Cassandra | Apache KafkaSenior-level Full TimePune, India1d ago
-
Application Support Engineer INR 1000K-1700K.NET | AWS CloudFormation | AWS Lambda | Amazon EC2 | Amazon RDSMid-level Full TimeHyderabad, HC3, India1d ago
-
Mid-level Full TimeBengaluru, BDC7C, India1d ago
-
Developer - AI Engineering - Backend INR 1500K-4600KAWS | Amazon Web Services | CI/CD | Databricks | DockerEmployee assistance program | Equity | Fertility support | Flexible annual leave | Life insuranceSenior-level Full TimeOffice - IND - Karnataka, Bengaluru, …1d ago
-
Senior Developer 2 - Python INR 2829K-5076KAWS | Databricks | Docker | Git | GoEquity | Fertility support | Flexible annual leave | Life insurance | Paid HolidaysSenior-level Full TimeOffice - IND - Karnataka, Bengaluru, …1d ago
-
IN_Senior Associate_AI ML_Digital Integration_Advisory_Gurgaon INR 2000K-2800KAI | Advanced Security | Application Security Testing | CodeQL | Composition analysisSenior-level Full TimeGurugram 10 C, India1d ago
-
Software Technologist I(Python , Linux, AWS) INR 1500K-2500KAmazon Web Services | Ansible | CI/CD | Git | GitHub ActionsMid-level Full TimeBangalore–Embassy Business Hub, India1d ago
-
Senior-level Full TimeNoida,Uttar Pradesh,India1d ago
-
SaaS Security Posture Mgmt Engineer INR 1800K-2750KAPI Integration | Access Management | Amazon Web Services | Automation workflows | BashSenior-level Full TimeNoida,Uttar Pradesh,India1d ago
-
Security Engineer III - AIML INR 3000K-5000KAI Security | Access Management | Authentication | CloudFormation | Data poisoningSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior-level Full TimeChennai, India2d ago
-
Senior-level Full TimePune, India2d ago
-
Gen AI Full-Stack Engineer INR 1800K-3000KAI Search | ARM | App Service | Asynchronous programming | AutogenHealth benefits | Hybrid remote work | Professional development | Work-life balanceMid-level Full TimeBengaluru, Karnataka2d ago
-
Assistant Vice President - Application Security Testing INR 2400K-3300K.NET | Burp Suite | Code Analysis | Code review | CsharpAnnual health checkup | Dental benefits | Gender neutral policy | Group term life insurance | Learning and development programExecutive-level Full TimeGurugram, India2d ago
-
AI | Bash | CI/CD | Data Loss Prevention | Data lossCollaborative work environment | Learning opportunities | Remote-friendly work environmentMid-level Full TimeIndia2d ago