Manager - Data Engineering
Tasks
- Collaborate with Data Architects analytics and IT stakeholders
- Define data engineering best practices
- Design AI and ML ready data architecture
- Design ETL ELT data ingestion pipelines
- Implement data governance privacy and security compliance
- Implement version control and CI/CD
- Integrate data from enterprise systems
- Lead data lake migration and modernization
- Maintain data lake architecture
- Monitor cloud resource usage and optimize costs
- Oversee data quality validation rules and monitoring
- Provide technical guidance and mentorship
- Supervise Data Engineers
- Support data strategy and platform roadmap
Perks/Benefits
Skills/Tech-stack
AWS Glue | AWS S3 | Amazon EMR | Amazon Redshift | Apache Kafka | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Synapse | Azure Synapse Analytics | CI/CD | Cloud Cost Optimization | Cloud Dataproc | Cost Optimization | Data Factory | Data Governance | Data Lake Storage | Data Modeling | Data Privacy | Data Quality | Data Security | Data Validation | Data quality monitoring | Databricks | Dimensional Modeling | ELT | ETL | Event Hubs | Google BigQuery | Google Cloud | Google Cloud Dataproc | Google Dataflow | Hadoop | Kafka | Metadata Management | Power BI | PySpark | Python | Quality monitoring | REST APIs | Relational Data | Relational Data Modeling | SQL | Snowflake Schema | Star Schema | Stream Analytics | Synapse Analytics
Education
Related jobs
-
Senior Manager, Quality Assurance INR 1500K-2500KAI Testing | API Testing | AWS | Agile | Apache SparkSenior-level Full TimePune, India19h ago
-
Senior Product Owner INR 3700K-4600KAWS | Access Management | Agile | Automation | CI/CDCareer growth | Collaborative work environment | In-office Flexibility | Mentorship cultureSenior-level Full TimeHyderabad, Telangana3d ago
-
Auditor – Risk Management, AVP INR 3300K-4000KAccess | Audit planning | Audit standards | Control Testing | Credit RiskAccident insurance | Certification sponsorship | Childcare assistance reimbursement | Employee assistance program | Flexible leave policyExecutive-level Full TimeMumbai Nirlon Knowledge Pk B1, India3d ago
-
Senior Engineering Manager, DevOps & SRE – CIAM Platform INR 3000K-4500KAWS | Automation | CI/CD | Cloud Security | Incident ManagementSenior-level Full TimeIND-Bangalore-A, RMZ Infinity, India3d ago
-
Staff Software Architect INR 2475K-4500KAgile | Algorithms | Amazon S3 | Angular | Architecture governanceCareer growth opportunities | Family support benefits | Flexible benefits | Health and wellbeing benefits | Inclusive work environmentSenior-level Contract Full TimeBengaluru, KA, India4d ago
-
Senior-level Full TimeHyderabad, Telangana, India4d ago
-
AI Operations | APIs | AWS | Artificial Intelligence | AzureAnnual health checkups | Car lease program | Continuous professional development | Employee stock purchase plan | Inclusive company cultureSenior-level Full TimeBangalore, India; Hyderbad, India5d ago
-
Fraud Risk & Compliance Manager INR 950K-1250KAI | Cause analysis | Data Analysis | Fraud Detection | Machine LearningMid-level Full TimeNoida, Uttar Pradesh5d ago
-
Senior Manager, Engineering INR 3000K-4500KAgile Development | Amazon Web Services | Application Security | As-a-Service | AutomationSenior-level Full TimeBengaluru, Karnataka, India5d ago
-
Engineering Manager INR 3264K-5876KAPI Design | AWS | AWS Glue | Agile | Batch ProcessingEnhanced medical benefits | Family wellbeing benefits | Hybrid work | Paid time off | Wellness programsSenior-level Full TimeHyderabad, India5d ago
-
Manager, Software Engineering - Data & AI Platforms INR 2200K-3550KAutomated testing | CI/CD | Data Governance | Data Modeling | Distributed SystemsMid-level Full TimePune, India5d ago
-
Assistant Manager- Capital Administration INR 600K-980KAllvue | CapAssure | Carried Interest | Closed End Fund | Consolidated Fund StructureCareer progression | Employee training resources | Learning and developmentMid-level Full TimeHyderabad, IN5d ago
-
Senior Manager, SW Engineering (Prisma AIRS) INR 2475K-3500KAgile | Architecture | CI/CD | Cloud Computing | Code reviewSenior-level Full TimeBengaluru, Karnataka5d ago
-
Cyber Security Assessment and Testing Operations Manager/Senior Associate Director, GCIO Ops Manager INR 650K-1000KBudgeting | Change Management | Clarity | Commercial negotiation | Contract ManagementContinuous professional development | Flexible working | Inclusive and diverse environment | Opportunities for career growthMid-level Full TimePune, Maharashtra, India R6d ago
-
Associate Manager, Kroll Settlement Administration INR 650K-980KClaims Processing | Data Analysis | Effort Estimation | Microsoft Excel | Microsoft OutlookMid-level Full TimeMumbai, India6d ago
-
Manager - MFT KGS CH INR 850K-1700KAI Security | Adversarial Machine Learning | Application Security | Bash | Cloud penetration testingMid-level Full TimeBangalore, Karnataka, India6d ago
-
Cyber Assessment_AI Red Team - Manager - MFT KGS CH INR 850K-1700KAI red teaming | Adversarial Attacks | Adversarial Machine Learning | Application Security | BashMid-level Full TimeBangalore, Karnataka, India6d ago
-
Java React Bash GCP IAM Engineering Lead/Senior Associate Director, Software Engineering INR 1300K-2200KAgile | Angular | Ansible | Bash | BigQueryContinuous professional development | Flexible workingMid-level Full TimePune, Maharashtra, India R6d ago
-
Sr. Principal Software Engineer INR 2800K-4200KAgile | Angular | Architecture | Cloud | Data pipelineSenior-level Full TimePune, India6d ago
-
Director, Software Engineering INR 1500K-6000KApache Kafka | Authorization | C++ | CI/CD | ClearingExecutive-level Full TimePune, India6d ago
-
Assistant Manager -Workplace & Infrastructure Architect INR 2500K-3500KAccess Management | Active Directory | Autopilot | Azure | Azure virtualizationSenior-level Full TimeBangalore, Karnataka, India7d ago
-
Technical Program Manager, Geo Intel and Escalations INR 1500K-2140KComputer Security | Cross-Functional Collaboration | Cross-functional | Cyber incident | Cyber incident responseMid-level Full TimeBengaluru, Karnataka, India7d ago
-
Senior Manager- Application Security INR 2000K-4600KAI Development | AWS | Application Security | Architecture Review | AzureEmployee assistance program | Equity | Fertility support | Flexible annual leave | Life insuranceSenior-level Full TimeOffice - IND - Karnataka, Bengaluru, …7d ago
-
Manager, Software Engineering INR 1500K-3000KAPIs | Angular | Automation | Business Intelligence | CDMid-level Full TimePune, India7d ago
-
Software Engineering Manager INR 1800K-2345KAWS | ArgoCD | CI/CD | Cloud platform | Event DrivenHealthcare benefits | Hybrid work | Online learning platform | Paid time offMid-level Full TimeIND-Trivandrum-Equifax Analytics-PEC, India7d ago