Manager - Data Engineering
Tasks
- Collaborate with Data Architects Analytics teams and IT stakeholders
- Define and implement data engineering best practices with version control and CI CD
- Design and implement data ingestion and transformation pipelines
- Ensure data governance, privacy, and security compliance
- Implement ETL ELT workflows across enterprise systems
- Lead data lake migration and modernization initiatives
- Monitor cloud resource usage and support cost optimization
- Oversee data quality frameworks validation rules and monitoring
- Own data lake architecture setup and maintenance
- Supervise Data Engineers and provide technical guidance
- Support AI and ML ready data architecture and roadmap
Perks/Benefits
- N/A
Skills/Tech-stack
AWS EMR | AWS Glue | AWS S3 | Amazon Bedrock | Amazon Redshift | Apache Hadoop | Apache Spark | Automation | Azure Data | Azure Data Factory | Azure Data Lake | Azure OpenAI | Azure Synapse | Azure Synapse Analytics | CI/CD | Cloud Cost Optimization | Cloud Dataproc | Cost Optimization | Data Engineering | Data Factory | Data Governance | Data Lake | Data Privacy | Data Quality | Data Security | Data Validation | Databricks | Dimensional Modeling | ELT | ETL | Event Hubs | Google BigQuery | Google Cloud | Google Cloud Dataproc | Google Dataflow | Google Vertex | Google Vertex AI | Kafka | Metadata Management | Monitoring | Performance Tuning | Power BI | PySpark | Python | REST APIs | Relational modeling | SAP | SQL | Salesforce | Snowflake Schema | Star Schema | Stream Analytics | Synapse Analytics | Version control | Vertex AI
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Cybersecurity Manager - India INR 2500K-4600KAI machine learning | AWS | Access Management | Agile | AutomationSenior-level Full TimeIndia, Pune17h ago
-
TC-CS-IAM-CyberArk-Senior INR 3000K-4000KAWS | Access policies | Ansible | Authentication | AzureFlexible work environment | Health and wellness packages | Learning opportunities | MentorshipSenior-level Full TimeHyderabad, TG, IN, 50008117h ago
-
Sr Lead, Cyber Sec IT RiskM INR 2800K-3500KCompliance | Continuous Control Monitoring | Continuous Monitoring | Continuous control | Control AutomationCollaborative work culture | Community volunteering | Flexible work arrangements | Reasonable accommodationsSenior-level Full TimePune, India17h ago
-
Risk and Control Manager INR 1000K-1700KAPI Gateway | AWS | Apache Airflow | Apache Flink | Apache SparkMid-level Full TimePune, Gera Commerzone SEZ, India17h ago
-
Executive-level Full TimeDelhi, India1d ago
-
Senior Technical Success Manager INR 3000K-4200KCapture analysis | Cisco | DLP | FTP | FiddlerEducation reimbursement | Health plans | Hybrid work | Parental leave options | Retirement optionsSenior-level Full TimeBangalore, IND1d ago
-
Manager, R&D - AI Proactive Defense INR 2475K-4600KAgent-based | Agent-based frameworks | Anomaly Detection | Behavioral Modeling | Continuous ImprovementSenior-level Full TimeOffice - IND - Karnataka, Bengaluru, …1d ago
-
IN_Manager_Java/Python_Risk Analytics - GRC_Advisory_Gurgaon INR 950K-1250KArtificial Intelligence | Auditing | Corporate actions | Data Analysis | Data ModelingFlexible work arrangements | Mentorship | Wellbeing supportMid-level Full TimeGurugram 8 B, India1d ago
-
Executive-level Full TimePune, India1d ago
-
KGS - CyberArk - Assistant Manager INR 1200K-1500KAWS | Access Management | Active Directory | Azure | Certificate managementMid-level Full TimeHyderabad, Telangana, India2d ago
-
Senior Technical Success Manager-AMS INR 3000K-4000KAuthentication Protocols | Cisco routing | DLP | Enterprise networks | FTPEducation reimbursement | Health plans | Hybrid work | In-office perks | Parental leaveSenior-level Full TimeBangalore, IND2d ago
-
VP/Enterprise System Management Manager INR 1500K-5199KDHCP | DNS | Data Loss Prevention | Data loss | DatadogExecutive-level Full TimePune, India2d ago
-
TC-CS-IAM-CyberArk-Manager INR 2092K-3500KAccess Management | Ansible | BeyondTrust | C# | Change ManagementSenior-level Full TimeBengaluru, KA, IN, 5600482d ago
-
Manager, Engineering - Endpoint - Sustaining INR 2156K-5000KAutomation | Cause analysis | Cloud Computing | Debugging | Escalation managementSenior-level Full TimeOffice - IND - Karnataka, Bengaluru, …2d ago
-
Senior Manager, Software Development Engineering INR 3000K-4000KAWS | Asynchronous Messaging | Azure | CI/CD | Cloud platformEducation reimbursement | Health plans | Hybrid work | Paid time off | Parental leaveSenior-level Full TimeBangalore, IND3d ago
-
Senior-level Full TimeIndia3d ago
-
KGS - CyberArk - Assistant Manager INR 1200K-1500KAWS | Access Management | Active Directory | Automation | AzureMid-level Full TimeBangalore, Karnataka, India3d ago
-
Manager Information Security INR 2092K-3285KApplication Security | Automation | Bash | Cybersecurity | Endpoint protectionSenior-level Full TimeIndia - Hyderabad3d ago
-
Software Engineer INR 2800K-4000KAPI Design | AWS | Algorithms | Ansible | AntRemote pairing tools | Virtual collaboration toolsSenior-level Full TimePune, India3d ago
-
Software Engineer INR 2400K-3500KAPIs | AWS | Algorithms | Ansible | AntAgile development | Inclusive culture | Remote pairing tools | Virtual collaboration toolsEntry-level Full TimePune, India3d ago
-
AMQP | Ansible | Bash | CI/CD | DefectDojoMid-level Full TimeIndia - Bengaluru - Doddanekundi Industrial …3d ago
-
Senior Manager – Infosec (Projects) INR 1592K-2100KAccess Control | Access Management | Audit management | Automation | Data Leakage PreventionComprehensive employee benefits | Global career mobilitySenior-level Full TimeCOMMERZ III, OBEROI GARDEN CITY, India3d ago
-
Senior Program Manager INR 2000K-2500KAgile | Agile Framework | Automation | Continuous Improvement | Defect metricsSenior-level Full TimePune, India3d ago
-
Senior-level Full TimeHyderabad, Telangana, India7d ago
-
Technical Specialist-App Engg Services INR 1650K-3000KAWS | Agile | Artificial Intelligence | CAD | CybersecuritySenior-level Full TimeINDIA - MUMBAI - BIRLASOFT OFFICE, …7d ago