Manager - Data Engineering
Tasks
- Collaborate with Data Architects Analytics teams and IT stakeholders
- Define and implement data engineering best practices with version control and CI CD
- Design and implement data ingestion and transformation pipelines
- Ensure data governance, privacy, and security compliance
- Implement ETL ELT workflows across enterprise systems
- Lead data lake migration and modernization initiatives
- Monitor cloud resource usage and support cost optimization
- Oversee data quality frameworks validation rules and monitoring
- Own data lake architecture setup and maintenance
- Supervise Data Engineers and provide technical guidance
- Support AI and ML ready data architecture and roadmap
Perks/Benefits
- N/A
Skills/Tech-stack
AWS EMR | AWS Glue | AWS S3 | Amazon Bedrock | Amazon Redshift | Apache Hadoop | Apache Spark | Automation | Azure Data | Azure Data Factory | Azure Data Lake | Azure OpenAI | Azure Synapse | Azure Synapse Analytics | CI/CD | Cloud Cost Optimization | Cloud Dataproc | Cost Optimization | Data Engineering | Data Factory | Data Governance | Data Lake | Data Privacy | Data Quality | Data Security | Data Validation | Databricks | Dimensional Modeling | ELT | ETL | Event Hubs | Google BigQuery | Google Cloud | Google Cloud Dataproc | Google Dataflow | Google Vertex | Google Vertex AI | Kafka | Metadata Management | Monitoring | Performance Tuning | Power BI | PySpark | Python | REST APIs | Relational modeling | SAP | SQL | Salesforce | Snowflake Schema | Star Schema | Stream Analytics | Synapse Analytics | Version control | Vertex AI
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Assistant Vice President - Application Security Testing INR 2400K-3300K.NET | Burp Suite | Code Analysis | Code review | CsharpAnnual health checkup | Dental benefits | Gender neutral policy | Group term life insurance | Learning and development programExecutive-level Full TimeGurugram, India13h ago
-
PEC Leader - Software Engineering INR 1753K-3000KCloud Native | Cloud Security | Data Governance | Google Cloud | PIIGuided career tracks | Healthcare package | Hybrid work setting | Online learning platform | Organizational growth potentialSenior-level Full TimeIND-Trivandrum-Equifax Analytics-PEC, India1d ago
-
Supervisor, SRE TechOps CICD (Remote, IND) INR 1200K-1680KAnsible | Bash | Bazel | Bitbucket | CI/CDAdoption leave | Competitive vacation and holidays | Employee networks | Paid parental leave | Paid professional developmentMid-level Full TimeIND MH Remote, India R1d ago
-
Data Analysis | Data trend analysis | Database Management | Python | Risk MetricsMid-level Full TimeKarnataka, India1d ago
-
Manager, SW Engineering INR 3500K-4500KAWS Serverless | Agile | Amazon Web Services | Code Reviews | Continuous integrationFlexible work schedule | In person collaboration cultureSenior-level Full TimeBengaluru, Karnataka1d ago
-
Senior Manager, GenAI Governance & Security INR 3000K-5000KAI Act | Arize | Cybersecurity | Data Privacy | EU AISenior-level Full TimeGurugram, Haryana, India2d ago
-
Mid-level Full TimeBangalore, Karnataka,, India2d ago
-
Manager, Engineering INR 700K-968KAWS | Agile | Azure | Batch Processing | Data NormalizationEmployee assistance program | Equity | Fertility support | Flexible annual leave | Life insuranceMid-level Full TimeOffice - IND - Karnataka, Bengaluru, …2d ago
-
Senior Manager-Risk Management INR 1890K-2700KChargeback | Data Analysis | Fraud risk | Hive | Project ManagementSenior-level Full TimeGurugram, HR, India4d ago
-
Snowflake Data Platform Administrator INR 180K-200KData Warehousing | ETL | SQL | SnowflakeHybrid workMid-level Full TimeIndia Hyderabad (Nexity)4d ago
-
Engineering Manager INR 1340K-1820KAWS | Apache Flink | Apache Kafka | Automation | AzureCompetitive vacation and holidays | Comprehensive wellness programs | Employee networks | Great Place to Work certified | Paid adoption leaveMid-level Full TimePune, India4d ago
-
Privileged Access Management Engineering - Senior Manager INR 2000K-3500KAPI | AWS | Access Management | Account Management | Active DirectoryEducational support | Employee networks | Flexible work programs | Hybrid work model | Insurance plansSenior-level Full TimeBangalore, India4d ago
-
Engineering Director Credit Cards INR 2000K-6000KAPI Gateway | Agile | Amazon Web Services | Android | Automated testingExecutive-level Full TimePune, Gera Commerzone SEZ, India4d ago
-
DSPM Engineer - Manager INR 2000K-3500KAPI Integration | AWS | Access Management | Automation | BigIDSenior-level Full TimeIndia5d ago
-
Assistant Manager - DevSecOps INR 800K-1500KAI | Application Architecture | By Design | C++ | CertificatesMid-level Full TimePune, Maharashtra, India5d ago
-
TC - CS - Data Protection and Privacy - Manager - PKI INR 3000K-4000KAD CS | AWS | AppViewX | Azure | BashSenior-level Full TimeTrivandrum, KL, IN, 6955815d ago
-
Senior Manager, Threat Detection & Response INR 1060K-2250KArtificial Intelligence | Automation | Cause analysis | Cybersecurity | Data EnrichmentSenior-level Full TimeIN004 Bangalore, India5d ago
-
Manager Security INR 704K-1200KAWS Security | Application Security | Azure Security | Cause analysis | Cloud SecurityEmployee wellness programs | Flexible work arrangements | Health insurance | Learning and development | Paid time offMid-level Full TimeGurugram, Haryana6d ago
-
Lead - Cybersecurity Risk & Compliance INR 2775K-3500KAI Deployment | AI Governance | AI RMF | AI Security | AWSSenior-level Full TimeChennai, TN, India6d ago
-
Manager, Data Engineering INR 1000K-2000KData Architecture | Data Engineering | Data Governance | Data Pipelines | Data QualityMid-level Full TimePune, India6d ago
-
TC - CS - CDR - SOC - Manager INR 650K-1000KCarbon Black | Cloud Security | CrowdStrike | Cyber Security | EDRClient SLA tracking | Late evening/night shift support | Rotational shift | Weekend availabilityMid-level Full TimeTrivandrum, KL, IN, 6955816d ago
-
Site Reliability Engineering Front Line Manager INR 1800K-2500KAWS | Ansible | Availability Engineering | Bash | ChefGuided career tracks | Healthcare packages | Hybrid work setting | Online learning platform | Organizational growth potentialMid-level Full TimeIND-Pune-Equifax Analytics-PEC, India6d ago
-
Cyber & Technology Risk Oversight, Enterprise Technology Risk Management,Assistant Vice President, INR 3000K-3300KApplication Security | Cloud Security | Control Assessment | Cybersecurity | Data SecurityEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysExecutive-level Full TimeHyderabad, India6d ago
-
Executive-level Full TimeBCIT Bengaluru Office (MGS), India6d ago
-
Asst Manager Data Governance & Privacy INR 700K-1600KArchitecture | BigID | CRM | Cloud Storage | DPDPAMid-level Full TimeMaharashtra, India6d ago