Lead, Big Data Analytics & Engineering
Tasks
- Apply metrics and benchmarking to evaluate solution effectiveness
- Deliver proofs of concept prototypes and pilots
- Design, build, and maintain scalable data pipelines
- Enable advanced analytics using big data frameworks
- Implement CI CD for data engineering workflows
- Integrate structured and semi structured sources for data unification
- Lead ingestion aggregation transformation and processing of large scale data sets
- Mentor data engineers and analysts and set engineering standards
- Partner with product and data science teams to deliver data solutions
- Promote best practices in data modeling and data governance
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Airflow | Apache NiFi | Azure | Azure Data | Azure Data Factory | CI/CD | Data Factory | Data Lakes | Data Mining | Data Modeling | Data Visualization | DevOps | ELT | ETL | Google Cloud | Graph Databases | Hadoop | Impala | Machine Learning | NumPy | Pandas | Pentaho | PySpark | Python | SQL | Talend
Education
N/A
Roles
Big Data Engineer | Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Senior DevOps Administrator INR 1200K-1500KAnsible | Apache | Azure Backup | Azure DevOps | Azure KubernetesBuddy program | Flexibility | Hybrid work | Insurance | Internet reimbursementMid-level Full TimeIN Bangalore, IN Noida, IN Pune, …3h ago
-
Senior-level Full TimeIndia7h ago
-
AES - DE - Generative AI Application Developers INR 2000K-5000KAWS | Application Security | Authentication | Authorization | AzureSenior-level Full TimePune, Maharashtra, India8h ago
-
AES - DE - Generative AI Application Developers INR 2800K-3500KAWS | Application Security Testing | Authentication | Authorization | AzureSenior-level Full TimePune, Maharashtra, India8h ago
-
Test Associate Engineer INR 480K-600KCI/CD | DNS | Git | HTTP | HTTPSAgile learning culture | Hybrid work | Mentored onboarding | Mentorship from experienced engineersMid-level Full TimePune, Maharashtra, India9h ago
-
Performance Test Lead INR 2000K-3500KAWS | Agile | CPU performance | Containerization | Disaster RecoveryWork from OfficeSenior-level Full TimeChennai, TN, India9h ago
-
Software Engineer - Python INR 1200K-1600KAWS | Authentication | Authorization | CI/CD | DockerHealth insurance | Life insurance | Personal accident insuranceMid-level Full TimeBangalore, Karnataka, India (Hybrid) R13h ago
-
DevSecOps Lead INR 2829K-3500KARM Templates | Access Management | Ansible | Azure DevOps | BicepAgile workplace program | Family-centric policies | Formal development opportunities | Health and well-being resourcesSenior-level Full TimeBengaluru - India13h ago
-
Software Engineer III - GBS IND INR 2486K-3500KAgile | Apache Flink | Apache Kafka | Apache Spark | Cloud ComputingSenior-level Full TimeChennai Tamil Nadu, India13h ago
-
Principal Database Administrator INR 2486K-4000KAWS | Agile project management | Azure IaaS | Capacity Planning | CassandraSenior-level Full TimeOff Embassy Golf Links Business Park, …13h ago
-
Dev Ops SRE, AVP INR 1500K-4000KARM | Alerting | Amazon Elastic Kubernetes Service | Application Insights | Azure Application InsightsAccident insurance | Best in class leave policy | Childcare assistance reimbursement | Comprehensive hospitalization insurance | Employee assistance programExecutive-level Full TimeBangalore, Velankani Tech Park, India13h ago
-
Corporate Support Engineer INR 1400K-1820KAWS Workspace | Active Directory | Bash | Defender for Endpoint | Entra IDEntry-level Full TimeBengaluru, Karnataka, India23h ago
-
Mid-level Full TimeBangalore, Karnataka, India1d ago
-
Cloud Security Engineer - Consultant INR 1200K-1500KAWS | Azure | Azure Monitor | CI/CD | CSPMHybrid work | No TravelMid-level Full TimeIN-AP-Hyderabad1d ago
-
Escalation Engineer - AI Security INR 3200K-4500KAI Agents | AI Model Security | AI model | API | AWSEducation reimbursement | Health plans | Hybrid work | Parental leave options | Retirement optionsSenior-level Full TimeBangalore, IND; Mohali, IND1d ago
-
Cloud Engineer INR 1000K-1000KAWS | Access Control | Access Control List | Application Firewall | Application Load BalancerFamily wellbeing benefits | Health insurance | Paid time off | Safety and wellbeing support | Wellbeing benefitsMid-level Full TimeHyderabad, India1d ago
-
Staff Software Engineer, RCPS AI INR 2000K-3800KArtificial Intelligence | Cloud platform | Distributed Computing | Google Cloud | Google Cloud PlatformSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Entry-level Full TimeIndia1d ago
-
Security Engineer III - Dot Net / .Net, AWS INR 500K-2000K.NET | ASP.Net Core | AWS | Asynchronous programming | BackoffSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Software Engineer II INR 950K-1250KApache Kafka | Apache Spark | BFS | Batch Processing | Cloud ComputingMid-level Full TimeHyderabad, TS, IN; Bengaluru, KA, IN1d ago
-
AI Security Engineer INR 1500K-2500KAgent systems | Anomaly Detection | Artificial Intelligence | Behavioral analytics | CCPAMid-level Full TimeIndia1d ago
-
Senior Security Engineer INR 2156K-2695KAutomation | Change Management | DLP | Data Classification | Data ConnectorsSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Technical Support Engineer INR 2156K-2695KAccess Management | Database operations | Governance and Administration | Identity and Access Management | Identity and accessSenior-level Full TimeBengaluru1d ago
-
Senior-level Full TimeHyderabad1d ago
-
ESaaS - SFDC - QA Automation & DevSecOps INR 1588K-2829KApex | Azure DevOps | CI/CD | Checkmarx | Code AnalysisSenior-level Full TimePune, Maharashtra, India1d ago