Lead, Big Data Analytics & Engineering
Tasks
- Apply metrics and benchmarking to evaluate solution effectiveness
- Deliver proofs of concept prototypes and pilots
- Design, build, and maintain scalable data pipelines
- Enable advanced analytics using big data frameworks
- Implement CI CD for data engineering workflows
- Integrate structured and semi structured sources for data unification
- Lead ingestion aggregation transformation and processing of large scale data sets
- Mentor data engineers and analysts and set engineering standards
- Partner with product and data science teams to deliver data solutions
- Promote best practices in data modeling and data governance
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Airflow | Apache NiFi | Azure | Azure Data | Azure Data Factory | CI/CD | Data Factory | Data Lakes | Data Mining | Data Modeling | Data Visualization | DevOps | ELT | ETL | Google Cloud | Graph Databases | Hadoop | Impala | Machine Learning | NumPy | Pandas | Pentaho | PySpark | Python | SQL | Talend
Education
N/A
Roles
Big Data Engineer | Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Applied R&D Engineer 2 - IVT INR 500K-800KLinux/Unix | Network Protocols | Network Troubleshooting | Networking Hardware | PytestSenior-level Full TimeIndia17h ago
-
AI | CI/CD | DNS | Docker | GitFamily support | Financial benefits | Flexible working | Health benefits | Professional growthEntry-level Full TimeIndia20h ago
-
Software Engineer, Actimize (Python) INR 1340K-1680KAWS | Agile | Automation | DevOps | DockerFlexible work model | Remote work optionsMid-level Full TimeIndia - Pune21h ago
-
Technical Support Engineer — Networks & Infrastructure INR 2500K-3200K802.1x | ARP | Cisco ISE | Docker | KubernetesSenior-level Full TimeBengaluru, KA, India22h ago
-
Data Engineer INR 1500K-2000KAzure | Data Architecture | Data Governance | Data Mapping | Data ModelingSenior-level Full TimePune, Maharashtra, India22h ago
-
Associate Data & GenAI Engineer INR 1500K-3000KAPI Development | CI/CD | Data Pipelines | Databricks | Delta LakeMid-level Full TimeBengaluru, KA, IN1d ago
-
Associate Data & GenAI Engineer INR 1500K-3000KData Pipelines | Data Quality | Delta Lake | ETL | EmbeddingsMid-level Full TimeBengaluru, KA, IN1d ago
-
Application Security Engineer INR 3200K-4225KApplication Security | Dynamic analysis | Java | JavaScript | NISTSenior-level Full TimeMumbai, India1d ago
-
Senior Product Security Engineer (Devanahalli, Bangalore) INR 2500K-4144KAuthorization testing | CI/CD | Checkmarx | Cloud Security | Container SecurityFlexible working | Health benefits | Learning opportunitiesSenior-level Full TimeBangalore, KA, IN, 5621491d ago
-
Security Engineer, Stores Application Security INR 2500K-2800KAdversarial Security Analysis | Adversarial security | Code review | Java | JavaScriptCareer development resources | Flexible work hours | Work-life balanceMid-level Full TimeBengaluru, Karnataka, IND1d ago
-
Manager, Attack Automation Engineer INR 1327K-2047K.NET | Analytical Skills | CI/CD | Communication skills | DNSMid-level Full TimeIND - Telangana - Hyderabad (HITEC …1d ago
-
Active Directory | Ansible | Bash | Certificates | Cloud platformHealthcare benefits | Paid time off | Remote work | Training and developmentSenior-level Full Time110382-IND-HYDERABAD-INTL HYD WF CENTRE BLK 1B …1d ago
-
Lead Information Security Engineer INR 500K-800KActive Directory | Agile | Ansible | Bash | Change ManagementFlexible work hours | Health insurance | Training and development opportunitiesSenior-level Full Time110382-IND-HYDERABAD-INTL HYD WF CENTRE BLK 1B …1d ago
-
Automation Test Engineer INR 2040K-3285KAgile methodologies | Automation Testing | Cassandra | Continuous integration | CucumberFlexible work arrangements | Inclusive organizationSenior-level Full TimeBengaluru, KA, IN1d ago
-
CMS-Senior- Sentinel SOAR INR 2092K-2695KAutomation | Endpoint protection | JSON | Network Monitoring | Playbook DevelopmentSenior-level Full TimeTrivandrum, KL, IN, 6955811d ago
-
Engineer I INR 949K-1437KAVD | Autopilot | Azure | Cloud-based | Cloud-based device managementCareer development | Flexible work environment | Health benefits | Supportive team cultureMid-level Full TimeIND-Hyderabad-Hybrid, India R1d ago
-
Associate Director, Software Engineering (C#, .Net, Angular, React, AWS, LLMs, Azure AI Services) INR 972K-1450K.NET | AI Services | AWS | Angular | Azure AIContinuous learning resources | Family benefits | Flexible time off | Health and wellness benefits | Retirement planMid-level Full TimeIN - HYDERABAD SKYVIEW, India1d ago
-
AWS | CSS | Django | Git | HTMLComprehensive healthcare | Online learning platform | Paid time offSenior-level Full TimeIND-Pune-Equifax Analytics-PTEC, India1d ago
-
Risk Analytics AI Engineer, Associate, Firm Risk Management INR 1100K-1500KAI | GPT-4 | Language Models | Language Processing | Large Language ModelsEmployee benefits | Inclusive environmentMid-level Full TimeCOMMERZ III, OBEROI GARDEN CITY, India1d ago
-
Site Reliability Engineer - Intermediate INR 1327K-1680KAWS | Bash | CD tools | CI/CD | CI/CD ToolsCareer growth opportunities | Healthcare | Hybrid work | Online learning platform | Paid time offMid-level Full TimeIND-Pune-Equifax Analytics-PTEC, India1d ago
-
AWS | Angular | Azure | Bootstrap | CI/CDCareer growth | Healthcare benefits | Hybrid work | Online learning | Paid time offEntry-level Full TimeIND-Pune-Equifax Analytics-PTEC, India1d ago
-
IT Security Engineering Lead INR 2486K-4225KAutomation | CI/CD | Cloud Security | Data Security | DevOpsHealth benefits | Relocation support | Remote workSenior-level Full TimeIN: Pune - Building 5, India1d ago
-
Sr. DevOps Engineer INR 3000K-4500KAutomation | CI/CD | Cloud Computing | Database operations | Distributed SystemsEmployee networks | Great place to work | Parental leave | Professional development | Vacation and holidaysSenior-level Full TimeBangalore, India1d ago
-
Senior developer-1 INR 2156K-5000KAI tools | Algorithms | Azure | Bazel | BitbucketEquity | Fertility support | Flexible leave | Life insurance | Medical insuranceSenior-level Full TimeOffice - IND - Karnataka, Bengaluru, …1d ago
-
Python Security Engineer INR 2500K-4200KAsset Management | Backpressure | Basic authentication | CI matching | CMDBSenior-level Full TimeGera Commerzone SEZ, Pune, India1d ago