Data Engineer II
Tasks
- Build data pipelines
- Collaborate in agile teams
- Deploy test and monitor pipelines
- Design enterprise data products
- Implement data quality checks
- Ingest batch streaming and API data
- Maintain ETL and ELT workflows
- Manage data lineage and governance
- Optimize data processing jobs and SQL queries
- Prepare and validate datasets for machine learning
- Support data infrastructure for analytics
- Transform structured and unstructured data
- Troubleshoot pipeline data issues
Perks/Benefits
- N/A
Skills/Tech-stack
Amazon Web Services | Apache Airflow | Apache Flink | Apache Hadoop | Apache Kafka | Apache NiFi | Apache Spark | Azure | CI/CD | Cloud platform | Data Governance | Data Lineage | Data Modeling | Data Quality | Data Warehousing | Databricks | ELT | ETL | Feature Engineering | Google Cloud | Google Cloud Platform | Java | Machine Learning | Python | SQL | Scala | Web Services
Education
Roles
Related jobs
-
CSRS Presales and Solutions Head INR 2000K-6000KAWS | Access Management | Cloud Security | Cloud Security Posture | Cloud Security Posture ManagementExecutive-level Full TimeIndia5h ago
-
Security Track Specialist INR 1000K-2500KAccess Control | Active Directory | Azure Active Directory | Azure Key Vault | CIS BenchmarksSenior-level Full TimeIndia6h ago
-
DC Engineer Specialist INR 1300K-2500KAzure CLI | Azure DNS | Azure Firewall | Azure Virtual | Azure Virtual NetworkSenior-level Full TimeIndia6h ago
-
Java Full Stack Engineer - Associate INR 1600K-3000KDAST | Dependency Scanning | Dependency management | GitHub Copilot | JavaSenior-level Full TimeIndia6h ago
-
Deputy Manager - Fraud Analytics & Monitoring (Detection) INR 950K-1500KAnomaly Detection | DPSC | Data Visualization | Decisioning | Early WarningAnnual health checkup | Dental benefits | Gender neutral policy | Group term life insurance | Learning and development programMid-level Full TimeGurugram, India8h ago
-
Sr. Software Development Engineer INR 3000K-4000KAWS | Azure | C# | GCP | HTTPEducation reimbursement | Health plans | Hybrid work model | In-office perks | Parental leave optionsSenior-level Full TimeBangalore, IND; Bangalore, IND11h ago
-
SO_Cloud Infra Operations Specialist INR 2125K-3500KAWS | Access Management | Ansible | Azure | Azure ADSenior-level Full Timecoimbatore, India11h ago
-
Access Control | Atlantis | Atlassian tools | Audit governance | Automation ScriptingMid-level Full TimeBangalore, Karnataka, India12h ago
-
Software Engineer - .NET - Career INR 1200K-2156K.NET | Agile | Angular | Azure DevOps | C#Guided career tracks | Healthcare benefits | Hybrid work setting | Online learning platform | Organizational growthMid-level Full TimeIND-Trivandrum-Equifax Analytics-PEC, India16h ago
-
IN_Senior Associate _ Microsoft Purview Data Governance Engineer_GCC_Advisory_Bangalore INR 1500K-2300KAzure CLI | Azure SQL | Azure SQL Database | Data Catalog | Data ClassificationMid-level Full TimeBengaluru Millenia, India16h ago
-
IAM Engineer INR 2755K-3487KABAC | Access Certifications | Access Management | Azure AD | BeanshellCounseling sessions | Discount vouchers | Family care leave | OPD Coverage | Paid leaveSenior-level Full TimeBengaluru, India16h ago
-
IN-Associate_AI ML_Digital Integration_Advisory_Bangalore INR 2000K-2800KAI coding | AI coding tools | Advanced Security | CodeQL | Coding ToolsFlexible work hours | Inclusive benefits | MentorshipMid-level Full TimeBengaluru Millenia, India16h ago
-
Backend Engineer III (Hybrid) INR 2755K-3500KCEL | Cloud Native | Data Mapping | Data Transformation | Distributed SystemsPaid adoption leave | Paid parental leave | Professional development opportunities | Volunteer opportunities | Wellness programsSenior-level Full TimePune, India R16h ago
-
Entry-level Full TimePune, India16h ago
-
Mid-level Full TimeNavi Mumbai, India (Finicity)16h ago
-
Lead Software engineer (Java Full stack Developer) INR 1500K-3000KAgile Framework | Angular | CI/CD | Cassandra | Cloud FoundrySenior-level Full TimePune, India16h ago
-
Senior Product Security Engineer INR 1567K-4590KAI Agents | API Security | AWS | Application Security | AuthenticationCareer development | Employee incentives | Headspace access | Headspace app | Hybrid work modelSenior-level Full TimeIndia, Bengaluru, Karnataka R16h ago
-
Sr. Security Analyst INR 1500K-4600KApplication Security | Authentication | Authorization | Automation | Bug BountyHybrid workSenior-level Full TimeHyderabad - Phoenix Equinox Tower 2, …16h ago
-
Assoc Engineer Software-9 INR 320K-360KCode review | Debugging | Development methodologies | Java | JavaScriptFlexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balanceEntry-level Full TimeKA Bangalore, India16h ago
-
Senior-level Full TimeNavi Mumbai, India (Finicity)16h ago
-
Mid-level Full TimePune, India16h ago
-
Senior Analyst, Data Strategy INR 2520K-4000KAWS | Artificial Intelligence | Azure | CI/CD | Cloud ComputingSenior-level Full TimeGurgaon, India16h ago
-
IN_Senior Associate _ Microsoft Purview Data Governance Engineer_GCC_Advisory_Bangalore INR 1500K-2300KAzure CLI | Azure SQL | Azure SQL Database | Cloud Security | Compliance reportingFlexibility programmes | Inclusive benefits | MentorshipMid-level Full TimeBengaluru Millenia, India16h ago
-
AWS | Ansible | Azure | Certificates | ChefFlexible workplace arrangements | Internal mobility | Learning and development programs | MentoringSenior-level Full TimeBengaluru - EC-2 Gateway campus, India16h ago
-
Amazon Web Services | Ansible | Application Firewall | Azure | CertificatesFlexible workplace arrangements | Internal mobility | Learning and development programs | MentoringSenior-level Full TimeBengaluru - EC-2 Gateway campus, India16h ago