Senior Data Engineer
Tasks
- Architect scalable data processing frameworks
- Build orchestration workflows for data integration
- Conduct proof of concepts for new technologies
- Create architecture proposals and technical plans
- Design develop deliver big data solutions
- Implement distributed data pipelines
- Maintain operational excellence meet SLA requirements
- Manage production incidents and root cause analysis
- Mentor team members and drive best practices
- Perform performance benchmarking and optimization
- Research evaluate emerging big data technologies
Perks/Benefits
Skills/Tech-stack
Apache Airflow | Apache Hadoop | Apache Iceberg | Apache NiFi | Apache Ozone | Apache Spark | Cloudera | Data Storage | Data orchestration | Data pipeline | Distributed Systems | HDFS | Java | Performance optimization | Proof of Concept | Python | Scala
Education
Bachelor of Engineering | Bachelor of Science | Bachelor of Science in Computer Science | Bachelor of Science in Information Technology
Roles
Related jobs
-
Staff Software Engineer, Google One Security Development INR 2800K-3900KAlgorithms | Application Programming | Application Programming Interfaces | C++ | Cross-functionalSenior-level Full TimeBengaluru, Karnataka, India4h ago
-
Sr IT Security Analyst(Cloud Security Sr Engineer) INR 3000K-3500KAWS Security | AWS Security Hub | Amazon Web Services | Audit Evidence Collection | Audit evidenceSenior-level Full TimeHyderabad, India9h ago
-
Staff Software Development Engineer INR 2800K-4200KAPI Development | AWS | Azure | CI/CD | Cause analysisEducation reimbursement | Health plans | In-office perks | Parental leave options | Retirement optionsSenior-level Full TimeBangalore, IND9h ago
-
Escalation Engineer - ZTB INR 3000K-4000KAutomation | BGP | Enterprise Network | Firewall | MTREducation reimbursement | Health plans | In-office perks | Parental leave | Retirement optionsSenior-level Full TimeBangalore, IND; Mohali, IND10h ago
-
Senior Staff Security Engineer L7 INR 2211K-3500KAWS Security | Access Management | Algorithms | C# | C++Senior-level Full TimeGurugram, India10h ago
-
Senior Data Engineer - Privacy INR 2800K-4000KAWS | Apache Airflow | Apache Spark | CCPA | Data ModelingCommuter benefits | Financial wellness support | Hybrid work flexibility | Mental health support | Retirement planSenior-level Full TimeBengaluru, India11h ago
-
Access Management | Alerting | Amazon EKS | Apache Kafka | AuthenticationSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India15h ago
-
Alerting | Apache Spark | Azure Data | Azure Data Factory | Azure DevOpsBest in class amenities and workspaces | Health and medical insurance | Learning and development | Rewards and recognition | Well-being programsEntry-level Full TimeIND-KA-Bengaluru, Bagmane Solarium City, India15h ago
-
Executive-level Full TimeBCIT Bengaluru Office (MGS), India15h ago
-
AWS | Agile | Android | Angular | Application ProgrammingSenior-level Full TimePune, India15h ago
-
Platform Engineer II INR 500K-1500KAWS Certified | AWS Certified Database | AWS Certified Database - Specialty | Access Control | AgileMid-level Full TimePune, India15h ago
-
Senior Backend Engineer - Platform and API INR 2200K-5000KAWS | Azure | Distributed Systems | GCP | GRPCEducation support | Generous time-off policies | Lifestyle support | Wellness supportSenior-level Full TimeBangalore, India20h ago
-
Principal Software Engineer INR 3000K-5000KAlerting | Algorithms | Automated testing | Azure Resource | Azure Resource ManagerSenior-level Full TimeIndia - Remote R21h ago
-
Alert deduplication | Anomaly Detection | Change Management | Dashboard Development | Data EngineeringMid-level Full TimeBangalore, Karnataka, India1d ago
-
Splunk Engineer (Remote) INR 800K-1680KAPI Integrations | Common Information Model | Data Lifecycle Management | Data lifecycle | Detection engineeringRemote workMid-level Full TimeMaharashtra, Pune, India R1d ago
-
Cloud Engineer INR 2000K-3500KAWS CloudFormation | AWS IAM | AWS VPC | Amazon Web Services | BashCareer growth | Financial benefits | Flexible benefits | Health and wellbeing benefits | Support for family wellbeingSenior-level Full TimeBengaluru, KA, India1d ago
-
Junior QA Engineer (Playwright & JavaScript /Java) INR 480K-540KAutomation Testing | Java | JavaScript | Playwright | SDLCEntry-level Full TimePune, India1d ago
-
Senior DevSecOps Engineer (OCI) INR 3000K-4000KAnsible | Azure DevOps | CI/CD | Cloud infrastructure | DASTSenior-level Full TimeChennai, India1d ago
-
Senior Technical Specialist-Performance Test Engineer INR 1632K-2800KAWS | Azure | Cloud platform | Docker | Google CloudSenior-level Full TimeIndia1d ago
-
Developer - Software Tester INR 480K-600KAgile | Behavior-Driven Development | CI/CD | DevOps | GitHubTravel up to 25%Mid-level Full TimeBangalore, Karnataka, India1d ago
-
Product Security Engineer INR 1100K-1600KAPI Security | AWS | Access Management | Application Security | AuthenticationCareer development | Community building | Learning opportunities | Work from anywhereMid-level Full TimeIndia R1d ago
-
Detection Engineer (Remote) INR 1228K-1680KAlert prioritization | Atomic Red Team | CrowdStrike Falcon | Defender for Endpoint | EDRRemote workMid-level Full TimeMaharashtra, Pune, India R1d ago
-
Test Analyst (SDET) - API Automation INR 720K-1200KAPI Testing | Automation Testing | Automation frameworks | Java | JavaScriptMid-level Full TimeIndia1d ago
-
Cyber IAM Managed Service - Saviynt Assistant Manager AR INR 2000K-3300KAccess Certification | Access Governance | Access Management | Access Review | Active DirectoryOnsite Pune or Bangalore office work | Rotational shifts possibleSenior-level Full TimePune, Maharashtra, India1d ago
-
Cyber IAM Managed Service - Saviynt Manager AR INR 2000K-3487KABAC | Access Certification | Access Governance | Access Review | Audit managementSenior-level Full TimePune, Maharashtra, India1d ago