Senior Data Engineer - Data & AI Platform
Tasks
- Apply CI CD practices for data systems
- Apply data modeling and schema management best practices
- Build platform services
- Build tooling templates and services for pipelines
- Contribute to design reviews and architecture decisions
- Contribute to platform automation
- Design data pipelines
- Develop reusable ingestion transformation and serving patterns
- Ensure reliability observability data quality and performance
- Implement batch and streaming workflows
- Implement customer data onboarding services
- Implement testing strategies and operational runbooks
- Monitor and troubleshoot production pipelines
- Optimize pipeline performance
- Partner with software engineers AI engineers and data scientists
- Perform root cause analysis
- Support standardized deployment and operational workflows
- Translate requirements into data architectures
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Apache Spark | Batch Processing | CI/CD | Cloud Storage | Data Governance | Data Modeling | Data Quality | Data Security | Data pipeline | Databricks | Distributed Systems | ELT | ETL | Incident Response | Monitoring | Schema evolution | Streaming | System design | Testing | Version control
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Senior-level Full TimePune, IN10h ago
-
Senior SIEM Engineer INR 1500K-3200KAccess Management | ArcSight | Automation | BeyondTrust | CyberArkOn-call support rotation | Professional development opportunities | Team collaborationSenior-level Full TimeNoida,Uttar Pradesh,India11h ago
-
Staff Software Engineer, Google One Security Development INR 2800K-3900KAlgorithms | Application Programming | Application Programming Interfaces | C++ | Cross-functionalSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Sr IT Security Analyst(Cloud Security Sr Engineer) INR 3000K-3500KAWS Security | AWS Security Hub | Amazon Web Services | Audit Evidence Collection | Audit evidenceSenior-level Full TimeHyderabad, India17h ago
-
Staff Software Development Engineer INR 2800K-4200KAPI Development | AWS | Azure | CI/CD | Cause analysisEducation reimbursement | Health plans | In-office perks | Parental leave options | Retirement optionsSenior-level Full TimeBangalore, IND17h ago
-
Senior Data Engineer - Privacy INR 2800K-4000KAWS | Apache Airflow | Apache Spark | CCPA | Data ModelingCommuter benefits | Financial wellness support | Hybrid work flexibility | Mental health support | Retirement planSenior-level Full TimeBengaluru, India18h ago
-
Access Management | Alerting | Amazon EKS | Apache Kafka | AuthenticationSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India22h ago
-
Alerting | Apache Spark | Azure Data | Azure Data Factory | Azure DevOpsBest in class amenities and workspaces | Health and medical insurance | Learning and development | Rewards and recognition | Well-being programsEntry-level Full TimeIND-KA-Bengaluru, Bagmane Solarium City, India22h ago
-
Analyst I Software Engineering INR 606K-833KCoding | Debugging | Documentation | Software development | TestingIn person collaboration flexibility | Inclusive work environment | Productivity support | Wellbeing supportEntry-level Full TimeIN318 - Hyderabad Sattva Knowledge Park …22h ago
-
Senior Application Security Engineer INR 2092K-4000KAPI Security | AWS | Application Security | Artifact validation | AzureCareer Development Programs | Health and wellbeing benefits | Hybrid work schedule | Inclusion and flexibility programsSenior-level Full TimeBengaluru, Karnātaka, India22h ago
-
Security Platform Engineer - OT INR 2156K-2600KAttack analysis | Break fix | CSIRT operations | Cause analysis | Computer forensics24/7 rotational shifts | Mentoring | TrainingSenior-level Full Timehyderabad, India22h ago
-
Lead DevOps Engineer INR 3000K-5000KAccess Management | CI/CD | Checkmarx | Cloud Networking | Cloud StorageHybrid work | In person work two days per week | Virtual workSenior-level Full TimeChennai, India22h ago
-
Lead engineer, GCP Devops engineering INR 2500K-4000KAPI Management | Artifactory | CI/CD | CheckmarxOne | Cloud platformOut-of-Hours support rota | Technical coaching and mentoringSenior-level Full TimeChennai, India22h ago
-
Engineer II - Cloud, Integrations Platform INR 1100K-1680KAWS | Agile Development | Automated testing | Azure | Cloud platformMid-level Full TimeBangalore, India22h ago
-
Senior Backend Engineer - Platform and API INR 2200K-5000KAWS | Azure | Distributed Systems | GCP | GRPCEducation support | Generous time-off policies | Lifestyle support | Wellness supportSenior-level Full TimeBangalore, India1d ago
-
SRE - Security Engineer INR 2500K-3500KAccess Management | Admission Controller | Application Firewall | ArgoCD | CI/CDSenior-level Full TimePune, Maharashtra, India1d ago
-
Principal Software Engineer INR 3000K-5000KAlerting | Algorithms | Automated testing | Azure Resource | Azure Resource ManagerSenior-level Full TimeIndia - Remote R1d ago
-
AI Python Django/Consultant Specialist INR 2800K-4000KAPI | AWS | Adversarial Testing | Angular | AnsibleSenior-level Full TimePune, Maharashtra, India R1d ago
-
Software Engineer - Full Stack INR 2000K-5000KAccessibility | Apollo | D3 | Esbuild | GRPC WebEducation benefits | Generous time off | Lifestyle benefits | Wellness benefitsSenior-level Full TimeBangalore, India1d ago
-
Alert deduplication | Anomaly Detection | Change Management | Dashboard Development | Data EngineeringMid-level Full TimeBangalore, Karnataka, India1d ago
-
Senior DevSecOps Engineer (OCI) INR 3000K-4000KAnsible | Azure DevOps | CI/CD | Cloud infrastructure | DASTSenior-level Full TimeChennai, India1d ago
-
Developer - Software Tester INR 480K-600KAgile | Behavior-Driven Development | CI/CD | DevOps | GitHubTravel up to 25%Mid-level Full TimeBangalore, Karnataka, India1d ago
-
Detection Engineer (SOC Analyst) INR 1200K-1801KAntivirus | C# | Chronicle | Computer networks | CrowdStrike FalconEducation reimbursement | Health plans | In-office perks | Paid time off | Parental leave optionsMid-level Full TimeIndia - Update Location1d ago
-
API Gateway | Access Certification | Access Management | Active Directory | Adaptive AuthenticationAccess to complex high impact technical challenges | Career growth | Collaboration with global enterprise security teams | Exposure to hybrid SaaS architectures | Fully remote within IndiaSenior-level Contract Full TimeIndia R1d ago
-
Senior-level Full TimeBengaluru, KA, India1d ago