Principal Engineer – Data Platform
Tasks
- Align data architecture with business goals
- Architect data platform strategy
- Articulate design tradeoffs and constraints
- Build data ingestion frameworks
- Define data modeling and schema evolution standards
- Design open table formats
- Design pipeline reliability and testing
- Develop streaming pipelines
- Enable self serve data platform
- Ensure data freshness accuracy availability
- Establish data lineage and data observability
- Implement data serving layers
- Lead lakehouse architecture
- Lead performance tuning
- Maintain production grade reliability
- Mentor engineers and elevate technical rigor
- Optimize large-scale data handling
- Own data ingestion data modeling streaming and data quality
- Own end to end data flows from ingestion to serving
- Plan capacity and cost efficiency
- Set partitioning and compaction best practices
Perks/Benefits
- Continuous learning
- Culture first work environment
- High-trust work environment
- Unlimited vacation policy
Skills/Tech-stack
AWS | Access Control | Apache Flink | Apache Iceberg | Apache Kafka | Apache Spark | Batch Processing | CloudFormation | Compaction | Data Governance | Data Lineage | Data Modeling | Data Observability | Data Partitioning | Data Quality | Distributed Systems | Docker | Failure recovery | Go | Kubernetes | Lakehouse | Multi-tenancy | Observability | Pipeline monitoring | Python | S3 | Schema evolution | Snapshotting | Streaming | System design | Terraform | TypeScript
Education
N/A
Related jobs
-
Mid-level Full TimeIN-KA-Bangalore10h ago
-
Senior Corporate Security Engineer INR 2829K-4000KAccess Management | Audit Evidence Collection | Audit evidence | Authentication Policy | AzureCompany paid bank holidays | Flexible hours | Free access to professional training platforms | Health insurance | Hybrid work modelSenior-level Full TimeBengaluru, KA, India11h ago
-
Engineering Analyst II, Gemini and Labs INR 1000K-1500KAdversarial techniques | Automation | Classifier | Data Analysis | Fine TuningHoliday coverage | Rotating on call coverage | Weekend coverageMid-level Full TimeBengaluru, Karnataka, India11h ago
-
DevOps + Team Lead INR 3000K-4000KArgo CD | Azure AKS | Azure Key Vault | Azure Service | Azure Service BusSenior-level Full TimeIndia13h ago
-
Senior Architect, ML Engineering INR 2500K-4500KAWS | Agentic Workflows | Async Programming | Azure | Circuit BreakersSenior-level Full TimePune, Maharashtra, India13h ago
-
API Security | Amazon Web Services | Application Firewall | Azure | BitbucketEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India17h ago
-
Entry-level Full TimeBengaluru, Karnataka, India17h ago
-
Senior Principal Software Engineer INR 2000K-4500KABAC | AWS | Access Management | Authorization Models | DDoS MitigationSenior-level Full TimeHyderabad, Telangana, India19h ago
-
Senior Principal Software Engineer INR 2000K-4500KABAC | AWS | Access Management | DDoS Mitigation | FIDO2Senior-level Full TimeHyderabad, Telangana, India19h ago
-
Security Engineer (Purple Team) INR 980K-1500KAPIs | AWS | Attack Emulation | Attack Emulation Platforms | AzureFlexible work schedule | Hybrid workMid-level Full TimeGurgaon - Cyber Park, India23h ago
-
Lead Software Engineer - DevSecOps INR 2755K-4000KAIOps | Blue-Green Deployment | Blue/green | CI/CD | DevSecOpsSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India23h ago
-
Compliance Engineer - Auditing | Certifications | ISMS | INR 800K-1250KAWS | Azure | Change Management | Cloud Security | Cloud platformCommunity involvement support | Flexible work hours | Medical, dental & vision coverage | Paid parental leave | Paid time offMid-level Full TimeIndia, Bangalore23h ago
-
Senior Staff Software Engineer Product Security INR 3000K-4500KAccess Management | Aquasec | Bash | CI/CD | CVE remediationCareer development | Employee resource groups | Flexible WFH | Generous PTO | Paid volunteer timeSenior-level Full TimeIndia-Bangalore-Remote R23h ago
-
Principal Cybersecurity Incident Response Analyst INR 1588K-4500KAWS | Adversary TTPs | After Action Review | Agile methodology | AzureCareer Development Programs | Flexible work arrangements | Health and wellbeing benefits | Hybrid work | Inclusion programsSenior-level Full TimeBengaluru, Karnātaka, India23h ago
-
Site Reliability Engineer - Intermediate INR 2000K-2500KAlerting | Ansible | Automation | Bash | ChefCareer growth opportunities | Healthcare benefits | Hybrid work setting | Online learning platform | Paid time offMid-level Full TimeIND-Pune-Equifax Analytics-PEC, India23h ago
-
Principal Cybersecurity Incident Response Analyst INR 1588K-4500KAWS | Adversary Tactics Techniques and Procedures | Adversary tactics | Agile | AutomationSenior-level Full TimeBengaluru, Karnātaka, India23h ago
-
Site Reliability Engineer - Intermediate INR 2000K-2500KAlerting | Ansible | Bash | Chef | Cloud CLICareer growth | Healthcare benefits | Hybrid work | Mentorship | Online learning platformMid-level Full TimeIND-Trivandrum-Equifax Analytics-PEC, India23h ago
-
Lead Cybersecurity - Identity Analytics Engineer INR 3000K-4000KAccess Management | Authentication | Authorization | CIS Controls | Data GovernanceSenior-level Full TimeIND:AP:Hyderabad / Argus Bldg 4f & …23h ago
-
Sr Specialist Cybersecurity- Network Security testing,(routing-OSPF, BGP), Paloalto, Firewall INR 500K-800KAAA | ACL | Anomaly Detection | Ansible | Azure DevOpsSenior-level Full TimeIND:AP:Hyderabad / Argus Bldg 4f & …23h ago
-
Sr Specialist Cybersecurity – Non-Human Identity (NHI) Engineer - Account/Service/Secret Management INR 3000K-4500KAWS IAM | Access Control | Access Management | Active Directory | Attribute-Based Access ControlSenior-level Full TimeIND:KA:Banglaore / Intl Tech Park, Whitefield …23h ago
-
Aladdin | Auditing | Business Process | Business process improvement | Compliance AuditingFlexible working hours | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeGurugram 8 B, India23h ago
-
Sr. Network Security Engineer INR 500K-800KAWS | AWS Security | AWS Security Groups | AWS WAF | AkamaiSenior-level Full TimeOffice - Noida, India23h ago
-
Senior-level Full TimeIND-Pune-Smartworks, India23h ago
-
Engineer II - Backend INR 980K-1500KAmazon Web Services | Cassandra | Code review | Continuous integration | ElasticsearchAdoption leave | Competitive vacation and holidays | Comprehensive wellness programs | Employee networks | Paid parental leaveMid-level Full TimePune, India23h ago
-
Security Engineer II INR 1500K-4500KAPI Security | AWS | Adversarial Attacks | Adversarial ML | Cloud SecuritySenior-level Full TimeBengaluru1d ago