Principal Engineer – Data Platform
Tasks
- Align data architecture with business goals
- Architect data platform strategy
- Articulate design tradeoffs and constraints
- Build data ingestion frameworks
- Define data modeling and schema evolution standards
- Design open table formats
- Design pipeline reliability and testing
- Develop streaming pipelines
- Enable self serve data platform
- Ensure data freshness accuracy availability
- Establish data lineage and data observability
- Implement data serving layers
- Lead lakehouse architecture
- Lead performance tuning
- Maintain production grade reliability
- Mentor engineers and elevate technical rigor
- Optimize large-scale data handling
- Own data ingestion data modeling streaming and data quality
- Own end to end data flows from ingestion to serving
- Plan capacity and cost efficiency
- Set partitioning and compaction best practices
Perks/Benefits
- Continuous learning
- Culture first work environment
- High-trust work environment
- Unlimited vacation policy
Skills/Tech-stack
AWS | Access Control | Apache Flink | Apache Iceberg | Apache Kafka | Apache Spark | Batch Processing | CloudFormation | Compaction | Data Governance | Data Lineage | Data Modeling | Data Observability | Data Partitioning | Data Quality | Distributed Systems | Docker | Failure recovery | Go | Kubernetes | Lakehouse | Multi-tenancy | Observability | Pipeline monitoring | Python | S3 | Schema evolution | Snapshotting | Streaming | System design | Terraform | TypeScript
Education
N/A
Related jobs
-
Software Engineer II INR 2250K-2400K.NET | ASP.NET | AWS | Angular | AuthenticationOn-call support rotationSenior-level Full TimeHyderabad, TS, IN2h ago
-
Distinguished Architect INR 1244K-4500KAWS | Analytics | Azure | Containers | CybersecurityEqual opportunity employer | Hybrid workSenior-level Full TimePune, Maharashtra, India7h ago
-
TC-CS-CTM-AppSec-Senior INR 2092K-2500KAPI Security | Agile | Application Security | Bitbucket | CI/CDCareer development | Coaching and feedback | Employee training | Flexible work arrangementSenior-level Full TimeBengaluru, KA, IN, 56004811h ago
-
Senior Cybersecurity Engineer – Exposure Management INR 2092K-3285KAPI Integration | Adversary TTPs | Application Security | Asset Management | Asset discoverySenior-level Full TimeIND-Hyderabad-Hybrid, India R13h ago
-
Senior Cybersecurity Engineer – Security Engineering INR 2156K-2156KAPIs | Automation | Cause analysis | Cloud Security | EDRSenior-level Full TimeIND-Hyderabad-Hybrid, India R13h ago
-
Expert Security Engineer - Offensive Security INR 2400K-2695KAPI Security | AWS | Application Security Testing | Attack Simulations | AutomationAccredited courses | Disability insurance | Donation matching | Employee assistance program therapy | Employee recognition programSenior-level Full TimeBengaluru, India13h ago
-
API Security | API Testing | Application Security | Automation | BLESenior-level Full TimeBengaluru, India13h ago
-
Public Cloud Security Engineer- Senior Advisor INR 2500K-3285KAWS | Agile | Automated testing | CI/CD | Cloud NetworkingSenior-level Full TimeBangalore, India13h ago
-
Public Cloud Security Engineer INR 1200K-1600KAWS | Automated testing | Azure | CI/CD | Cloud NetworkingMid-level Full TimeBangalore, India13h ago
-
Senior-level Full TimePune, IN1d ago
-
Security Architect INR 1244K-2156KABAC | AWS | Access Management | Active Directory | Application SecuritySenior-level Full TimeBangalore, India1d ago
-
Senior AppSec Engineer INR 2829K-3200KASPM | AST | AWS | Application Security | Application Security TestingHealth insurance | Learning and developmentSenior-level Full TimeNoida, Uttar Pradesh1d ago
-
Security Engineer III - .NET 6.0, Containers, SQL INR 500K-800K.NET 6 | ASP.NET | Agile | Asynchronous programming | BitbucketSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Security Engineer (Enterprise) INR 2156K-3500KApplication Security | Authentication | Automated security | Automated security testing | C plus plusSenior-level Full TimeBengaluru1d ago
-
Application Security | Authentication | Code review | Incident Response | JavaScriptCollaborative globally distributed team culture | Flexible working hours | Fully remote | Health benefits | Home office setup supportSenior-level Full TimeIndia R1d ago
-
Senior-level Full TimeHyderabad, Telangana, India1d ago
-
AWS RDS | Azure SQL | Azure SQL Database | Capacity Planning | Data ModelingBig 4 experienceSenior-level Full TimeNew Delhi, Delhi, India1d ago
-
Senior Staff Software Engineer INR 2156K-2695K.Net Core | AWS | Architecture | Azure | CI/CDDEI | Reward and recognition | Volunteering | Wellness | Work-life balanceSenior-level Full TimeHyderabad, India1d ago
-
Senior-level Full TimeBengaluru, Karnataka, India1d ago
-
Networking and Cybersecurity Engineer INR 1042K-1563KAccess Control | Access Control Lists | C Programming | CCNA | DCS401k plan | Dental coverage | Employee assistance program | Flexible time off | Medical insuranceSenior-level Full TimeNOIDA, UTTAR PRADESH, India1d ago
-
Data & AI DevSecOps Specialist INR 2298K-2675KAccess Control | CI/CD | Cloud platform | Data Classification | Data PrivacySenior-level Full TimeBengaluru, IN, 5601031d ago
-
Consultant INR 3000K-3200KAPP-v | Access Control | Active Directory | Agile | AppSenseCollaborative engineering environment | End user computing focus | Remote work opportunity | Vendor supportSenior-level Full TimeBangalore, Karnataka, India1d ago
-
Electronic Systems Technical Specialist - Tools INR 1000K-1800K.NET | Access Management | Android | Authentication | AuthorizationMid-level Full TimePune, Maharashtra, India1d ago
-
Senior Software Engineer, Security Engineering INR 3375K-4590KAWS | Access Management | Azure | Cloud infrastructure | Cloud infrastructure securitySenior-level Full TimeBengaluru, India1d ago
-
Apache Airflow & AWS (S3/EMR/Bedrock) Data Platform Administrator / Operations Engineer INR 2535K-4200KAWS | AWS IAM | AWS KMS | Access Logging | Amazon Bedrock24x7 production supportSenior-level Full TimePune, Maharashtra, India1d ago