Software Development Engineer II - Data
Tasks
- Architect and implement high scale data pipelines
- Build data lakehouse solutions
- Deploy scalable secure data infrastructure on AWS
- Design data models for structured and semi structured data
- Develop streaming and batch processing pipelines
- Implement data quality checks and observability
- Optimize pipeline performance and reliability
- Orchestrate ELT workflows with Airflow
Perks/Benefits
Skills/Tech-stack
AWS ECS | AWS Lambda | Apache Airflow | Apache Flink | Apache Iceberg | Apache Pinot | Apache Spark | Automated testing | CDC | CI/CD | Data Governance | Data Lineage | Data Modeling | Data Observability | Docker | Druid | Go | Infrastructure as Code | Kafka | Kinesis | Kubernetes | Node.js | Parquet | Partitioning | Pulsar | Python | Query Optimization | Real Time | Real-time analytics | Rockset | S3 | SQL | Scala | Schema Design | Snowflake | Streaming Data | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Senior System Administrator II [Storage Engineer] INR 1000K-1890KAWS EBS | AWS S3 | Ansible | Ceph | DASMid-level Full TimeBengaluru9h ago
-
Senior System Administrator II [Ceph Engineer] INR 1500K-2400KAWS EBS | AWS S3 | Ansible | Ceph | DASMid-level Full TimeBengaluru9h ago
-
Mid-level Full TimePune, India14h ago
-
Senior-level Full TimePune, India14h ago
-
Senior-level Full TimePune, India14h ago
-
Senior Platform Engineer INR 2695K-4000KAPI Integration | ARM | Artifact Repositories | Azure DevOps | BashSenior-level Full TimePune, India14h ago
-
Tech Lead(Cyber Security) INR 2000K-4600KAWS IAM | Access Control | Access Recertification | Active Directory | Azure ADGlobal career opportunities | Mandatory background screening | Robust benefits packageSenior-level Full TimeNoida Office, India14h ago
-
Senior Developer 1 (SRE) - Endpoint - Cloud INR 2156K-4600KChef | Docker | GitHub | Grafana | HelmEmployee assistance program | Equity | Fertility support | Flexible annual leave | Life insuranceSenior-level Full TimeOffice - IND - Karnataka, Bengaluru, …14h ago
-
Cloud Services Engineer III INR 1500K-2750KAzure Automation | Azure SQL | Azure SQL Database | Azure SQL Managed Instance | Backup and RecoveryRemote workSenior-level Full TimeBangalore, Karnataka, India R1d ago
-
Software Engineer INR 420K-575K.Net Core | Agile | Bitbucket | C# | CI/CDCareer growth | Financial benefits | Health and wellbeing benefits | Inclusive work environment | Lifestyle benefitsEntry-level Full TimeBengaluru, KA, India1d ago
-
Escalation Engineer - AI Security INR 3000K-4000KAI Agent | AI Model Security | AI agent security | AI model | APIEducation reimbursement | Health plans | Parental leave options | Retirement options | Time off plansSenior-level Full TimeBangalore, IND; Mohali, IND1d ago
-
Mid-level Full TimeHyderabad, Telangana, India1d ago
-
AES - DE - DevOps - AWS DevOps INR 2695K-3500KARM Templates | Agile | Alerting | Auto Scaling | Azure ContainerSenior-level Full TimeIndia1d ago
-
TC-CS-CTM-AppSec INR 1500K-2500KAPI Security | Agile | Application Security | CI/CD | Compliance as CodeCareer development | Flexible work arrangement | Support and coaching | Training opportunitiesMid-level Full TimePune, MH, IN, 4110141d ago
-
Principal Vulnerability Management Engineer INR 2800K-4200KAPI Integration | Attack Path | Attack Path Analysis | Attack surface management | Authenticated ScanningEducation reimbursement | Health plans | Hybrid work | Parental leave options | Retirement optionsSenior-level Full TimeBangalore, IND1d ago
-
AWS | Access Management | Active Directory | Automation | AzureEmployee resource groups | Health and wellness benefits | Inclusive culture | Internet reimbursement | Mental health supportSenior-level Full TimeIndia1d ago
-
Amazon EKS | Aqua Security | Bash | CI/CD | CVE remediationContinuous learning and career development | Employee resource groups | Flexible schedule | Health and wellness support | Inclusive cultureSenior-level Full TimeIndia1d ago
-
API | Automation | CMDB | CNAPP | CSPMEducation reimbursement | Health plans | In-office perks | Parental leave | Remote workSenior-level Full TimeRemote - India R1d ago
-
Senior Software Engineer INR 3000K-5000KAlgorithms | Authentication | Authorization | C# | C++Equity | Flexible hours | Health insurance | Paid time off | Work from home expenseSenior-level Full TimeRemote - India R1d ago
-
Mid-level Full TimeChennai, TN, India1d ago
-
Application Security Engineer INR 1200K-1680KASVS | AWS | Application Security | Architecture Analysis | Authentication401-k match | Collaborative office environment | Flexible vacation | HSA contributions | Healthcare optionsMid-level Full TimeIndia | Pune1d ago
-
Senior-level Full TimeBengaluru, KA, IN, 5600161d ago
-
Security Automation Engineer INR 2475K-3500KAlert Correlation | Change Management | Cloud Security | Cloud apps | CrowdStrike FalconFlexible schedule | Permanently remote | Remote work supportSenior-level Full TimeBengaluru, Karnataka, India - Remote R1d ago
-
Senior-level Full TimeHyderabad-Hi-Tec City, India1d ago
-
TC-CS-IAM-SailPoint IIQ-Staff INR 1588K-2647KAccess reviews | Beanshell | CI/CD | Compliance Manager | GitHubSenior-level Full TimeBengaluru, KA, IN, 5600481d ago