Software Development Engineer II - Data
Tasks
- Architect and implement high scale data pipelines
- Build data lakehouse solutions
- Deploy scalable secure data infrastructure on AWS
- Design data models for structured and semi structured data
- Develop streaming and batch processing pipelines
- Implement data quality checks and observability
- Optimize pipeline performance and reliability
- Orchestrate ELT workflows with Airflow
Perks/Benefits
Skills/Tech-stack
AWS ECS | AWS Lambda | Apache Airflow | Apache Flink | Apache Iceberg | Apache Pinot | Apache Spark | Automated testing | CDC | CI/CD | Data Governance | Data Lineage | Data Modeling | Data Observability | Docker | Druid | Go | Infrastructure as Code | Kafka | Kinesis | Kubernetes | Node.js | Parquet | Partitioning | Pulsar | Python | Query Optimization | Real Time | Real-time analytics | Rockset | S3 | SQL | Scala | Schema Design | Snowflake | Streaming Data | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Lead Security Engineer - Python, Cloud INR 2500K-4500KAPI Development | AWS | AWS CloudFormation | Agile methodology | Application ResiliencySenior-level Full TimeBengaluru, Karnataka, India12h ago
-
Java React Bash GCP IAM Engineering Lead/Senior Associate Director, Software Engineering INR 1000K-1800KAgile | Angular | Ansible | Bash | BigQueryContinuous professional development | Flexible workingMid-level Full TimePune, Maharashtra, India R15h ago
-
C# | C++ | Concurrency | Epoll | GoSenior-level Full TimePune, Maharashtra, India16h ago
-
Senior-level Full TimePune, India20h ago
-
Lead Software Engineer INR 1500K-3500KAgile | Amazon Web Services | Ant | Apache Cassandra | Apache KafkaSenior-level Full TimePune, India20h ago
-
Software Engineer II INR 2400K-4000KAgile | CI/CD | Cloud Computing | Event Driven | Event-driven architectureExecutive-level Full TimePune, India20h ago
-
Application Support Engineer INR 1000K-1700K.NET | AWS CloudFormation | AWS Lambda | Amazon EC2 | Amazon RDSMid-level Full TimeHyderabad, HC3, India20h ago
-
Developer - AI Engineering - Backend INR 1500K-4600KAWS | Amazon Web Services | CI/CD | Databricks | DockerEmployee assistance program | Equity | Fertility support | Flexible annual leave | Life insuranceSenior-level Full TimeOffice - IND - Karnataka, Bengaluru, …20h ago
-
Senior Developer 2 - Python INR 2829K-5076KAWS | Databricks | Docker | Git | GoEquity | Fertility support | Flexible annual leave | Life insurance | Paid HolidaysSenior-level Full TimeOffice - IND - Karnataka, Bengaluru, …20h ago
-
IN_Senior Associate_AI ML_Digital Integration_Advisory_Gurgaon INR 2000K-2800KAI | Advanced Security | Application Security Testing | CodeQL | Composition analysisSenior-level Full TimeGurugram 10 C, India20h ago
-
Senior-level Full TimeNoida,Uttar Pradesh,India1d ago
-
SaaS Security Posture Mgmt Engineer INR 1800K-2750KAPI Integration | Access Management | Amazon Web Services | Automation workflows | BashSenior-level Full TimeNoida,Uttar Pradesh,India1d ago
-
Security Engineer III - AIML INR 3000K-5000KAI Security | Access Management | Authentication | CloudFormation | Data poisoningSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior-level Full TimeChennai, India1d ago
-
AWS | Adversary Emulation | Application Security | Azure | Cloud SecuritySenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior-level Full TimePune, India1d ago
-
Gen AI Full-Stack Engineer INR 1800K-3000KAI Search | ARM | App Service | Asynchronous programming | AutogenHealth benefits | Hybrid remote work | Professional development | Work-life balanceMid-level Full TimeBengaluru, Karnataka1d ago
-
Assistant Vice President - Application Security Testing INR 2400K-3300K.NET | Burp Suite | Code Analysis | Code review | CsharpAnnual health checkup | Dental benefits | Gender neutral policy | Group term life insurance | Learning and development programExecutive-level Full TimeGurugram, India1d ago
-
AI | Bash | CI/CD | Data Loss Prevention | Data lossCollaborative work environment | Learning opportunities | Remote-friendly work environmentMid-level Full TimeIndia1d ago
-
Network Security II Engineer II INR 800K-1400KAccess Control | Application Firewall | Big-IP | DNS | F5 Big IPMid-level Full TimePune, India1d ago
-
Principal Security Engineer INR 2515K-4401KApplication Security | Applied cryptography | Cloud Security | Cloud Security Auditing | Code reviewEmployee stock purchase plan | Equity grants | Health benefits | Paid time off | Parental leaveSenior-level Full TimeIndia R1d ago
-
Senior Software Engineer, DevSecOps Engineering INR 1632K-2700KAndroid | Build Automation | CI/CD | Code Analysis | Cross-compilationSenior-level Full TimeKolhapur,Maharashtra,IND1d ago
-
Senior Technical Support Engineer INR 2156K-3300KAccess Management | Groovy | Identity and Access Management | Identity and access | IntegrationSenior-level Full TimeBengaluru1d ago
-
Sr. Backend Engineer INR 2755K-3465KAWS | AWS Cloud | Azure | Cassandra | Code reviewEmployee networks | Paid Holidays | Paid adoption leave | Paid parental leave | Paid vacationSenior-level Full TimeBangalore, India1d ago
-
Senior Developer 2 INR 2156K-5000KAWS | Athena | Azure | Bash | Crash AnalysisFertility support | Flexible annual leave | Life insurance | Medical insurance | Paid HolidaysSenior-level Full TimeOffice - IND - Karnataka, Bengaluru, …1d ago