Senior Data Engineer
Tasks
- Build and maintain big data applications and environments
- Build data ingestion and transformation workflows
- Develop and deploy data engineering solutions using SDLC
- Develop and manage data pipelines
- Ingest data from Apache Kafka
- Perform ETL using Apache Spark
- Perform SQL performance tuning
- Support ad hoc data investigations
- Utilize Apache NiFi for orchestration and scheduling
- Work with Hadoop and data lake platforms
- Write and optimize SQL queries
Perks/Benefits
- N/A
Skills/Tech-stack
AWS S3 | Apache Hadoop | Apache Iceberg | Apache Kafka | Apache NiFi | Apache Spark | Bash | Data Ingestion | Data Warehousing | Delta Lake | ETL | Hive | Impala | Linux | Oracle | Python | SQL
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeIN-AP-Hyderabad10h ago
-
Infrastructure Engineer III- Cloud Database Administrator (DBA) INR 2486K-3200KAWS DMS | AWS EC2 | AWS ECS | AWS EKS | AWS RDSSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Information Security Engineer INR 1228K-1801KAWS | Access Control | Acunetix | Alert Logic | Automation ResponseMid-level Full TimePune, MAHĀRĀSHTRA, India11h ago
-
Senior Software Test Engineer INR 2092K-2541KBitbucket | C# | C++ | CI/CD | Case designCareer growth | Health and wellbeing benefits | Inclusive workplace | Training opportunities | Work-life flexibilitySenior-level Full TimeBengaluru, KA, India12h ago
-
Senior Database Administrator INR 2520K-3380KComputer Networking | DNS | Database Reliability | Database performance | FirewallsFlexible Working ProgramSenior-level Full TimeIndia13h ago
-
Senior Security Engineer - Perimeter Security Operations INR 500K-800KAPI abuse | AWS WAF | Akamai | Bash | Bot mitigationGlobal on-call rotationSenior-level Full TimeHyderabad, Telangana, India13h ago
-
Software Quality Engineer INR 600K-875KAzure Boards | Azure DevOps | Azure DevOps Repos | Azure DevOps Test Plans | Azure PipelinesMid-level Full TimeHyderabad, Telangana, India13h ago
-
Junior Platform Engineer INR 800K-800KAPI Development | Agile | Alerting | Amazon Web Services | AzureEntry-level Full TimePune, 411022, India15h ago
-
Software Engineer INR 900K-900KAPI Design | AWS | Agile | Angular | Application SecurityCareer growth | Financial support | Flexible benefits | Health and wellbeing support | Inclusive environmentEntry-level Full TimeBengaluru, KA, India16h ago
-
Senior Cyber Defense Analyst, ITC INR 2500K-3200KAWS | Artificial Intelligence | Azure | CI/CD | DatabricksSenior-level Full TimeINDIA TECHNOLOGY CENTER, India23h ago
-
Software Engineer (Quality Engineer,Python,SDET) INR 2092K-3200KAWS | Anomaly Detection | Automation | Azure | CI/CDSenior-level Full TimeBangalore, India23h ago
-
Senior Engineer, Database Engineering INR 1800K-2250KADO NET | AWS | Always On | Client Libraries | Clustering24/7 shifts | Continuous learning access | Family-friendly perks | Flexible downtime | Healthcare coverageSenior-level Full TimeIN - HYDERABAD SKYVIEW, India23h ago
-
Database Engineer III INR 1500K-2250KData Guard | Elasticsearch | Informatica | JDBC | Microsoft SQL24x7 shift work | Continuing education program | Continuous learning resources | Generous time off | Health care coverageSenior-level Full TimeIN - HYDERABAD SKYVIEW, India23h ago
-
System Administrator/Devops Operator INR 1971K-3000KAzure | Bash | CI/CD | Database Management | DockerCareer development opportunities | Email support | Off-hours on-call support | Phone and Microsoft Teams supportMid-level Full TimePune Cerebrum, India23h ago
-
Specialist, AI Engineer INR 2500K-4500KAPI Integration | Agent Orchestration | Agent systems | Anomaly Detection | ClassificationHybrid work | Visa sponsorshipSenior-level Full TimeIND - Telangana - Hyderabad (HITEC …23h ago
-
Cyber- Senior Cloud Engineer- Application Security INR 2092K-4590KAWS | Advanced Security | AppSec | Audit Logging | AzureCareer development | Global organization | Inclusive workplaceSenior-level Full TimeINBLR02 - Bangalore - Milesstone Buildcon, …23h ago
-
Site Reliability Engineer | Cloud Infrastructure, Automation, Incident Management, Kubernetes, Terraform, Monitoring and Security INR 2800K-4000KAccess Control | Amazon Web Services | Ansible | AppDynamics | AzureSenior-level Full TimePune - Kharadi (EON), India23h ago
-
Specialist, Data Engineer INR 2520K-3380KAPI Orchestration | Apache Spark | Azure | Azure Data | Azure Data ExplorerHybrid work arrangement | Relocation support | Visa sponsorshipSenior-level Full TimeIND - Telangana - Hyderabad (HITEC …23h ago
-
Lead Software Engineering INR 2829K-3200KAPI Gateway | Agile | Cloud Foundry | DRY | Event DrivenContinuous learningSenior-level Full TimePune, India23h ago
-
Business Rule Author - Software Engineer 2 INR 1297K-1502KAgile | Behavior-Driven Development | Decision Manager | IBM Operational Decision Manager | JavaMid-level Full TimePune, India23h ago
-
Senior Software Engineer INR 2156K-2500KAgile Framework SAFe | Ansible | Bitbucket | Chef | DatabasesSenior-level Full TimePune, India23h ago
-
Principal, Software Engineering INR 2829K-2829KCI/CD | Cassandra | Cloud Foundry | Docker | ElasticsearchSenior-level Full TimePune, India23h ago
-
Senior-level Full TimeVadodara, India23h ago
-
Senior Software Engineer-1 INR 2156K-2405KAPI Design | Alerting | Ansible | Automated testing | C#On-call rotation | Security trainingSenior-level Full TimePune, India23h ago
-
Mid-level Full TimePune, India23h ago