Data Engineer
Tasks
- Build ETL/ELT pipelines
- Collaborate with stakeholders and data architects
- Design data pipelines for legal systems
- Develop Databricks Spark Delta Lake workflows
- Document pipelines and technical decisions
- Enable feature engineering for AI applications
- Implement data governance, lineage, and security controls
- Implement data quality checks and validation
- Optimize Delta Lake and Spark workloads
- Participate in agile development
- Prepare datasets for AI ML and GenAI use cases
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Airflow | Apache Spark | Azure | Data Catalog | Data Governance | Data Lineage | Data Modeling | Data Privacy | Data Quality | Data Warehousing | Databricks | Databricks Workflows | Delta Lake | ELT | ETL | GCP | Kafka | PySpark | Python | SQL | Security
Education
N/A
Roles
Related jobs
-
Mid-level Full TimeIN-AP-Hyderabad4h ago
-
Security Engineer - SIEM Engineer INR 3000K-4000KAnalytics | Automation | Dashboarding | Data Normalization | Data VisualizationSenior-level Full TimeKochi, Kerala, India9h ago
-
Test Associate Senior Engineer INR 500K-968KAgile | Automated Test | Automated test frameworks | Networking | Networking protocolsMid-level Full TimeBangalore, Karnataka, India12h ago
-
Staff Software Development Support Engineer INR 1567K-4600KAWS | Apache Athena | Azure | Bash | DatabricksFlexible annual leave | Paid Holidays | Training and career developmentSenior-level Full TimeOffice - IND - Karnataka, Bengaluru, …17h ago
-
Developer 2 INR 1567K-4600KAWS | Azure | Bazel | Bitbucket | C#401k match | Dental insurance | Disability insurance | Employee assistance program | EquitySenior-level Full TimeOffice - IND - Karnataka, Bengaluru, …17h ago
-
Software Dev Engr I INR 960K-1200K.NET | API Keys | Azure DevOps | Azure Pipelines | Azure Pipelines CI CDEmployee belonging groups | Healthcare (Dental | Healthcare (Medical | Healthcare vision | Hybrid workEntry-level Full TimeIN.Bangalore.Remote, India R17h ago
-
Senior-level Full TimeHyderabad, Telangana, India21h ago
-
Staff Software Engineer (Position located in Bengaluru, India) INR 3375K-4590KAPI Gateway | AWS AppSync | AWS Glue | AWS Lambda | Amazon CloudWatchAdoption Assistance | Certification completion bonus | Certification reimbursement | Employee bonuses | Employee referral bonusSenior-level Full TimeBengaluru, India22h ago
-
Snr. Software Engineer (Position located in Bangalore, India) INR 3200K-4500KAPI Gateway | AWS AppSync | AWS Glue | AWS Lambda | Amazon CloudWatchAdoption Assistance | Bonuses | Certification completion bonuses | Certification reimbursement | Employee referral bonusesSenior-level Full TimeBangalore, India22h ago
-
Software Engineer (Position located in Bangalore, India) INR 1200K-1680KAPI Gateway | AWS AppSync | AWS IAM | AWS Lambda | Amazon CloudFrontAdoption Assistance | Certification completion bonus | Certification reimbursement | Tuition reimbursementMid-level Full TimeBengaluru, India22h ago
-
Staff Software Development Engineer INR 3000K-4200KAWS | Azure | C# | Debugging | Distributed SystemsEducation reimbursement | Health plans | Hybrid work model | Paid time off | Parental leaveSenior-level Full TimeIndia - Update Location1d ago
-
Access Controls | Cloud Access Security Broker | Cloud Access Security Broker (CASB) | Cloud Email | Cloud ProxyMid-level Full TimeBengaluru, Karnataka, IN1d ago
-
API Gateway | AWS | Alerting | Bash | CI/CDFlexible work arrangements | Health insurance | Learning and development programs | Paid time off | Retirement benefitsMid-level Full TimeIndia1d ago
-
AWS IAM | Active Directory | Ansible | Azure Active Directory | CI/CDDisability coverage | Employee Assistance Program (EAP) | Health insurance | Home office stipend | Learning and development supportSenior-level Full TimeIndia1d ago
-
DSPM Engineer - Manager INR 2000K-3500KAPI Integration | AWS | Access Management | Automation | BigIDSenior-level Full TimeIndia1d ago
-
PrivacyOps Engineer - Manager INR 700K-1500KAgile | BigID | CCPA | CMDB | Consent ManagementClient-facing consulting experienceMid-level Full TimeIndia1d ago
-
Senior-level Full TimePune, Maharashtra, India1d ago
-
DevSecOps Engineer-AI Labs INR 2500K-4000KAccess Control | Akamai | Audit Logging | Automated scaling | AzureSenior-level Full TimeAhmedabad, Gujarat, India1d ago
-
Assistant Manager - DevSecOps INR 800K-1500KAI | Application Architecture | By Design | C++ | CertificatesMid-level Full TimePune, Maharashtra, India1d ago
-
Senior Technology Engineer INR 2000K-3900KAPI Development | Active Directory | Ansible | Artifact management | BashSenior-level Full TimeIndia1d ago
-
Anti-Bot | Binary Analysis | C++ | DDoS | HTTPCutting edge security work | Fully remote | Global team collaboration | High autonomy | OwnershipMid-level Full TimeIndia R1d ago
-
Sr IT Security Analyst INR 1753K-3500KAWS Cognito | Access Management | Access reviews | Active Directory | AutomationSenior-level Full TimeHyderabad, India1d ago
-
Information Security Engineer INR 800K-1700KAccess Control | Acunetix | Amazon Web Services | Application Security | Burp SuiteFully remote | US business hours remote scheduleMid-level Full TimePune, MAHĀRĀSHTRA, India R1d ago
-
Application Security Engineer INR 2000K-3500KAPI Security | API Top 10 | AWS Security | Advanced Security | Adversarial Machine LearningSenior-level Full TimePune, MAHĀRĀSHTRA, India1d ago
-
Software Engineer INR 1000K-1500KAWS | Azure | CI/CD | CloudFormation | DockerCompetitive leave benefits | Employee Assistance Program (EAP) | Food allowance | Gender neutral parental leave | Health and wellness benefitMid-level Full TimeBengaluru, Karnataka, India1d ago