Apache Airflow & AWS (S3/EMR/Bedrock) Data Platform Administrator / Operations Engineer
Pune, Maharashtra, India
INR 2535K-4200K (estimate) Senior-level Full Time
Tasks
- Analyze S3 usage and costs
- Configure Amazon Bedrock model endpoints
- Enable S3 access logging
- Encrypt S3 data with AWS KMS
- Execute retries and backfills
- Govern Bedrock costs
- Handle SLA miss events
- Implement S3 storage tiering and transitions
- Manage Bedrock access controls
- Manage EMR autoscaling
- Manage pipeline failure recovery
- Monitor Apache Airflow DAGs
- Monitor Bedrock invocations
- Optimize Amazon S3 storage with lifecycle policies
- Perform EMR lifecycle management
- Perform root cause analysis for pipeline failures
- Provide SLA based operational support
- Provision and configure Amazon EMR clusters
- Rerun failed task instances
- Resolve DAG execution delays
- Secure S3 with IAM policies and bucket policies
Perks/Benefits
Skills/Tech-stack
AWS | AWS IAM | AWS KMS | Access Logging | Amazon Bedrock | Amazon EMR | Amazon S3 | Apache Airflow | Autoscaling | Backfilling | Bucket policies | Cause analysis | DAG monitoring | Intelligent Tiering | Lifecycle Policies | Object level permissions | Retry strategies | Root Cause Analysis | Root cause | S3 versioning | SLA management | Storage class transitions | Storage lifecycle policies
Education
N/A
Related jobs
-
Engineering-L2-Bengaluru-Vice President-Security Engineering INR 1500K-4000KAWS | Cloud Security | Cloud platform | CrowdStrike Falcon | CybersecurityExecutive-level Full TimeBengaluru, Karnataka, India7h ago
-
Cloud Engineer INR 2500K-3500KAWS | AWS Security | AWS Security Hub | Active Directory | Assured WorkloadsSenior-level Full TimeBengaluru South, Karnataka, India8h ago
-
Mid-level Full TimeNoida, Uttar Pradesh, India14h ago
-
Senior Trust Operations Cloud Security Engineer INR 1500K-3440KAWS | Account strategy | Azure | CNAPP | CSPMEducation support | Generous time-off policies | Lifestyle support | Top shelf benefits | Wellness supportSenior-level Full TimeBangalore15h ago
-
Senior Staff Software Development Engineer INR 3200K-4200KAWS | Azure | C# | DNS | Distributed SystemsEducation reimbursement | Health insurance | Hybrid work | In-office perks | Paid time offSenior-level Full TimeBangalore, IND18h ago
-
Senior Cloud Engineer(GCP) INR 2755K-3465KAI endpoints | API Gateway | AWS | Access Management | AgileCompany-matched student loan contribution | Continuous learning | Family-friendly perks | Flexible time off | Health care coverageSenior-level Full TimeIN - HYDERABAD SKYVIEW, India19h ago
-
Staff Software Engineer (Java) INR 2050K-4000KAWS | CI/CD | DevSecOps | Distributed Systems | DockerSenior-level Full TimePune, Maharashtra, India19h ago
-
Senior Sales Engineer INR 2500K-4000KAPI Integration | API Security | AWS | Application Firewall | Application SecuritySenior-level Full TimeMUMBAI, India19h ago
-
Mid-level Full TimeGurugram, DDC2A, India19h ago
-
Mid-level Full TimeGurugram, DDC2A, India19h ago
-
Senior-level Full TimeIN - HYDERABAD SKYVIEW, India19h ago
-
DDoS Network Security Engineer - MTS - Bangalore/Hyderabad INR 1019K-1593KAWS | Akai | Azure | BGP | BashMid-level Full TimeIndia - Bangalore19h ago
-
Mid-level Full TimeIndia R1d ago
-
Senior Software Engineer (Firewall Backend, Content Filtering) INR 1567K-4600KAWS | Azure | CI/CD | Certificates | Data PipelinesSenior-level Full TimePune, Maharashtra, India - Remote R1d ago
-
Senior Software Engineer (Backend, Cloud Network Management) INR 1500K-4500KAWS | Authentication | Azure | CI/CD | CertificatesEqual opportunity employer | Hybrid workSenior-level Full TimePune, Maharashtra, India1d ago
-
Senior Data Platform Engineer INR 1500K-2400KAWS Glue | AWS IAM | AWS Lake Formation | AWS Lambda | AWS S3Senior-level Full TimeBangalore, India1d ago
-
Senior-level Full TimeIndia, West Bengal, Kolkata1d ago
-
Security Engineer II INR 950K-1500KAPI Security | API fuzzing | AWS | Burp Suite | CI/CDEmployee wellness programs | Flexible vacation | Paid time off | Team events and off-sites | Training budgetMid-level Full TimeRemote (Pune, Maharashtra, IN); Remote (Bengaluru, … R1d ago
-
Principal Software Engineer INR 2000K-3300KAWS | Agile | Azure | Code Signing | CryptographyEducation support | Generous time-off policies | Lifestyle support | Wellness supportSenior-level Full TimeBangalore1d ago
-
API Security | AWS | Access Management | Application Security | AzureCollaborative high ownership culture | Flexible working arrangements | Learning opportunities | Professional development support | Remote-friendly workSenior-level Full TimeIndia1d ago
-
Support Engineer II - India INR 1000K-1400KAPIs | AWS | Ansible | Azure | Bash401k plan | Career growth | Dental insurance | Discretionary time off | Health insuranceMid-level Full TimeRemote - India R1d ago
-
Lead Information Security Engineer, ITC INR 2156K-3200KAI/ML | AWS | Azure | CI/CD | Cloud SecuritySenior-level Full TimeINDIA TECHNOLOGY CENTER, India1d ago
-
Senior-level Full TimeBangalore, KA, IN1d ago
-
Lead Software Engineer INR 1500K-3000KAWS | Caching | Cassandra | Cloud infrastructure | Cloud platformSenior-level Full TimePune, India1d ago
-
Engineer, Staff INR 1000K-2250KASP.NET | AWS | Active Directory | Backup and Recovery | Business ContinuitySenior-level Full TimeBengaluru, India1d ago