Apache Airflow & AWS (S3/EMR/Bedrock) Data Platform Administrator / Operations Engineer
Pune, Maharashtra, India
INR 2535K-4200K (estimate) Senior-level Full Time
Tasks
- Analyze S3 usage and costs
- Configure Amazon Bedrock model endpoints
- Enable S3 access logging
- Encrypt S3 data with AWS KMS
- Execute retries and backfills
- Govern Bedrock costs
- Handle SLA miss events
- Implement S3 storage tiering and transitions
- Manage Bedrock access controls
- Manage EMR autoscaling
- Manage pipeline failure recovery
- Monitor Apache Airflow DAGs
- Monitor Bedrock invocations
- Optimize Amazon S3 storage with lifecycle policies
- Perform EMR lifecycle management
- Perform root cause analysis for pipeline failures
- Provide SLA based operational support
- Provision and configure Amazon EMR clusters
- Rerun failed task instances
- Resolve DAG execution delays
- Secure S3 with IAM policies and bucket policies
Perks/Benefits
Skills/Tech-stack
AWS | AWS IAM | AWS KMS | Access Logging | Amazon Bedrock | Amazon EMR | Amazon S3 | Apache Airflow | Autoscaling | Backfilling | Bucket policies | Cause analysis | DAG monitoring | Intelligent Tiering | Lifecycle Policies | Object level permissions | Retry strategies | Root Cause Analysis | Root cause | S3 versioning | SLA management | Storage class transitions | Storage lifecycle policies
Education
N/A
Related jobs
-
Senior-level Full TimeBengaluru, Karnataka, India14h ago
-
Senior Software Engineer, Security Engineering INR 3375K-4590KAWS | Access Management | Azure | Cloud infrastructure | Cloud infrastructure securitySenior-level Full TimeBengaluru, India15h ago
-
Lead Specialist Application Security INR 3384K-4600KAWS | Access Management | Application Security | Authentication | AuthorizationSenior-level Full TimeBangalore, Karnataka, India16h ago
-
Custom Software Engineer INR 1800K-2400KAPI Gateway | AWS CloudFormation | AWS IAM | AWS Lambda | AWS Well ArchitectedSenior-level Full TimeHyderabad, HDC4A, India22h ago
-
Sr Linux System Administrator INR 2520K-4144KAWS | Alerting | Ansible | Automation | BINDCertificate reimbursement | Health benefits | Medical insurance | Professional development | Remote work up to 30 days per yearSenior-level Full TimeGurugram Gurgaon HR, IN22h ago
-
ABAC | AD | AWS | AWS EKS | Access ManagementEmployee assistance program | Employee referral program | Flexible work environment | Group accident insurance | Group term life insuranceMid-level Full TimeIND - Bengaluru, India22h ago
-
Software Engineer II - Java development, Springboot INR 1050K-1300KAWS | Angular | Application Security | Azure | BDDMid-level Full TimePune, India22h ago
-
Senior-level Full TimePune, India22h ago
-
Test Engineer II (Performance Test Engineer) INR 720K-1200KAPIs | AWS | AppDynamics | Azure | BlazeMeterMid-level Full TimeIND Bangalore C 701, India22h ago
-
Test Engineer II (Performance Test Engineer) INR 720K-1200KAPIs | AWS | Apache JMeter | AppDynamics | AzureMid-level Full TimeIND Bangalore C 701, India22h ago
-
Entry-level Full TimeGera Commerzone SEZ, Pune, India22h ago
-
Lead Software Engineer - Network Automation INR 2500K-3500KAWS | Ant Design | Azure | BigQuery | CI/CDSenior-level Full TimeGera Commerzone SEZ, Pune, India22h ago
-
Senior-level Full TimeGera Commerzone SEZ, Pune, India22h ago
-
nCino Product Engineer | Salesforce APEX | nCino LOS Configuration & Integration | Cloud Security | Loan Origination Expertise INR 2156K-2156KAWS | Agile | Apex | Cloud Security | Data MigrationSenior-level Full TimeBengaluru - GTP, India22h ago
-
nCino Product Engineer | Salesforce APEX Development | Loan Origination System | Cloud Security & DevOps INR 2156K-2156KAWS | Agile | Cloud Security | Data Migration | DevOpsMid-level Full TimeBengaluru - GTP, India22h ago
-
MS Fabric & Power BI Platform Administrator INR 1628K-2245KAWS | Access Control | Audit Trail | Azure | Azure DataContinuous operations shift support | Flexible work hours adjustment | Weekend and holiday work with benefits adjustmentSenior-level Full TimeIN: Lilly Hyderabad, India22h ago
-
SDE III - DevSecOps INR 2200K-3500KAPI Security | AWS CLI | AWS CloudFormation | AWS CloudFront | AWS CloudHSMSenior-level Full TimeJunglee Gurgaon, India22h ago
-
Senior-level Full TimeChennai, India1d ago
-
Senior-level Full TimeBengaluru, Karnataka, India1d ago
-
Software Development Engineer II - AI and Analytics INR 1500K-2000KAI Agents | AWS Bedrock | AWS CloudFormation | AWS Lambda | AgileContinuous learning | High-trust work environment | Unlimited vacationMid-level Full TimeBengaluru1d ago
-
Software Development Engineer III INR 2829K-3500KAPI Gateway | AWS CloudFormation | AWS Lambda | Agile | Amazon APIContinuous learning | High-trust work environment | Unlimited vacationSenior-level Full TimeBengaluru1d ago
-
SIEM Engineer INR 1100K-1600KAWS | Automation | Azure | Cloud Security | Cloud platformClient-facing collaboration | Security strategy contributionMid-level Full TimeHyderabad1d ago
-
AWS | Bash | CI/CD | Cloud platform | ComplianceAnnual incentive bonus plan | Earned Leave | Employee investment plan | Employee resource groups | Life insuranceMid-level Full TimeBangalore, Karnataka, India1d ago
-
Application Security Specialist Engineer - InfoSec INR 1567K-4500KAPIs | AWS | Azure | CI/CD | CVSSMid-level Full TimeBangalore, India2d ago
-
TC-CS-Data Protection and Privacy-PKI-Senior INR 1044K-1375KAWS | Active Directory | Active Directory Certificate Services | AppViewX | AutomationSenior-level Full TimeTrivandrum, KL, IN, 6955812d ago