Senior Databricks Platform Engineer
Arlington, VA, United States
USD 180K-247K (estimate) Senior-level Full Time
Tasks
- Apply data governance metadata management and cataloging
- Build platform observability
- Collaborate with AWS infrastructure teams
- Configure compute autoscaling and workload management
- Configure metastore and catalog hierarchies
- Configure storage integrations and external locations
- Create Databricks workspaces clusters notebooks jobs and Delta Lake
- Enforce compute policies and cluster configurations
- Establish connections to source systems
- Evaluate and test new Databricks and AWS features
- Implement RBAC security frameworks
- Implement data lineage and auditing
- Implement encryption and data masking
- Implement user provisioning processes
- Integrate identity management using SAML SCIM and Active Directory
- Maintain enterprise Databricks platform
- Maintain technical documentation
- Manage Unity Catalog governance
- Manage secrets and credential handling
- Manage serverless SQL warehouses
- Monitor and tune cluster utilization and performance
- Optimize cost using cost optimization frameworks
- Troubleshoot platform-level issues
- Validate security and compliance controls
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Data | AWS Data Factory | AWS Glue | AWS IAM | AWS KMS | Active Directory | Amazon EMR | Amazon S3 | Apache Airflow | Apache Hadoop | Apache Hive | Apache Spark | Auditing | Autoscaling | CI/CD | Data Cataloging | Data Factory | Data Governance | Data Lineage | Data masking | Databricks | Delta Lake | Encryption | Git | Metadata Management | Python | RBAC | SAML | SCIM | SQL | Scala | Serverless SQL | Unity Catalog | Workload management
Education
Related jobs
-
Application Engineer Expert Level USD 225K-305KAutomation | Cloud Security | CloudTrail | CloudWatch | Defender for Endpoint401k match | Career development | Dental insurance | Health insurance | Life insuranceSenior-level Full TimeFort Meade, MD, US14h ago
-
Application Engineer Expert Level USD 225K-305K800-53 | AWS | AWS Config | AWS Inspector | AWS Key Management Service401k match | Career development | Dental insurance | Health insurance | Health savings accountSenior-level Full TimeLinthicum, MD, US14h ago
-
Junior Software QA Engineer USD 60K-89KAPI Testing | Accessibility testing | Agile | Azure Pipelines | CI/CDEntry-level Full TimeFrisco, TX, US14h ago
-
Application Engineer Expert Level USD 225K-305KAWS | Amazon S3 | Apache NiFi | Apache Spark | Azure401k plan | Career development | Federal Holidays | Flexible spending account | Health savings accountSenior-level Full TimeLinthicum, MD, US14h ago
-
Senior Product Solutions Engineer USD 212K-292KAccess Management | Account takeover | Active Directory | Automation Scripts | Azure Active Directory401k matching | Disability insurance | Flexible remote work options | Health savings account | Health, dental, vision insuranceSenior-level Full TimeAustin, Texas | Remote R16h ago
-
Sr. Data Architect III (6550) USD 174K-202KData Architecture | Data Engineering | Data Governance | Data Lineage | Data Management401k match | Dental insurance | Dependent care | Employee assistance | Flexible work arrangementsSenior-level Full TimeWashington, DC16h ago
-
Software Engineer I USD 137K-205KAPI Design | AWS | Agile | Analytics | Azure401k matching | Dental insurance | Employee discounts | Medical insurance | Paid time offMid-level Full TimeUnited States, San Diego, CA17h ago
-
Software Engineer I USD 137K-205KAWS | Agile | Analytics | Azure | CI/CD401k matching | Dental insurance | Employee discounts | Medical insurance | Paid time offMid-level Full TimeUnited States, San Mateo, CA17h ago
-
Mid-level Full TimeOrlando, FL17h ago
-
AI SIEM | Ansible | Bash | Chef | CrowdStrikeCorporate holidays | Dental insurance | HSA | Home internet allowance | Medical insuranceMid-level Full TimeRemote R17h ago
-
Senior Security Engineer USD 153K-220K800-53 | AWS | Access Management | CI/CD | Continuous MonitoringSenior-level Full TimeRemote - USA R18h ago
-
Security Engineer (930867) USD 106K-233KAWS | Antivirus | DevSecOps | Firewall | Google CloudLearning opportunities | Networking programsSenior-level Full TimeLouisville, KY, United States18h ago
-
Principal Security Operations and Enablement Engineer USD 190K-215KAPI Integration | Alerting platforms | Automation tooling | Dashboard Development | Python401k contribution | Coaching platform access | Digital reimbursement | Disability insurance | Education allowanceSenior-level Full TimeUnited States of America R19h ago
-
Security Software Engineer, AI & Automation USD 127K-207KAWS | Agent systems | Authentication | Authorization | Caching401k match | Cell phone stipend | Co-working Space Subsidy | Dental insurance | Employee resource groupsMid-level Full TimeNerdWallet US R19h ago
-
AWS | Automation | Bash | Containerization | Continuous DeliveryHealth insurance | Paid leave | RetirementMid-level Full TimeAurora, CO; Chantilly, VA; Herndon, VA21h ago
-
Security Engineer, AI Vulnerability Management USD 122K-185KAPI | AWS | Automation | CI/CD | CVSS100 percent paid health insurance | 401k matching | Employer-paid disability insurance | Employer-paid life insurance | Fertility benefitsSenior-level Full TimeMenlo Park, CA21h ago
-
Sr. System Administrator / System Engineer - Linux USD 105K-135KAuthentication | CentOS | JBoss | JSON | LinuxFlexible schedule | On-call supportSenior-level Full TimeFort Meade, MD22h ago
-
Database Administrator II USD 100K-170KBackup and Recovery | Bash | Bucardo | Database Administration | Database MigrationMid-level Full TimeBasking Ridge, New Jersey23h ago
-
Lead Database Administrator USD 165K-200KAWS | Backup and Recovery | Bash | Database Administration | Database performanceSenior-level Full TimeBasking Ridge, New Jersey23h ago
-
Software Developer – Security Code Review USD 92K-140KApplication Security Testing | C# | C++ | CVSS | CWEMid-level Full TimeOrlando, FL23h ago
-
Senior Security Operations Engineer USD 102K-133KAWS | Azure | Cloud Security | Defense in Depth | Detection and Response24/7 on-call rotation | Flexible schedule | Travel for onsite meetings | Virtual first | Work-life balanceSenior-level Full TimeSt. Paul, Minnesota, United States23h ago
-
Senior Security Engineer USD 137K-165KAI | AWS | Application Firewall | Azure | BashHSA employer contribution | Health insurance options | Learning and development stipend | Paid parental leave | Phone and internet allowanceSenior-level Full TimeUS-Remote R23h ago
-
ARM | App Service | Application Insights | Approval Workflows | Artifact managementFlexible lunch schedule | Opportunity to support modernization initiatives | Telework | Work from office with telework optionsMid-level ContractColumbus, United States1d ago
-
Cloud Security Engineer (Secret Clearance) USD 107K-188KAccess Management | Amazon Web Services | Cloud Security | Cloud Security Architecture | Cloud platformMid-level Full TimeArlington/Rosslyn, Virginia, United States; Baltimore, Maryland, …1d ago
-
Manager, Network Security USD 82K-121KAWS CloudFormation | Access Management | Bash | CI/CD | Certificate managementMid-level Full TimeRemote- United States R1d ago