DataBricks Administrator
A USD 147K-190K (estimate) Mid-level Full Time
Tasks
- Administer Databricks clusters jobs notebooks and workflows
- Automate workspace deployment with Infrastructure as Code
- Deploy and manage Azure Databricks workspaces
- Enforce RBAC and integrate with Azure Active Directory
- Implement CI CD pipelines for Databricks job deployment
- Implement Unity Catalog for access control and data governance
- Implement monitoring with Azure Monitor Prometheus and Grafana
- Integrate Databricks with Azure Data Lake Azure Synapse and Snowflake
- Manage Databricks runtime libraries and dependencies
- Monitor and optimize compute utilization and autoscaling
- Optimize Delta Lake storage caching and indexing
- Set up audit logging monitoring and alerting
- Troubleshoot performance bottlenecks in ETL and ML
- Tune Apache Spark workloads for query performance
Perks/Benefits
Skills/Tech-stack
Active Directory | Apache Spark | Audit Logging | Azure | Azure Active Directory | Azure Data | Azure Data Lake | Azure Databricks | Azure DevOps | Azure Key Vault | Azure Monitor | Azure Resource | Azure Resource Manager | Azure Synapse | Azure Synapse Analytics | Bicep | CI/CD | Data Governance | Data Lake | Databricks Unity Catalog | Delta Lake | GitHub Actions | Grafana | Jenkins | Key Vault | MLflow | Prometheus | PySpark | RBAC | Resource manager | SQL | Scala | Synapse Analytics | Terraform | Unity Catalog
Education
N/A
Related jobs
-
Senior-level Full TimeFairfax, VA, United States12h ago
-
Data Engineer USD 86K-128KData Modeling | Data Pipelines | Data Warehouse | Data integration | Desktop Development401k matching | Disability insurance | Holiday pay | Life insurance | Medical, dental & vision coverageEntry-level Full TimeHuntsville, AL, United States14h ago
-
Cloud infrastructure | Cloud infrastructure (OCI | Database monitoring | Database performance | Database performance tuningCareer development | Coaching | Continued Education | Development & training | Hybrid workMid-level Full TimeKnoxville, TN, United States16h ago
-
Oracle Database Administrator USD 87K-135KAccess Manager | Ansible | Backup and Recovery | Data Extraction Transformation and Loading | Data Migration401k match | Flex Time | Health insurance | Paid Holidays | Paid time offMid-level Full TimeAlexandria, United States16h ago
-
System Administrator USD 80K-106KActive Directory | Air-gapped | Air-gapped environments | Automation | DNS401k match | Dental insurance | Medical insurance | Paid Holidays | Paid time offMid-level Full TimeColumbus, United States16h ago
-
Systems Administrator USD 116K-179KBackup monitoring | Bash | Change Management | Command Line | Command-line Interface401k match | Dental insurance | Flex Time | HSA | Health insuranceSenior-level Full TimeArlington, United States16h ago
-
Lead Windows Server Administrator USD 80K-102KActive Directory | Anti-virus | Backup and Recovery | DHCP | DNSSenior-level Full TimeUnited States-Virginia-Virginia Beach17h ago
-
Web Administrator USD 84K-95KAPI Integration | Access Control | Accessibility | Active Directory | AutomationGrowth and development | Health and wellness programs | Inclusive culture | Medical dental disability benefits | Retirement savings programSenior-level Full TimeAtlanta, GA, US, 3034622h ago
-
Access Control | Active Directory | Agile | Authentication | Cache ManagementSenior-level Full TimeCampus Site, Fairfax, VA, Workplace Type, …1d ago
-
Senior Software Engineer USD 134K-184KC++ | CI/CD | DevOps | Docker | KubernetesOnsite position | Security clearance supportSenior-level Full TimeWoburn, MA1d ago
-
Geospatial Database Administrator (Washington DC) USD 100K-140KArcGIS Enterprise | ArcGIS Portal | ArcGIS Server | C# | Cloud ComputingBonuses | Company-paid training | Flexible work hours | Medical, dental, and vision coverage | Paid time offMid-level Full TimeWashington, DC, US1d ago
-
Database Administrator USD 105K-115KData Transformation | Data Validation | Data extraction | Data integration | Data loadingSenior-level Full TimeSan Diego, CA, US1d ago
-
Senior Windows System Administrator USD 118K-195KActive Directory | Ansible | Backup and Recovery | DHCP | DNSSenior-level Full TimeAustin, TX1d ago
-
Mid-Level or Senior Product Security Engineer USD 162K-276K800-171 | AWS | Agile Framework | Azure | Azure ResourceFlexible spending accounts | Health insurance | Health savings accounts | Life and disability insurance | Paid time offMid-level Full TimeUSA - Everett, WA, United States1d ago
-
Cloud Security Engineer USD 106K-222KAccess Management | Amazon Web Services | Azure Monitor | CIS | CSAHybrid work | On-call rotationSenior-level Full TimeMiramar, United States1d ago
-
Mid-Level or Senior Product Security Engineer USD 162K-276K800-171 | AWS | Azure | Azure Resource | Azure Resource ManagerRelocation assistanceMid-level Full TimeUSA - Everett, WA, United States1d ago
-
API Design | AWS | Amazon Athena | Amazon Redshift | Apache SupersetUK Security ClearanceMid-level Full TimeBristol - Central1d ago
-
Cybersecurity Automation Engineer USD 75K-126KAPI | Authentication | Authorization | CD pipelines | CI/CDMid-level Full TimeUSA - IL (Remote), United States R1d ago
-
Senior Security Engineer II USD 95K-158K800-63 | AWS | AWS Config | AuditBoard | Automated evidenceAnnual incentive bonus | Country-specific benefitsSenior-level Full TimeUSA - Raleigh, NC (RDU), United …1d ago
-
Systems Administrator 4, Engineering Operations USD 225K-360KAPI Integration | AWS | Alerting | Go | Google Workspace401k match | Disability insurance | Family-forming benefits | Flexible spending accounts | Flexible time offSenior-level Full TimeUSA - Remote, United States R1d ago
-
M365 Platform and Security Engineer USD 120K-140KAccess Management | Conditional Access | Data Governance | Data Loss Prevention | Data lossCommunity engagement programs | Generous time off | Health coverage options | Hybrid work setup | Learning and development programsSenior-level Full TimeVentura, CA1d ago
-
API | AWS | Access Control | Ansible | AzureContinuing education | Flexible time off | Healthcare | On-call rotation | Prepaid trainingSenior-level Full TimeBYS CHANTILLY VA, United States1d ago
-
Sr. Info Security Engineer - Cisco ISE USD 119K-140K802.1x | AAA | Access Control | Access Points | Active Directory401k match | Adoption Assistance | Paid Holidays | Paid vacation | Parental leaveSenior-level Full TimeSaint Paul, MN, United States1d ago
-
Lead Firewall Engineer USD 90K-189KActive Directory | Architecture Framework | Certificate revocation | Configuration Management | DOD Architecture FrameworkContinuing education | Flexible time off | Health care | Learning resources | Retirement benefitsSenior-level Full TimeBRB SPRINGFIELD VA, United States1d ago
-
Application development | Cybersecurity | Data Architecture | Data Governance | Data LakeTravel requirementsSenior-level Full TimeSpringfield, IL1d ago