Job Title: DataBricks Administrator
Location: Onsite, Cincinnati, OH
Job Summary:
The DataBricks Administrator will be responsible for the administration, management, and optimization of Azure Databricks workspaces, ensuring high availability, performance, and cost efficiency. This role includes managing security and compliance, optimizing performance, automating deployments, and collaborating with data teams to support data pipelines and analytics workloads.
Key Responsibilities:
• Azure Databricks Administration & Management:
◦ Deploy, configure, and manage Azure Databricks workspaces efficiently and securely.
◦ Administer clusters, jobs, notebooks, and workflows, ensuring high availability and performance.
◦ Optimize compute resource utilization and autoscaling strategies to improve cost efficiency.
◦ Manage Databricks Runtime versions, libraries, and dependencies.
• Security & Compliance:
◦ Implement and manage Unity Catalog for access control and data governance.
◦ Enforce Role-Based Access Control (RBAC) and integrate with Azure Active Directory (AAD).
◦ Ensure compliance with SOC 2, HIPAA, GDPR, and internal security standards.
◦ Set up audit logging, monitoring, and alerting for operational and security insights.
• Performance Optimization & Troubleshooting:
◦ Tune Apache Spark workloads to improve query performance and resource efficiency.
◦ Analyze and troubleshoot performance bottlenecks in ETL and ML workloads.
◦ Optimize Delta Lake storage, caching, and indexing strategies.
• Automation & Infrastructure as Code (IaC):
◦ Automate Databricks workspace deployment using Terraform, ARM Templates, or REST API.
◦ Develop and maintain CI/CD pipelines for job deployment and configuration management.
◦ Implement monitoring solutions using Azure Monitor, Prometheus, or Grafana.
• Collaboration & Integration:
◦ Work with data engineers, data scientists, and DevOps teams to support data pipelines.
◦ Integrate Databricks with Azure Data Lake, Synapse Analytics, and Snowflake.
◦ Provide technical guidance for efficient Spark job execution and cost optimization.
Required Skills & Experience:
• 5+ years of experience in Azure Databricks administration and performance optimization.
• Expertise in Apache Spark, PySpark, SQL, and Scala.
• Hands-on experience with Databricks Unity Catalog, Delta Lake, and MLflow.
• Strong knowledge of Azure cloud services (Azure Data Lake, Synapse, Key Vault).
• Experience in Infrastructure as Code (Terraform, Bicep, or ARM Templates).
• Proficiency in CI/CD automation using Azure DevOps, GitHub Actions, or Jenkins.
• Strong understanding of network security, identity management (AAD), and encryption.
• Excellent problem-solving and troubleshooting skills.
• Strong communication and documentation skills.
Preferred Qualifications:
• Databricks Certified Associate or Professional certification.
• Experience with Azure Kubernetes Service (AKS) and serverless computing.
• Familiarity with Kafka, Apache Airflow, and event-driven architectures.
• Knowledge of Python, PowerShell, or Bash scripting for automation.
...of Travel Trailers & 5th Wheels directly from manufacturers to dealerships. We are recognized as the premier experts in our field, operating across the US and Canada. We are seeking exceptional drivers who own their pickup trucks or semis to join our ranks and embark on...
...Delivery Truck Driver, CDL Class A at Performance Foodservice summary: As a Delivery Truck Driver with a CDL Class A, you will be responsible for safely delivering food and food-related products to various customers in a timely manner. You will interact professionally...
...Skincare, Astrology, Plants, etc. ~&##129496; &##128178; Wellbeing: Vouchers have access to many wellbeing perks, including Calm, Peloton, Headspace, Fetch, OneMedical, SoFi, etc. ~&##128202; Annual performance reviews with quarterly check-ins: Vouch conducts...
...Our delivery drivers are the best and make the most! NOW HIRING IMMEDIATELY Full time or part time Day shift, night shift, weekday and weekend shifts available Our drivers deliver smiles by supporting our local businesses and communities Join Pizza Royalty!...
Job Title: Chaplain- GCMC Location: Scranton, Pennsylvania Job Category: Patient Support, Nursing and Nursing Support Schedule: Evenings Work Type: Full time Department: Spiritual Care Team Date Posted: 02/05/2025 Job ID: R-64740 Job Summary Offers spiritual and emotional...