Databricks Architect Job at Pi-Square Technologies LLC, City, NV

bGdIVHR4NExHK1V5K0RBd2RNcll1WCttdEE9PQ==
  • Pi-Square Technologies LLC
  • City, NV

Job Description

Job Description:

We are seeking a skilled and experienced Cloud Azure Databricks Architect to join our dynamic team. The ideal candidate will have extensive experience in building, managing, and optimizing data pipelines and solutions on Azure Databricks. They should also possess strong expertise in PySpark, Python, SQL, Unity Catalog, and excellent communication skills.

Key Responsibilities:

  • Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
  • Implement and manage Unity Catalog for data governance, access control, and metadata management.
  • Create naming standards, guidelines, practical design patterns and frameworks for data processing.
  • Optimize data pipelines for performance, scalability, and cost-effectiveness.
  • Create documentation for data workflows, processes, and solutions.
  • Communicate effectively with stakeholders to provide project updates and insights.
  • Microservices & API Design: Experienced in designing scalable, loosely coupled architectures.
  • Data & AI Strategy: Skilled in integrating data management and AI/ML components into architectural designs.

Required Skills and Qualifications:

  • 10+ years of experience in data engineering or a related field.
  • Strong hands-on experience with Azure Databricks and other Azure native services including Purview, Synapse and Power BI.
  • Proficiency in PySpark and Python for large-scale data processing.
  • Experience with Unity Catalog for managing data governance and access control.
  • Understanding of data modelling concepts and ETL/ELT workflows.
  • Excellent problem-solving and analytical skills.
  • Strong communication skills, both written and verbal, to collaborate with technical and non-technical stakeholders.

Pi-square technologies is a Michigan (USA) Headquartered Automotive Embedded Engineering Services company, Synergy Partner for major OEMs and Tier 1s and their implementation partners in Automotive Embedded Product Development, Projects, Requirements Analysis, Software Design, Software Implementation, Efficient Build, Release Process, and turnkey software V & V Services. We have more than 20+ years of industry expertise with specialization in the latest cutting-edge automotive technologies such as Infotainment, connected vehicles, Cyber security, OTA, and Advanced Safety/ Body electronics.

Job Tags

Full time, Contract work, Internship,

Similar Jobs

PlayCore

Graphic Design Marketing Intern Job at PlayCore

 ...Essential Duties and Responsibilities Serve in a graphic design support role to the PlayCore Marketing Team to generate graphics as...  ...opportunities to enhance graphic design experience and growth. Intern will gain experience in producing a project from start to finish... 

Cynet Health

Travel Electrophysiology Tech - $2,479 per week in Greensboro, NC Job at Cynet Health

 ...verification through a third party required; certain schools on the Florida Education Audit list not accepted. - No open cases in background check allowed. - COVID-19 and flu vaccines are required, with medical/religious exemptions only. - Non-billable modules,... 

ROCS Grad Staffing

Call Center Representative Job at ROCS Grad Staffing

 ...Job Summary: As a Call Center Representative, you will serve as the first point of contact for customers, providing exceptional customer service through phone, email, or chat. You will be responsible for addressing inquiries, resolving complaints, processing orders,... 

LocumJobsOnline

Nurse Practitioner (NP) - Urology in New Mexico, NM Job at LocumJobsOnline

 ...Connections to find a qualified Urology NP in New Mexico, New Mexico, 87196! About The Position NEW MEXICO - Nurse Practitioner with 2+ Years Surgical Experience Needed...  ...experience with an active New Mexico license. New graduate Nurse Practitioners with surgical RN... 

USAA

Customer Service Advisor Job at USAA

 ...or other contacts from members. Apply developing knowledge of personal lines' insurance to assist members with foundational to moderately complex quotes, binding new business, rating, policy, billing, payment, underwriting, contract and coverage provisions, and...