Specialized Recruiting Group - Edina, MN

www.expresspros.com

1 Job

8 Employees

About the Company

We are a locally-owned recruitment firm who specializes in recruiting and placing individuals in various professional positions. We want to help candidates advance their careers while providing clients with the best person to keep their business growing!

Listed Jobs

Company Name: Specialized Recruiting Group - Edina, MN
Job Title: Databricks Developer
Job Description: Job title: Databricks Developer Role Summary: Design, implement, and maintain end-to-end Databricks CI/CD pipelines and streaming table solutions on Azure. Deliver high-performance, schema‑evolving data pipelines and collaborate with data architects to meet business analytics requirements while ensuring data quality, security, and compliance. Expectations: Deliver robust, automated deployment pipelines, scalable streaming tables, and maintain production‑grade data engineering practices on Azure Databricks for real‑time analytics. Key Responsibilities: - Build, test, and deploy Databricks CI/CD pipelines using Git, YAML, and Azure DevOps or equivalent tooling. - Design and implement streaming tables that support schema evolution and optimization for real‑time analytics workloads. - Plan and manage compute resources, job clusters, and environment changes in Azure Databricks. - Collaborate with data architects and stakeholders to translate data requirements into scalable solutions. - Troubleshoot ingestion, schema, and performance issues in streaming and batch pipelines. - Enforce data quality, security, and compliance across all pipelines and data assets. - Track and document environment changes and pipeline configurations. Required Skills: - Azure cloud computing fundamentals and Databricks expertise. - Proven CI/CD pipeline design and management in Databricks. - Advanced knowledge of streaming table design, schema evolution, and performance tuning. - Strong programming in Python and SQL; familiarity with YAML and GIT. - Experience with data lake architecture and integration of diverse data sources on Azure. - Excellent problem‑solving, communication, and documentation skills. Required Education & Certifications: - Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent work experience). - Minimum 5 years of data engineering experience focused on cloud data solutions.