- Company Name
- Quantum Health
- Job Title
- Data Engineer
- Job Description
-
Job Title: Data Engineer
Role Summary: Design, construct, and maintain scalable data pipelines to ingest, transform, and deliver terabytes of structured and unstructured healthcare data across enterprise systems. Operationalize data science findings into production-ready services that support analytics, reporting, and core product experiences.
Expectations: Minimum 2 years in a data‑engineering or ETL role; strong proficiency in Python, Apache Spark, and Azure Databricks; experience with relational databases, JSON/XML, and REST APIs. Demonstrated ability to collaborate with data architects, cross‑functional teams, and communicate complex technical concepts clearly. Must adhere to data security, privacy, and ethical handling standards.
Key Responsibilities:
- Build and maintain scalable ETL/ELT workflows using Azure Databricks, Apache Spark, and related tools.
- Transform, validate, and optimize structured and semi‑structured data for analytic and operational use.
- Manage data storage and retrieval across platforms such as Databricks, Elasticsearch, PostgreSQL, and Azure Synapse.
- Collaborate with data architects, product, and analytics teams to define data solutions and support evolving requirements.
- Operationalize data science pipelines into robust, production‑ready services.
- Mentor peers and contribute to continuous improvement of data engineering practices.
Required Skills:
- Python, SQL, Apache Spark, Azure Databricks
- Data modeling, relational database design, and transformation best practices
- Experience with JSON/XML, REST APIs, and semi‑structured data processing
- Knowledge of Azure ecosystem (Databricks, Synapse, Data Lake)
- Familiarity with Elasticsearch is a plus
- Strong communication, teamwork, and problem‑solving abilities
Required Education & Certifications:
- Bachelor’s degree in Computer Science, Engineering, Mathematics, Statistics, or related field (or equivalent experience).
- Relevant certifications (e.g., Azure Data Engineer Associate) preferred but not mandatory.