- Company Name
- Redslim
- Job Title
- Data Engineer Lead
- Job Description
-
**Job Title**
Data Engineer Lead
**Role Summary**
Lead the design, development, and deployment of scalable, high‑performance data solutions. Oversee a team of engineers, set strategy, and collaborate with stakeholders to translate business objectives into robust data architecture. Champion best practices in data governance, quality, and security while driving continuous innovation on cloud platforms.
**Expactations**
- 6+ years of data engineering experience with 3+ years in technical leadership.
- Proven track record delivering enterprise‑grade pipelines in cloud environments.
- Deep expertise in Python, PySpark, SQL, and modern data platforms (Azure, Databricks, Snowflake, etc.).
- Strong understanding of CI/CD, Azure DevOps, and infrastructure‑as‑code.
- Excellent communication, mentoring, and strategic thinking skills.
- Ability to manage multiple strategic projects simultaneously in a fast‑paced setting.
**Key Responsibilities**
- Architect and implement complex data pipelines and lakehouse solutions.
- Define and execute data engineering strategy aligned with organizational goals.
- Serve as primary technical liaison with clients and cross‑functional teams.
- Report on team performance, resource utilization, and project status to senior leadership.
- Promote data governance, quality, and security standards across the organization.
- Mentor and develop senior and junior engineers, fostering a culture of innovation.
- Evaluate and pilot emerging technologies to enhance platform capabilities.
- Convert business requirements into actionable engineering initiatives.
**Required Skills**
- Python & PySpark (pipeline development, performance tuning).
- SQL, Azure Data Factory, Azure Blob Storage, Azure Functions, Databricks (Delta Lake, Spark SQL, Unity Catalog).
- Experience with Snowflake, Airflow, dbt, or comparable tools.
- CI/CD, Azure DevOps pipelines, and infrastructure‑as‑code (Terraform or ARM).
- Data modelling, warehousing, enterprise architecture, and governance.
- Strong problem‑solving, analytical mindset, and time‑management.
- Outstanding verbal and written communication.
- Leadership, mentoring, and team‑building abilities.
**Required Education & Certifications**
- Bachelor’s or Master’s degree in Computer Science, Information Systems, or related field.
- Professional certifications preferred: Databricks Certified Data Engineer – Professional, Microsoft Certified: Azure Data Engineer Associate.
- Additional certifications in cloud architecture, data warehousing, or CI/CD are a plus.