- Company Name
- Nifty Tech Inc
- Job Title
- Lead Big Data with openshift
- Job Description
-
Job title: Lead Big Data with OpenShift
Role Summary:
Contract senior engineer responsible for designing, deploying, and managing end‑to‑end big data pipelines and analytics workloads on OpenShift. Lead data governance, modeling, and security efforts to deliver scalable, production‑ready solutions that drive business insights.
Expectations:
* Deliver high‑quality, production‑grade data pipelines within agreed timelines.
* Mentor and guide cross‑functional teams to align technical solutions with analytical needs.
* Maintain compliance with data governance, security, and performance standards.
Key Responsibilities:
* Design, develop, and maintain scalable ETL/ELT pipelines and data workflows on OpenShift.
* Build and optimize data models, warehouses, and storage solutions for analytics.
* Lead containerization of big‑data workloads (Spark, Flink, Hadoop, Kafka) using OpenShift.
* Implement and enforce data governance, quality, and security controls.
* Collaborate with data scientists, analysts, and product owners to translate business requirements into technical specifications.
* Monitor system performance, troubleshoot issues, and drive continuous improvement.
* Provide technical leadership, code reviews, and mentorship to junior engineers.
Required Skills:
* Proficiency with big‑data technologies (Spark, Flink, Hadoop, etc.) and OpenShift container orchestration.
* Expertise in ETL, data integration, and data modeling for relational and columnar warehouses.
* Strong SQL and data transformation skills; familiarity with Python or Scala.
* Knowledge of cloud platforms (AWS, Azure, GCP) and their data services.
* Solid understanding of data governance, security, and compliance.
* Leadership, communication, and collaboration skills for cross‑functional engagement.
* Ability to analyze complex datasets and derive actionable insights.
Required Education & Certifications:
* Bachelor’s or Master’s degree in Computer Science, Data Science, Information Systems, or related field.
* Relevant certifications (e.g., Red Hat OpenShift Administrator, AWS Certified Big Data – Specialty, Google Cloud Professional Data Engineer) are a plus.