Job Specifications
Job Title: Big Data Engineer
Location: Mississauga ON Hybrid
Duration: 9-12+ months (Possible extension)
Key Responsibilities:
Core Skills:
* Strong solid understanding of the Big Data architecture and the ability to trouble shoot performance and/or development issues on Hadoop (Cloudera preferably)
* Hands-on experience working with Hive, Impala, Kafka, HBase, Spark for data curation/conformance related work.
* Strong proficiency in Spark for development work related to curation/conformance. Strong Scala development (with previous Java background) preferred.
* Experience with Spark/Kafka or equivalent streaming/batch processing and event-based messaging.
* Strong data analysis skills and the ability to slice and dice the data as needed for business reporting.
* Relational SQL (Oracle, SQL Server), NoSQL (MongoDB) and Cache (Couchbase) database integration and data distribution principles experience
* Leadership & Mentorship: Ability to guide and mentor junior developers, fostering a collaborative team environment and promoting professional growth.
* Communication Skills: Strong communication skills, both written and verbal, with the ability to explain complex technical concepts to both technical and non-technical audiences.
* DevOps Practices: Experience working in a Continuous Integration and Continuous Delivery environment and familiarity with tools like Jenkins, TeamCity, SonarQube, OpenShift, ECS, or Kubernetes.
* Software Engineering Principles: Proficient in industry-standard best practices such as Design Patterns, Coding Standards, Coding modularity, and Prototyping.
* Data Visualization: Experience with data visualization tools and techniques for presenting data insights effectively.
* Agile Methodologies: Familiarity with agile development methodologies and experience working in agile and scaled agile teams.
Qualifications:
* 8-12 years of relevant experience in the Big Data Application Development
* Experience as Applications Development Manager
* Experience as senior level in an Applications Development role
* Stakeholder and people management experience
* Demonstrated leadership skills
* Proven project management skills
* Basic knowledge of industry practices and standards
Education:
* Bachelors degree/University degree or equivalent experience
* Masters degree preferred
Other Relevant Skills
Apache Hadoop, Apache Hive, Apache Impala, Apache Kafka, Apache Spark, Big Data, Java, MongoDB, NoSQL, Oracle Database, Python (Programming Language), Relational Database Management System (RDBMS).
This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.
Dexian is a leading provider of staffing, IT, and workforce solutions with over 12,000 employees and 70 locations worldwide. As one of the largest IT staffing companies and the 2nd largest minority-owned staffing company in the U.S., Dexian was formed in 2023 through the merger of DISYS and Signature Consultants. Combining the best elements of its core companies, Dexian's platform connects talent, technology, and organizations to produce game-changing results that help everyone achieve their ambitions and goals.
Dexian's brands include Dexian DISYS, Dexian Signature Consultants, Dexian Government Solutions, Dexian Talent Development and Dexian IT Solutions. Visit https://dexian.com/ to learn more.
Dexian is an Equal Opportunity Employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status.
Note: Dexian Canada will, on request, provide accommodations for disabilities to support your participation in all aspects of our Recruitment and Assessment/Selection Processes.
About the Company
Dexian is a leading provider of staffing, IT, and workforce solutions with nearly 12,000 employees and 70 locations worldwide. As one of the largest IT and professional staffing companies and the 2nd largest minority-owned staffing company in the U.S., Dexian was launched in 2023 and created from the combination of DISYS, Signature Consultants, and other strategic acquisitions.
Dexian fuses the best elements of its legacy companies to create a platform that connects talent, technology, and organizations to produce game-chan...
Know more