Skills

Python Unity SQL Big Data Data Governance Data Engineering Apache Spark Encryption CI/CD DevOps Version Control Azure Data Factory Architecture Machine Learning Scikit-Learn TensorFlow Programming apache Organization Azure Agile Analytics Spark r programming CI/CD Pipelines Databricks

Job Specifications

Job Title: Databricks Engineer

Location : Austin Texas

Work Type: Remote Work within Texas ONLY

Duration: 12 Months of Contract

Certificates :

Databricks Certified Associate Developer for Apache Spark - Must

Azure Data Engineer Associate - Must

Job Description:

The Worker is responsible for developing, maintaining, and optimizing big data solutions using the Databricks Unified Analytics Platform.

This role supports data engineering, machine learning, and analytics initiatives within this organization that relies on large-scale data processing.

Duties include:

Designing and developing scalable data pipelines

Implementing ETL/ELT workflows

Optimizing Spark jobs

Integrating with Azure Data Factory

Automating deployments

Collaborating with cross-functional teams

Ensuring data quality, governance, and security.

Required Skills and Qualifications:

Implement ETL/ELT workflows for both structured and unstructured data

Automate deployments using CI/CD tools

Collaborate with cross-functional teams including data scientists, analysts, and stakeholders

Design and maintain data models, schemas, and database structures to support analytical and operational use cases

Evaluate and implement appropriate data storage solutions, including data lakes (Azure Data Lake Storage) and data warehouses

Implement data validation and quality checks to ensure accuracy and consistency

Contribute to data governance initiatives, including metadata management, data lineage, and data cataloging

Implement data security measures, including encryption, access controls, and auditing; ensure compliance with regulations and best practices

Proficiency in Python and R programming languages

Strong SQL querying and data manipulation skills

Experience with Azure cloud platform

Experience with DevOps, CI/CD pipelines, and version control systems

Working in agile, multicultural environments

Strong troubleshooting and debugging capabilities

Design and develop scalable data pipelines using Apache Spark on Databricks

Optimize Spark jobs for performance and cost-efficiency

Integrate Databricks solutions with cloud services (Azure Data Factory)

Ensure data quality, governance, and security using Unity Catalog or Delta Lake

Deep understanding of Apache Spark architecture, RDDs, DataFrames, and Spark SQL

Hands-on experience with Databricks notebooks, clusters, jobs, and Delta Lake

Knowledge of ML libraries (MLflow, Scikit-learn, TensorFlow)

Databricks Certified Associate Developer for Apache Spark

Azure Data Engineer Associate

Vishal (Victor) Verma | Assistant Manager

vishal@nsitsolutions.com

NS IT Solutions

www.nsitsolutions.com

About the Company

ADN Telecom Ltd, the leading ISP, MPLS, IPLC, and IP Telephony service provider in Bangladesh, initiated its glorious journey back in 2003. It is one of the major sister concerns of “ADN Group” along with ADN Technologies Ltd, Tech Valley Networks Ltd (TVNL), InGen Technologies Ltd, and ADN EduServices Ltd. ADN Telecom was launched as a Private Limited Company and designated as the ‘Advanced Data Networks System Ltd.’ till 2012. From 2013, ADN Telecom Ltd. is marching ahead with glory with the current title. Besides offering... Know more

Related Jobs

Company Name: Specialized Recruiting Group - Edina, MN
Job Title: Databricks Developer

Company Name: Apptad
Job Title: Data Architect (Databricks, Azure data and data concepts)

Atlanta, United states

Hybrid

Freelance

04-02-2026