Job Specifications
We're hiring a Senior Server Administrator to join our client’s AI Engineering team. This role is pivotal in deploying, maintaining, and optimizing high-performance computing infrastructure leveraging NVIDIA GPU technologies. You will collaborate with AI researchers, data scientists, and software engineers to ensure systems are robust, scalable, and tuned for cutting-edge machine learning workloads.
Job Title: Senior Server Administrator
Location: Chicago/ Peoria, Cary, Phoenix
Contract: 12 Months
Work Environment: Hybrid: 1 day/week onsite, transitioning to 5 days/week onsite when notified.
Hourly Rate: $70-75 (W2)
Key Responsibilities:
Administer and maintain GPU-accelerated servers and clusters (NVIDIA A100, H100, etc.).
Manage and optimize NVIDIA software stack (CUDA, cuDNN, TensorRT, NCCL, NGC containers).
Monitor system performance, troubleshoot issues, and ensure high availability.
Support containerized workflows (Docker, Kubernetes) and distributed training environments.
Implement security best practices and compliance standards.
Lead upgrades, patching, and lifecycle management of GPU servers.
Provide documentation, automation scripts, and training for internal teams.
What We’re Looking For:
Bachelor’s Degree with 8+ years of experience, including 5+ years in server administration and 3+ years with NVIDIA GPU-based systems.
Strong Linux administration skills in HPC or AI environments.
Hands-on experience with NVIDIA GPU drivers, CUDA toolkit, and performance tuning.
Familiarity with Slurm, Kubernetes, and orchestration tools.
Experience with monitoring tools (Prometheus, Grafana) and automation (Ansible, Terraform).
Strong scripting skills (Bash, Python).
Strong expertise in:
NVIDIA Certified Professional or similar credentials.
Experience with multi-GPU/multi-node training setups.
Familiarity with AI/ML frameworks (PyTorch, TensorFlow).
Exposure to cloud-based GPU infrastructure (AWS, Azure, GCP).
About us:
Harvey Nash is a national, full-service talent management firm specializing in technology positions. Our company was founded with a mission to serve as the talent partner of choice for the information technology industry.
Our company vision has led us to incredible growth and success in a relatively short period of time and continues to guide us today. We are committed to operating with the highest possible standards of honesty, integrity, and a passionate commitment to our clients, consultants, and employees.
We are part of Nash Squared Group, a global professional services organization with over forty offices worldwide.
For more information, please visit us at https://www.harveynashusa.com/
Harvey Nash will provide benefits please review: 2025 Benefits -- Corporate
Regards,
Phani Pinisetty
phani.pinisetty@harveynash.com
About the Company
We’re Harvey Nash, and we build amazing technology and digital teams. From senior appointments through to recruitment and project solutions, we are experts in the tech sector.
Established in 1988, we have helped over half the world’s leading companies recruit, retain, source and manage the highly skilled tech talent they need to succeed in an increasingly competitive, global and technology driven world.
With over 3.300 staff in more than 49 offices across Europe, Asia-Pacific and the U.S and Canada, we have built a rep...
Know more