- Company Name
- Tenstorrent
- Job Title
- Sr. Engineer, Software - AI Compiler
- Job Description
-
Job Title: Sr. Engineer, Software – AI Compiler
Role Summary:
Lead design, implementation, and optimization of TT-Forge, an MLIR‑based compiler enabling AI workloads on Tenstorrent hardware. Drive development of custom MLIR dialects, transformation passes, and human‑in‑the‑loop tuning tools to support training, inference, and multi‑chip scaling across diverse AI frameworks. Collaborate closely with hardware, firmware, and system teams to integrate low‑level execution backends and expose high‑performance execution paths to developers.
Expectations:
- Deliver production‑ready compiler components that bridge popular ML frameworks (PyTorch, TensorFlow, JAX) to RISC‑V‑based AI chips.
- Reduce latency, memory footprint, and power consumption through advanced graph optimizations and hardware‑aware scheduling.
- Extend MLIR infrastructure to include custom dialects (TTIR, TTNN, TTKernel) and maintain maintainable source code with comprehensive tests and documentation.
- Engage with open‑source community contributions and incorporate external tooling for profiling, debugging, and fine‑grained tuning.
- Mentor junior engineers and provide architectural guidance within the compiler group.
Key Responsibilities:
1. Design and implement MLIR dialects, passes, and optimization pipelines for AI model translation.
2. Build and maintain converters from high‑level frameworks to TT-Forge IR, ensuring correct semantics and optimal performance.
3. Develop compiler backends targeting multi‑chip TT hardware, managing data movement, pipelining, and resource allocation.
4. Create and refine tools for profiling, debugging, and human‑in‑the‑loop tuning (e.g., TT‑Explorer).
5. Collaborate with hardware engineers to expose new ISA features and verify compiler outputs against hardware simulations.
6. Maintain high code quality through automated testing, static analysis, and code reviews.
7. Document compiler architecture, APIs, and tuning guides for internal and open‑source users.
Required Skills:
- Proficiency in C++ (≥ 11) and Python; experience building complex systems bridging high‑level frameworks to low‑level runtimes.
- Deep understanding of compiler theory, IR design, and MLIR framework APIs.
- Practical experience optimizing computational graphs and implementing custom dialects/transformation passes.
- Familiarity with AI frameworks: PyTorch, TensorFlow, JAX, or similar.
- Strong background in systems programming and low‑level hardware interaction (RISC‑V, ASICs, or GPUs).
- Experience with open‑source project management, version control (Git), CI/CD pipelines, and unit/integration testing.
- Excellent problem‑solving, communication, and teamwork skills.
Required Education & Certifications:
- Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, or a related technical field.
- Professional certifications in compiler development, AI/ML engineering, or related domains are a plus.