GPU System Engineer
Title: GPU System Engineer Location: Remote 100% Duration: Contract Job Description: We are seeking expert-level GPU Software Engineers to support a high-visibility platform initiative within the Maya program, focused on building software tooling on top of a custom compiler and SDK. The role involves developing, optimizing, and porting GPU kernels and AI workloads to a specialized hardware platform.
Key Responsibilities
Develop high-performance GPU kernels for specialized hardware platforms using PyTorch and Triton frameworks Build software solutions leveraging custom compiler toolchains and SDK capabilities Design and implement kernel-level optimizations to control and improve hardware execution behavior Port and optimize open-source AI/ML models for proprietary or custom SDK environments Adapt and run high-performance computing benchmarks and stress workloads, including: High Performance Linpack (HPL) BERT and similar benchmark-style workloads Develop stress testing and validation workloads aligned with hardware behavior and platform reliability goals Support validation and performance testing for both current and next-generation hardware platforms Collaborate closely with platform architects, compiler teams, and system engineers to enhance end-to-end system performance Core Technical Skills (Must-Have) Programming & Frameworks Strong proficiency in Python Expertise in C/C++ for systems-level programming Hands-on experience with PyTorch Experience with Triton (kernel development and Triton language) GPU & Systems Expertise Mandatory experience in GPU kernel development Strong understanding of GPU architecture and performance optimization techniques Experience with compiler optimizations and runtime execution models Familiarity with custom SDKs and hardware abstraction layers Performance & Workloads Hands-on experience in: GEMM (matrix multiplication) kernel development Porting and optimizing ML models on new/custom hardware platforms System-level performance tuning, benchmarking, and stress testing