AI Software Engineer - AI Frameworks
Intel · Posted Nov 6
Semiconductor manufacturing, microprocessors, data center solutions, and artificial intelligence infrastructure
Get a personal compatibility score
Add a resume for personal matches
About the role
Intel's Data Center and AI group is seeking an AI software engineer to design and develop optimizations for high-performance AI serving and training frameworks such as SGLang, vLLM, and PyTorch. The role contributes to Intel's AI framework software stack and helps enable and optimize state-of-the-art solutions for Intel's AI accelerators and next-generation GPUs. The engineer will work on custom GPU kernels, scheduling, memory management, and kernel optimization for production AI workloads.
What you will do
- Design and develop custom GPU kernels for AI framework operations including attention mechanisms, collective operations, and computation primitives to optimize performance on Intel accelerators and GPUs.
- Optimize and enhance framework components including scheduling, memory management, and execution pipeline architecture to improve throughput, latency, and resource utilization.
- Write and integrate high-performance kernels using GPU programming frameworks to maximize throughput and minimize latency.
- Identify and implement optimization opportunities in the framework stack for production AI workloads.
- Collaborate with the open-source community (SGLang, vLLM, PyTorch, and others), participate in upstream development, and integrate new innovations into production software.
- Debug and optimize complex multi-layered systems involving kernel execution, memory hierarchies, and distributed AI scenarios.
Skills used in this role
What the employer is looking for
- Bachelor's degree (B.Tech) or Master's degree (M.S./M.Tech) in Computer Science, Electronics and Communications Engineering (ECE), or a related field, with 6 to 12 years of professional experience.
- Advanced proficiency in C++ (C++14/17) and intermediate skills in Python and parallel programming.
- Proven, hands-on experience writing and optimizing GPU kernels. Demonstrated expertise in kernel development for machine learning operations such as GEMM, attention mechanisms (including Flash Attention), collective operations, and sampling.
- In-depth, hands-on experience with AI frameworks—SGLang, vLLM, PyTorch, or similar production-grade serving and training systems. Deep understanding of their internal architecture, scheduling mechanisms, and memory management strategies is essential.
- Strong knowledge of AI inference and training concepts including batching strategies, memory optimization, distributed execution, and performance tuning.
- Practical experience optimizing and deploying AI models at scale in production environments.
- Strong ability to debug complex issues in multi-layered software systems, performance profiling, and bottleneck identification in AI frameworks.
- Solid understanding of computer architecture, GPU execution models, memory hierarchies, and hardware-software co-optimization techniques.
- Experience working on frameworks and platforms that have been deployed to production with high availability and performance requirements.
- Excellent communication skills and experience collaborating with cross-functional, geographically distributed teams.
Preferred qualifications
- Extensive experience developing production-grade kernels with CUDA, CUTLASS, or Triton for various AI operations.
- Published or open-source contributions demonstrating kernel optimization expertise.
- Knowledge of compiler algorithms for heterogeneous systems and kernel fusion optimizations.
- Contributions to or deep familiarity with SGLang, vLLM, PyTorch, or other open-source AI frameworks.
- Experience with distributed AI workloads, multi-GPU scheduling, and optimization across heterogeneous hardware.
- Understanding of quantization techniques, mixed-precision inference and training, and their integration into AI frameworks.
Benefits and support
- Compensation and benefits are detailed in the job posting
About Intel
Intel Corporation is a global technology leader focused on the design and manufacturing of microprocessors, integrated circuits, and advanced data center infrastructure. The company drives innovation across personal computing, artificial intelligence, and cloud ecosystems while operating a major semiconductor foundry business. Intel delivers foundational silicon and packaging solutions that power modern digital infrastructure worldwide.
- Industry
- Semiconductors
- Company size
- 10001+ employees
- Founded
- 1968
- Location
- Santa Clara, California, USA
- Funding stage
- Public Company
Leadership
Lip-Bu Tan
Chief Executive Officer
Executive Vice President and Chief Financial Officer
Pushkar Ranade
Chief Technology Officer and Chief of Staff to the CEO
Executive Vice President – Chief Technology and Operations Officer, General Manager Intel Foundry
Recent coverage
Intel Newsroom
Intel Reports Third-Quarter 2026 Financial Results2026-10-29
Intel Newsroom
Intel to Acquire Classiq to Create a Full-stack Quantum Computing Platform2026-10-26
TradingView
Key facts: Intel shares plunge 29%; Q3 beats; Xeon demand strong2026-11-05