https://http://www.dlai.dev Last 10 notes on Yet Another AI Blog Quartz -- quartz.jzhao.xyz https://http://www.dlai.dev/ https://http://www.dlai.dev/ AI Engineering and Inference Optimization Specialist Tue, 26 May 2026 16:06:19 GMT https://http://www.dlai.dev/tools/ https://http://www.dlai.dev/tools/ Hands-on tools for understanding GPU programming and AI optimization Tue, 26 May 2026 16:06:19 GMT https://http://www.dlai.dev/2026-05-26-khoj-cli-hermes-research-reflex https://http://www.dlai.dev/2026-05-26-khoj-cli-hermes-research-reflex How a small Exa-powered terminal search tool becomes much more useful when wrapped as a Hermes skill. Tue, 26 May 2026 00:00:00 GMT https://http://www.dlai.dev/2026-04-09-qwen35a3b-r9700-rocm-vllm https://http://www.dlai.dev/2026-04-09-qwen35a3b-r9700-rocm-vllm Benchmark notes from dual-R9700 ROCm inference: good warm throughput, decent TTFT, and a tensor-parallel path that still likes to explode under stress. Thu, 09 Apr 2026 00:00:00 GMT https://http://www.dlai.dev/2025-12-20-llm-kernel-optimization https://http://www.dlai.dev/2025-12-20-llm-kernel-optimization A technical discussion of how large language models can speed up GPU kernel optimization, from research ideas to production kernels. Sat, 20 Dec 2025 00:00:00 GMT https://http://www.dlai.dev/2025-06-22-linear-layouts https://http://www.dlai.dev/2025-06-22-linear-layouts Exploring the concept of linear layouts in Triton, a programming language for writing high-performance GPU code, and how it simplifies memory management and data access patterns. Sun, 22 Jun 2025 00:00:00 GMT https://http://www.dlai.dev/2025-05-26-torch-inductor https://http://www.dlai.dev/2025-05-26-torch-inductor PyTorch 2.x Backends The Great ML Framework Debate Centuries ago (2020), I contributed to PyTorch library, specifically, TorchServe which used to be the default model serving library for PyTorch Models. Mon, 26 May 2025 00:00:00 GMT https://http://www.dlai.dev/2025-05-17-cuda-basics https://http://www.dlai.dev/2025-05-17-cuda-basics An in-depth exploration of CUDA configurations and their impact on thread/block patterns for optimal performance Sat, 17 May 2025 00:00:00 GMT https://http://www.dlai.dev/2025-05-17-cuda-visualizer https://http://www.dlai.dev/2025-05-17-cuda-visualizer CUDA Thread/Block Visualizer This interactive tool helps you understand how different thread and block configurations affect GPU execution patterns. Sat, 17 May 2025 00:00:00 GMT https://http://www.dlai.dev/tools/cuda-visualizer https://http://www.dlai.dev/tools/cuda-visualizer CUDA Thread/Block Visualizer This interactive tool helps you understand how different thread and block configurations affect GPU execution patterns. Sat, 17 May 2025 00:00:00 GMT