CUDA Micro-benchmark Series (Part 2): Exploring how to benchmark ultimate GPU compute and bandwidth, understanding Memory Consistency, and mastering PTX inline assembly and Hopper (H100) TMA/WGMMA asynchronous features.
CUDA Micro-benchmark Series (Part 1): An in-depth exploration of CUDA compilation workflows, binary analysis tools, GPU Warp scheduling mechanisms, and how to conduct deep performance and stall profiling using Nsight Compute.
A deep dive into the frontier of mathematical LLMs: from the current SFT and GRPO recipes, to the introduction of formal mathematics (Lean), dissecting the AlphaProof workflow, symbolic reasoning pruning (LIPS), and the evaluation challenges in autoformalization.
A comprehensive deep dive into Tool Agents: from Toolken vocabulary injection and CodeAct execution, to DocPrompting, Toolformer self-learning, visual Set-of-Mark grounding, and autonomous environment exploration.
A comprehensive deep dive into Coding Agents, detailing fine-grained evaluation benchmarks (SWE-bench, LiveCodeBench), agentic frameworks (SWE-agent vs. Agentless), and the sophisticated mechanisms of code localization, code efficiency, and LLM safety.
From the definition of Agents and Language Agents and their three generations, through memory (episodic/semantic/procedural, RAG, HippoRAG), reasoning (ReAct interleaved with action), and planning (reactive, tree search, world models, WebDreamer), to a unified picture and the Bitter Lesson.
