Show HN: TurboGPT: train 22KiB transformer in 13s
Inspired by minGPT for home experiments.Requires CUDA 13.4; build script is Windows only.
以下正文同步自 Hacker News，版权归原站所有，已转换为易读排版。
Tiny byte-level GPT training in CUDA C++. MIT.
Windows, Visual Studio 2022 C++ tools, and CUDA 13.4:
.\build.ps1 -CudaArch 86
CudaArch is the GPU compute capability from NVIDIA's CUDA GPU list.
.\build\turbogpt.exe --data hn1g.txt --log-to runs/ctx4
The run stores its checkpoint at runs/ctx4/ctx4.pt, containing model, optimizer, scheduler, and trainer state. Use --load CHECKPOINT.pt to resume it.
runs/ctx4/report.json is derived from the log directory. Logs are TensorBoard-compatible: one report per batch, capped at 8Mi reports, and flushed with periodic or final checkpoints.
正文由 探How 从来源站点 RSS 同步，内容未经改写；遇到排版缺失或需要图片、视频时请以原文为准。