Recent Posts

Latency values for programmers in 2024

Latency values are important for modern software. A program usually waits for I/O, another thread to complete a task, or a network request to complete. In a ...

WebAssembly vs. JVM: An Informal Peek

Recently, WebAssembly (WASM) has gained traction as a reference runtime, providing a way to run programs written in different programming languages. However,...

How PyTorch implements DataParallel?

PyTorch can send batches and models to different GPUs automatically with DataParallel(model). How is it possible? I assume you know PyTorch uses dynamic comp...