How PyTorch implements DataParallel?
PyTorch can send batches and models to different GPUs automatically with DataParallel(model). How is it possible? I assume you know PyTorch uses dynamic comp...
Recent Posts
How to have a data science lab in 13 steps?
TL;DR. You have to be passionate and insane. I would not recommend doing it.
3 steps to start Google Summer of Code with Discourse
Discourse is a wonderful free and open source software for a modern forum. Now it has already powered many projects’ forum. Take a look at where it’s built a...
Take it slow in life
Internet profoundly changes human life. I read a magazine when I was a kid. It says “Everything at your fingertip.” This refers to the internet. It finally b...
Digging in Python iterator and enumerate
When a PyTorch DataLoader repeat its data? Why it’s so magical and impossible to see in its code. It is implemented as an iterator in Python. Pythonic but im...