Understanding GPU Memory 2: Finding and Removing Reference Cycles

Open link in next tab

Understanding GPU Memory 2: Finding and Removing Reference Cycles

https://pytorch.org/blog/understanding-gpu-memory-2/

This is part 2 of the Understanding GPU Memory blog series. Our first post Understanding GPU Memory 1: Visualizing All Allocations over Time shows how to use the memory snapshot tool. In this part, we will use the Memory Snapshot to visualize a GPU memory leak caused by reference cycles, and then locate and remove them in our code using the Reference Cycle Detector.

Understanding GPU Memory 2: Finding and Removing Reference Cycles