Documentation for pl.LightningModule that includes many nn.Modules about pytorch_memlab HOT 6 OPEN

Here is an example:

https://colab.research.google.com/github/PytorchLightning/pytorch-lightning/blob/master/notebooks/01-mnist-hello-world.ipynb

In my code (not the colab above, but a similar style), I don't OOM when I create the model. I OOM when I run

trainer.fit(model)

How do I memory profile why I OOM?

from pytorch_memlab.

THX for reporting. I'll investigate the integration with pytorch lightning in this weekend.

But in principle, the only thing need to be done is to add the forward function into the line_profiler.

from pytorch_memlab.

It looks like our current implementation cannot profiling the detailed memory usage inside nn.Module. However you can work this around by simply defining a dummy container Module like:

class Net(pl.Module):
    def __init__(self):
        super().__init__()
        self.conv1 = nn.Conv1D(xxx)
    @profile
    def forward(self, input):
        out = self.conv1(input)
        return out

from pytorch_memlab.

@Stonesjtu if I have an nn.Module that contains other nn.Modules (which in turn contain other nn.Modules), do I add @Profile decorator to all nn.Modules to see what is happening? Thank you for the help.

from pytorch_memlab.

A common workflow is to profile top-down. Usually 2 or 3 profile should give you an overall memory consumption statistics.

from pytorch_memlab.

@Stonesjtu wanted to ping on this issue to see if there is a better way to use memlab with lightning now.

from pytorch_memlab.