Comments (2)
emcastillo
commented on July 16, 2024
1
I will take care of this
from pytorch-pfn-extras.
kmaehashi
commented on July 16, 2024
Thank you for your contirbution!
It would be good to have LazyBatchNorm instead of having LazyBatchNorm*d-s since lazy ones know its desired shapes. Any thoughts?
I feel explicitness is one of the PyTorch's philosophy because they provide BatchNormXd (X=1,2,3) even though everything is implemented in hidden _BatchNorm class. https://pytorch.org/docs/master/_modules/torch/nn/modules/batchnorm.html
I think it's better to do as the Romans do.
Separate LazyBatchNormXd implementation will also make users easier to migrate from PPE's lazy implementation to PyTorch's upstream lazy implementation, which is under proposal in pytorch/pytorch#40493
from pytorch-pfn-extras.
Related Issues (20)
- Use `PPE` instead of `pytorch_pfn_extras` for profiler key
- Revert onnxruntime version fixing after new fix release
- Support PyTorch 2.1 HOT 1
- Support Min/Max in report summaries
- Automatic determination of train_len for IteratorDataset
- Saving of trigger state in MicroAverage Extension
- Adding pytest in an MPI environment
- Upgrade ubuntu version of CI execution environment
- Option argument is not applied during Logic initialization
- Distribute wheel HOT 2
- Custom function extension HOT 1
- Make `Logic._forward()` method a public method
- `torch.distributed` with single process
- Custom function trigger
- `snapshot_on_error` in `DistributedSnapshot`
- Fix nightly CPU test failures HOT 2
- Flaky test
- Fix nightly cpu test
- Add manager._start_time to state_dict HOT 1
- Append mode Chrome Tracing profiler
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pytorch-pfn-extras.