Comments (1)
Xia-Weiwen
commented on June 23, 2024
Hi @yangyyt The problem you met was that the quantized model expected quantized tensors as inputs but it got non-quantized inputs. It's probably because you didn't insert QuantStub and DeQuantStub correctly in the model. You may refer to this tutorial for more details and examples.
from pytorch.
Related Issues (20)
- [inductor][cpu]transformers models static/dynamic quant performance/accuracy crash in 2024-06-17 nightly release HOT 1
- version inquiry HOT 1
- Performance degradation for certain input using Conv2D
- Unable to install PyTorch on M1 Macos with Python 3.10.14 HOT 1
- Inquiry Regarding PyTorch Data Mirroring and Proxy Services
- torch.compile graph break with unsupported LOAD_BUILD_CLASS
- torch.Tensor.tolist() cancels torch.round() HOT 1
- torch.compile graph break due to unsupported builtin filter function
- [MAC] Convolution with kernel size 3 yields different results depending on whether gradient is enabled or not. HOT 1
- Memory consumption of conv3d grows too quickly with certain input shapes.
- Parameters out of sync over different ranks due to unused parameters
- Question about torch.lstsq and torch.linalg.lstsq
- [Dynamo] Maybe we shouldn't attempt to recursively compile inside of a frame if the frame hit cache limit
- caffe2 removal HOT 2
- [Dynamo x torch_function] magic methods and methods with regular Tensors don't seem to work HOT 1
- `torch.compile` fails with `fullgraph=True` when accessing `getitem` of a `Tensor` subclass
- RuntimeError: NCCL error: invalid usage when deploy LLM model by vllm. (torch version: 2.3.0+cu118)
- [Dynamo x torch_function] methods on torch_function objects require id_match guards, causing recompiles HOT 3
- Torchrun / torch.distributed.run throws RendezvousConnectionError / DistNetworkError (Connection reset by peer)
- Trying to use forward AD with _scaled_dot_product_flash_attention that does not support it because it has not been implemented yet. HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pytorch.