Comments (12)
I also meet this problem when I transfer a CUDA tensor by float_quantize yesterday, and cannot figure out what made this mistake.
from qpytorch.
hi @ASHWIN2605 and @yhhu99,
sorry to hear this and thank you for letting me know. Would you kindly help try out v0.2.0 to see if you encounter the same issue?
I will look into it in the meantime.
from qpytorch.
hi @ASHWIN2605 and @yhhu99,
sorry to hear this and thank you for letting me know. Would you kindly help try out v0.2.0 to see if you encounter the same issue?
I will look into it in the meantime.
thanks for your reply, but I wonder know that how can I change the version?
from qpytorch.
can you try pip install qtorch==0.2.0
? thank you!
from qpytorch.
can you try
pip install qtorch==0.2.0
? thank you!
I'm sorry that it doesn't work.
from qpytorch.
can you try
pip install qtorch==0.2.0
? thank you!
But when I test this problem in another script, it works well:
from qpytorch.
please downgrade to v2.0.0 for now. I will look into fixing this.
from qpytorch.
unfortunately I cannot replicate the segmentation fault you are seeing. I am on torch v1.8.0 and CUDA11.1.
Not sure if this is due to the difference in our CUDA versions. Can you provide me a minimal example to replicate the issue you are seeing?
Also, maybe try removing the cached compilation and recompile it. For example try rm -rf /tmp/torch_extensions/quant_cuda /tmp/torch_extensions/quant_cpu
(but note that your torch_extensions
might live somewhere else).
from qpytorch.
unfortunately I cannot replicate the segmentation fault you are seeing. I am on torch v1.8.0 and CUDA11.1.
Not sure if this is due to the difference in our CUDA versions. Can you provide me a minimal example to replicate the issue you are seeing?
Also, maybe try removing the cached compilation and recompile it. For example try
rm -rf /tmp/torch_extensions/quant_cuda /tmp/torch_extensions/quant_cpu
(but note that yourtorch_extensions
might live somewhere else).
Thanks for your reply. I had tried the command 'rm -rf ...quant_cuda & quant_cpu', but it didn't work. I make a small example to show the question as below:
And after I run the script on gpu, the 'segmetation fault (core dump)' would occur.
from qpytorch.
Hi,
It was my bad.I didn't update the CUDA version of Pytorch installation to latest 11.0.I had only my NVCC updated in my linux machine to version 11.0 earlier and now after updating the Pytorch CUDA veraion to 11.0,it is working fine without the segmentation fault error.Thank you for the trials you made. @yhhu99 I hope this will help you as well.
from qpytorch.
Hi,
It was my bad.I didn't update the CUDA version of Pytorch installation to latest 11.0.I had only my NVCC updated in my linux machine to version 11.0 earlier and now after updating the Pytorch CUDA veraion to 11.0,it is working fine without the segmentation fault error.Thank you for the trials you made. @yhhu99 I hope this will help you as well.
Thank you! I think I know where the problem is.
from qpytorch.
Closing because this seems to be resolved.
from qpytorch.
Related Issues (20)
- no module named 'quant_cpu' HOT 2
- optim_low breaks if some parameter in the model has None gradient HOT 2
- Question about float quantization HOT 3
- RuntimeError: Error building extension 'quant_cuda' HOT 6
- Problems in Ninjia build HOT 3
- Floatpoint(8,23)flips the input values HOT 4
- About the Speed of Low Precision Training HOT 1
- How to represent integer? HOT 1
- SWALP Example HOT 1
- FixedPoint `symmetric=True` Min Value
- Is there any way to directly convert fp16 tensors to low precision tensors? HOT 2
- Model Export to ONNX dose not work due to quant functions
- Why the gradient scaling factor is multiplied before quantization?
- Code Freezes When Using QPyTorch HOT 9
- 'gbk' codec can't decode
- Rex
- quant_cuda does not compile.
- is there any way to control exponent bias?
- float_quantize at multi-gpu works wrong.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from qpytorch.