Comments (12)
ofajardo
commented on May 27, 2024
as suggested in the issue template, please include a file (with no sensitive data) so that I can reproduce the issue. If I cannot reproduce the issue I cannot fix it.
from pyreadr.
69hed
commented on May 27, 2024
HEDIEH KARACHI has shared a OneDrive for Business file with you. To view it, click the link below.
<https://deakin365-my.sharepoint.com/personal/hkarachi_deakin_edu_au/Documents/Attachments/tip2020.rda>
[https://r1.res.office365.com/owa/prem/images/dc-generic_20.png]<https://deakin365-my.sharepoint.com/personal/hkarachi_deakin_edu_au/Documents/Attachments/tip2020.rda>
tip2020.rda<https://deakin365-my.sharepoint.com/personal/hkarachi_deakin_edu_au/Documents/Attachments/tip2020.rda>
Thanks for reply. Please find the attached file.
Best,
Hedieh
…![https://r1.res.office365.com/owa/prem/images/dc-generic_20.png]<https://deakin365-my.sharepoint.com/personal/hkarachi_deakin_edu_au/Documents/Attachments/tip2020.rda](https://r1.res.office365.com/owa/prem/images/dc-generic_20.png]<https://deakin365-my.sharepoint.com/personal/hkarachi_deakin_edu_au/Documents/Attachments/tip2020.rda){kind=link}
________________________________
From: Otto Fajardo <[email protected]>
Sent: Thursday, January 28, 2021 6:37 PM
To: ofajardo/pyreadr <[email protected]>
Cc: HEDIEH KARACHI <[email protected]>; Author <[email protected]>
Subject: Re: [ofajardo/pyreadr] it shows me this error LibrdataError: Unable to convert string to the requested encoding (invalid byte sequence) (#64)
as suggested in the issue template, please include a file (with no sensitive data) so that I can reproduce the issue. If I cannot reproduce the issue I cannot fix it.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub<#64 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/ASUA2CX3M2LBZKK56EQ4ZM3S4EH4TANCNFSM4WWGP7UQ>.
from pyreadr.
69hed
commented on May 27, 2024
To view tip2020.rda, sign in<https://deakin365-my.sharepoint.com/personal/hkarachi_deakin_edu_au/_layouts/15/acceptinvite.aspx?invitation=%7B330CED30%2D1D78%2D461C%2D81A5%2D189B24317B79%7D&listId=a28ef285%2D83ed%2D45e2%2Da8ba%2De99882217f27&itemId=d7417c06%2Dc171%2D467f%2D9eb7%2Db5b988867010> or create an account.
from pyreadr.
ofajardo
commented on May 27, 2024
I can't access the file, it gives me an error. Please zip it and drag and drop here directly.
from pyreadr.
69hed
commented on May 27, 2024
To view rdaFile.zip, sign in<https://deakin365-my.sharepoint.com/personal/hkarachi_deakin_edu_au/_layouts/15/acceptinvite.aspx?invitation=%7B515C7C3D%2D7129%2D40A0%2DB162%2DAA719DB1A1B0%7D&listId=a28ef285%2D83ed%2D45e2%2Da8ba%2De99882217f27&itemId=bdd5d20c%2Da6cc%2D4caf%2D9a9d%2D1ef25c0d988d> or create an account.
from pyreadr.
69hed
commented on May 27, 2024
HEDIEH KARACHI has shared a OneDrive for Business file with you. To view it, click the link below.
<https://deakin365-my.sharepoint.com/personal/hkarachi_deakin_edu_au/Documents/Attachments/rdaFile.zip>
[https://r1.res.office365.com/owa/prem/images/dc-zip_20.png]<https://deakin365-my.sharepoint.com/personal/hkarachi_deakin_edu_au/Documents/Attachments/rdaFile.zip>
rdaFile.zip<https://deakin365-my.sharepoint.com/personal/hkarachi_deakin_edu_au/Documents/Attachments/rdaFile.zip>
I hope it works now. As the file is already compressed, when I zip it, it doesn't make it smaller. Let me know if you still can't open it.
Best,
Hedieh
…![https://r1.res.office365.com/owa/prem/images/dc-zip_20.png]<https://deakin365-my.sharepoint.com/personal/hkarachi_deakin_edu_au/Documents/Attachments/rdaFile.zip](https://r1.res.office365.com/owa/prem/images/dc-zip_20.png]<https://deakin365-my.sharepoint.com/personal/hkarachi_deakin_edu_au/Documents/Attachments/rdaFile.zip){kind=link}
________________________________
From: Otto Fajardo <[email protected]>
Sent: Thursday, January 28, 2021 7:17 PM
To: ofajardo/pyreadr <[email protected]>
Cc: HEDIEH KARACHI <[email protected]>; Author <[email protected]>
Subject: Re: [ofajardo/pyreadr] it shows me this error LibrdataError: Unable to convert string to the requested encoding (invalid byte sequence) (#64)
I can't access the file, it gives me an error. Please zip it and drag and drop here directly.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub<#64 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/ASUA2CVGQG6EALEKNHIF7I3S4EMR3ANCNFSM4WWGP7UQ>.
from pyreadr.
ofajardo
commented on May 27, 2024
After signing in it keeps me giving a permission denied error. Please attach the file here in github (you need to zip it not to reduce the size, but because github accepts zip files) or look for another way to share it.
from pyreadr.
69hed
commented on May 27, 2024
Hopefully you can access the file now. I couldn't share in github, as the file is bigger than 10mb.
https://www.dropbox.com/s/650m9kxkb8dzglw/tip2020.rda.zip?dl=0
[https://www.dropbox.com/static/images/spectrum-icons/generated/content/content-zip-large.png]<https://www.dropbox.com/s/650m9kxkb8dzglw/tip2020.rda.zip?dl=0>
tip2020.rda.zip<https://www.dropbox.com/s/650m9kxkb8dzglw/tip2020.rda.zip?dl=0>
Shared with Dropbox
www.dropbox.com
…![https://www.dropbox.com/static/images/spectrum-icons/generated/content/content-zip-large.png]<https://www.dropbox.com/s/650m9kxkb8dzglw/tip2020.rda.zip?dl=0](https://www.dropbox.com/static/images/spectrum-icons/generated/content/content-zip-large.png]<https://www.dropbox.com/s/650m9kxkb8dzglw/tip2020.rda.zip?dl=0){kind=link}
________________________________
From: Otto Fajardo <[email protected]>
Sent: Saturday, January 30, 2021 12:18 AM
To: ofajardo/pyreadr <[email protected]>
Cc: HEDIEH KARACHI <[email protected]>; Author <[email protected]>
Subject: Re: [ofajardo/pyreadr] it shows me this error LibrdataError: Unable to convert string to the requested encoding (invalid byte sequence) (#64)
Reopened #64<#64>.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub<#64 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/ASUA2CWHV6MUHDUWESMEU7DS4KYQ5ANCNFSM4WWGP7UQ>.
from pyreadr.
ofajardo
commented on May 27, 2024
I managed to download the file and reproduce the error. Reading the first bytes of the file I got this:
b'RDX3\nX\n\x00\x00\x00\x03\x00\x03\x06\x01\x00\x03\x05\x00\x00\x00\x00\x06CP1252\x00'
I think CP1252 is the encoding, meaning Windows-1252. Right now as indicated in the Known limitations section of the README of this repo, pyreadr does not support other encodings different from UTF-8.
Cannot read RData or rds files in encodings other than utf-8.
That means this file is not supported.
This limitation comes from the C backend librdata. Looking at the C source code I have the feeling the error message should be different, so I am going to make an issue there for them to take a look. I will also ask if other encodings could be supported. It may come at some point in the future.
If you have control over the generation of the rda files, then try saving them with utf-8 encoding.
from pyreadr.
69hed
commented on May 27, 2024
Thanks so much for your help. I really appreciate it.
Best,
Hedieh
…________________________________
From: Otto Fajardo <[email protected]>
Sent: Monday, February 1, 2021 7:51 PM
To: ofajardo/pyreadr <[email protected]>
Cc: HEDIEH KARACHI <[email protected]>; Author <[email protected]>
Subject: Re: [ofajardo/pyreadr] it shows me this error LibrdataError: Unable to convert string to the requested encoding (invalid byte sequence) (#64)
I managed to download the file and reproduce the error. Reading the first bytes of the file I got this:
b'RDX3\nX\n\x00\x00\x00\x03\x00\x03\x06\x01\x00\x03\x05\x00\x00\x00\x00\x06**CP1252**\x00'
I think CP1252 is the encoding, meaning Windows-1252. Right now as indicated in the Known limitations section, pyreadr does not support other encodings different from UTF-8.
Cannot read RData or rds files in encodings other than utf-8.
That means this file is not supported.
This limitation comes from the C backend librdata. Looking at the C source code I have the feeling the error message should be different, so I am going to make an issue there for them to take a look. I will also ask if other encodings could be supported. It may come at some point in the future.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub<#64 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/ASUA2CQRKWJHA55BNJKQV3TS4ZTSFANCNFSM4WWGP7UQ>.
from pyreadr.
ofajardo
commented on May 27, 2024
@69hed could you please share the file again? It has been deleted from dropbox.
from pyreadr.
ofajardo
commented on May 27, 2024
@69hed recovered the file and hosted it here: https://github.com/ofajardo/readstat_test_files/blob/master/tip2020.rda for easier sharing with librdata people, who is looking at it.
from pyreadr.
Related Issues (20)
- Unable to allocate memory HOT 1
- index of pandas dataframe is lost when writing to Rds HOT 2
- fail to run tests due to missing import pyreadr HOT 5
- Allow Python 3's pathlib.Path as an alternative to str HOT 2
- ImportError: DLL load failed while importing librdata: Can't find the specified module. HOT 39
- Support for row_offset and row_limit ? HOT 2
- ModuleNotFoundError: No module named 'pyreadr.librdata' HOT 16
- Installation problem on MacOS 12.1 (m1max chip) with python 3.8. HOT 14
- LibrdataError: The file contains an unrecognized object HOT 1
- Invalid file, or file has unsupported features HOT 1
- Usage of - df1 = result["df1"] # extract the pandas data frame for object df1
- DLL load failed while importing librdata: The specified module could not be found. HOT 3
- Error: Unable to load time variables with missing values in python using pyreadr package from RData file HOT 2
- Integer datatypes with missing values changes to object in python using pyreadr package, after importing data from RData file HOT 5
- Wheel building on MacOS arm64 HOT 9
- Wheels for Python 3.11 HOT 4
- save multiple df at once in pyreadr.write_rdata HOT 1
- A string file path was read as bytes in pyreadr.read_r() HOT 5
- Error during installation of pyreadr using pip HOT 3
- pyreadr.custom_errors.LibrdataError: Unable to read from file for large RDS files HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pyreadr.