Comments (8)
Had the same problem, but with an tailing . (dot). Modified parseN to also do a rstrip(b'.'). Works like a charm! Thanks
from dbfread.
It looks like there are two '*' characters at the end of each value. I first thought it might be padding, but '0.00**' and '**' are not the same length.
Could you try to open the file with raw=True and see what you get?
Here's a workaround that might work:
from dbfread import DBF, FieldParser
class AsteriskFieldParser(FieldParser):
def parseN(self, field, value):
value = value.strip().strip('*')
return FieldParser.parseN(self, field, value)
f = DBF('test.dbf', load=True, encoding='latin1',
parserclass=AsteriskFieldParser)
from dbfread.
Thanks for the help. My work around was editing the parseN function in field_parser. I added another replace() to account for the asterisks and replaced them with a 0, resulting in '0.000'. I also tried to replace the majority of the "0.00**" values in the actual dbf files. I realize this could cause problems if a value of "5**", for example, showed up but it appears to have been OK in my use case.
def parseN(self, field, data):
"""Parse numeric field (N)
Returns int, float or None if the field is empty.
"""
try:
return int(data)
except ValueError:
if not data.strip():
return None
else:
# Account for , in numeric fields
return float(data.replace(b',', b'.').replace(b'**', b'0'))
from dbfread.
Why not simply remove the '*' characters? 0.000 is the same as 0.00 after all.
from dbfread.
I'm having this error:
in parseN
return float(data.replace(b',', b'.'))
ValueError: could not convert string to float: b'***********'
from dbfread.
I've added some code to remove the '*' characters in float fields. Could you try my develop branch and see if it works for you?
from dbfread.
In develop branch but adding the same line to parseN too works fine.
In my case the column with problems is a numeric field.
from dbfread.
Ah, sounds good. I've pushed a fix to my develop branch. Thanks for reporting this.
from dbfread.
Related Issues (20)
- error occured when parsing a 'N' type field which is mistakenly defined as ‘C'
- Generalize the --encoding-xlsx input option for other file types in in2csv
- UnicodeEncodeError for special charater HOT 2
- dbfread read hidden rows
- Error parsing dates HOT 1
- Replace test system HOT 1
- Return dict instead of OrderedDict as default from 3.7 and up HOT 1
- Better tests for field parsing HOT 2
- Create debug tools for inspecting unsupported or broken files
- Break up code into functions that can be composed in different ways
- Support for dataclasses? HOT 1
- Add support for reading from a (non-seekable) file object instead of a filename HOT 1
- New PyPI release and release-checklist.rst file
- Throwing exceptions if column name contains commas
- UnicodeDecodeError: 'charmap' codec can't decode byte 0x8d in position 65: character maps to <undefined> HOT 1
- UnicodeDecodeError: 'charmap' codec can't decode byte 0x81 HOT 1
- Import into postgres -specific schema HOT 1
- DB4MemoFile field termination.
- ValueError: Field type I must have length 4 (was 0) HOT 1
- ValueError: could not convert string to float: b'60.00\x00\x00' HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dbfread.