Comments (2)
I tried dealing with this within regular expressions, but it went badly. We're using a backreference for the second appearance of a hyphen, but that assumes that the same character is being used for each hyphen. If the first one is a hyphen and the second one is an em dash, then the SSN won't be found.
What we really need is to match a second hyphen-shaped thing if a first hyphen-shaped thing is found.
Or, of course, we can just convert all em dashes, en dashes, and minus signs to hyphens before running this regex, as proposed in the initial issue.
from ssn-redaction.
I think the proper solution is to do a conversion on the input stream. Replace −
, –
, —
, ~
, and ‐
with -
. (There are other characters that look the same, but OCR software is vanishingly unlikely to use them, in my experience.)
I'm assigning this to @jazzido, since this is now out of my bailiwick.
from ssn-redaction.
Related Issues (11)
- OCR software confuses letters and numbers HOT 4
- Require either 0 or 2 hyphens HOT 4
- Require that SSNs be neither preceded nor followed by digits HOT 2
- Support spaces as SSN separators
- Modify background image to draw a black box
- Replace identified target string with equivalent-length redaction vector data
- Identify target text within PDF text HOT 1
- Save the fully redacted PDF HOT 3
- Create a test harness to evaluate effectiveness HOT 1
- Test candidate regex on actual PDFs HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ssn-redaction.