Comments (6)
Indeed, if the input contained the actual replacement char, it was incorrectly detected as an encoding error. It's fixed in the branch fix-replacement-char
, could you give it a try and let me know if all's good for you? I'll merge on master after that.
Thanks,
Martin
from pigeon.
Hello,
You have that error when you try to parse an input file that should conform to your pigeon (rules) file? Or when trying to build the parser from your rules file? That error indicates that your input is not valid utf8, and depending on the step at which it occurs, the invalid input may be your grammar or the file you're trying to parse with that grammar.
Martin
from pigeon.
I get this error while parsing my input file which contain this ACTUAL character inserted by user editor
/* blah blah blah � */
if remove this character from line then all fine. I look for any method for catching this error.
REPLACEMENT CHARACTER is not valid utf-8?
from pigeon.
Replacement character is the character returned when the input contains
invalid utf8.
On Tue, Aug 30, 2016 at 01:40 RedSkotina [email protected] wrote:
I get this error while parsing my input file which contain this ACTUAL
character inserted by user editor/* blah blah blah � */
if remove this character from line then all fine. I look for any method
for catching this error.
REPLACEMENT CHARACTER is not valid utf-8?—
You are receiving this because you commented.Reply to this email directly, view it on GitHub
#12 (comment),
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAqQoFyYcSocwuKvJp6Z1lVJAEabR_cfks5qk8JpgaJpZM4JvdqI
.
from pigeon.
but my input file contain byte sequence 0xEF 0xBF 0xBD . user save this sequence in the file.
can i parse this sequence?
from pigeon.
yes. error has gone away. thanks
from pigeon.
Related Issues (20)
- wrong pigeon gets installed? HOT 1
- Support annotating return types next to rules HOT 4
- Help Required for developing expression evaluation parser! HOT 2
- Is this project still active? HOT 1
- trouble with \n and EOF HOT 2
- Matched text not accessible from state blocks HOT 4
- Remove dependency of io/ioutils HOT 2
- Run from code? HOT 4
- Provide rule and no-match indicators in parserErr HOT 1
- Ignore Braces in String and Rune Literals HOT 1
- [Feature Request] Left recursion support HOT 2
- Generating a Treesitter grammar
- Fix Backslash Escapes Not Being Properly Handled
- Include a variable in the parser state HOT 1
- Use regexp in grammar rules? HOT 2
- Invalid rune literal syntax generation for class matcher HOT 3
- [Feature Request] Skip all "codeExpr" while looking ahead
- Some suggestion for a new major version HOT 2
- Tricks for >5x performance increase
- errors during compilation of grammar.go are reported as grammar.go rather than grammar.peg HOT 5
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pigeon.