Add a `eof` terminal about earley HOT 5 CLOSED

from earley.

It seems like it should be possible to add as a primitive, but might add some complexity to the implementation.

There are also some questions that need to be answered like whether eof *> eof means the same as eof and whether it can be done in a backward compatible way.

Could you get away with adding an EOF token to your token type instead?

from earley.

whether eof *> eof means the same as eof

For the use case I described, it should be the same.

Could you get away with adding an EOF token to your token type instead?

No. Let's say I want to parse (2 tokenised as [OpenPar, Num 2, Eof] – this will work. However, ((2 tokenised as [OpenPar, OpenPar, Num 2, Eof], will not.

from earley.

whether it can be done in a backward compatible way.

I don't see how this functionality would break any existing parser.

from earley.

Turns out this is possible using existing functionality: #40.

from earley.