Lexer causes offset mismatch -> IllegalStateException; no file displayed about jetbrains-plugin-sample HOT 5 CLOSED

Right, this is described in the SDK docs:

Note: Lexers, and in particular JFlex-based lexers, need to be created in such a way that they always match the entire contents of the file, without any gaps between tokens, and generate special tokens for characters which are not valid at their location. Lexers must never abort prematurely because of an invalid character.

For ANTLRv4 grammars, this means that you should never skip() tokens, but rather use channel(HIDDEN) instead like @nixel2007 suggested.

See also antlr/antlr4-intellij-adaptor#3 and this explanation from someone working at JetBrains.

from jetbrains-plugin-sample.

I've faced this issue with WHITESPACE rule with -> skip(). rewrote it in -> channel(HIDDEN) and a problem has gone. not sure if it'll make my life harder in the future, but it solves current problem. hope it helps.

from jetbrains-plugin-sample.

@azrdev - Have you used any modes in the grammar?

from jetbrains-plugin-sample.

@Shan1024 no (but maybe I will have to later)

from jetbrains-plugin-sample.

@azrdev - I encountered this issue but could not find any solution for it yet. I thought it was due to some issue in modes since it occurs in one mode that I have. Seems like that is not the case then.

from jetbrains-plugin-sample.