Cannot load model after weight generation about lilt HOT 6 CLOSED

Is it ok to use roberta-large models also?

from lilt.

Hi,
due to the limitation of computing resources, we haven't trained the large LiLT model yet. It is considered for future work.

from lilt.

+1 for training LiLT-Large 👍🏻

from lilt.

will this ever be done? I am trying to use LILT but we have some forms that go over the 512 limit and we can't just truncate as the data could be anywhere in the tokens.

from lilt.

@AnQuethit it seems this project is mostly dead in terms of development.

My solution for that was to just tokenize longer documents in chunks with some overlap

The doc_stride parameter in huggingface tokenizer is very useful for this

from lilt.

i ran across the stride parameter 30 minutes ago but i haven't figured out how to get around the error it causes. do you have working code with it save me some time lol ?

Couldn't cast array of type
list<item: int64>
to
int64

from lilt.