Hi! Your work looks great! I tried to train my own model in Russian language. I made t

Fix <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id

Only O and <pad> in inference mode about arabicner HOT 2 CLOSED

AnnaKholkina commented on September 2, 2024

Only O and in inference mode

from arabicner.

Comments (2)

AnnaKholkina commented on September 2, 2024

Problem found. It lies in the fact that when training the model, bert_model was not installed in data_config:

--data_config '{"fn":"arabiner.data.datasets.NestedTagsDataset","kwargs":{"max_seq_len":512}}'

Therefore, after training, the name of the model for the tokenizer was not recorded in args.json and the default model in NestedTagsDataset was used in inference mode:

class NestedTagsDataset(Dataset):
    def __init__(
        self,
        examples=None,
        vocab=None,
        bert_model="aubmindlab/bert-base-arabertv2",
        max_seq_len=512,
    ):

To fix this problem, you need to specify the name of the BERT model in --data_config when you start train the model:

--data_config '{"fn":"arabiner.data.datasets.NestedTagsDataset","kwargs":{"max_seq_len":512, "bert_model": "DeepPavlov/rubert-base-cased-conversational"}}'

or write this manually in args.json:

    "data_config": {
        "fn": "arabiner.data.datasets.NestedTagsDataset",
        "kwargs": {
            "max_seq_len": 512,
            "bert_model": "DeepPavlov/rubert-base-cased-conversational"
        }
    },

from arabicner.

AnnaKholkina commented on September 2, 2024

Fix #8

from arabicner.

Recommend Projects