Validation loss rockets up for speech example about kur HOT 4 CLOSED

The 5 hours of default train/test data is taken from the Librispeech "dev clean". It is disjoint (no shared data points) with these other datasets in #6. So I would change the training set to be one of the big training sets, and use one of the following for the new validation:

1. Just use the same, default validation.
2. Use the "old", default training set as the new validation set (because it is a little bigger).
3. Use both the "old" default training set as well as default validation set! You can combine them by simply having more than one data supplier. So in the speech.yml Kurfile, you currently have:

train:
  data:
    - speech_recognition:
        <<: *data
        url: "https://kur.deepgram.com/data/lsdc-train.tar.gz"
        checksum: >-
          fc414bccf4de3964f895eaa9d0e245ea28810a94be3079b55505cf0eb1644f94

# ...

validate: &validate
  data:
    - speech_recognition:
        <<: *data
        url: "https://kur.deepgram.com/data/lsdc-test.tar.gz"
        checksum: >-
          e1c8cf9cd57e8c1ae952b6e4e40dcb5c8e3932c81ecd52c090e4a05c8ebbea2b

And you can change it to something like this:

train:
  data:
    - speech_recognition:
        <<: *data
        url: "http://kur.deepgram.com/data/lsc100-100p-train.tar.gz"
        checksum: >-
          cad3d2aa735d50d4ddb051fd8455f2dd7625ba0bb1c7dd1528da171a10f4fe86

# ...

validate: &validate
  data:
    - speech_recognition:
        <<: *data
        url: "https://kur.deepgram.com/data/lsdc-test.tar.gz"
        checksum: >-
          e1c8cf9cd57e8c1ae952b6e4e40dcb5c8e3932c81ecd52c090e4a05c8ebbea2b
    - speech_recognition:
        <<: *data
        url: "https://kur.deepgram.com/data/lsdc-train.tar.gz"
        checksum: >-
          fc414bccf4de3964f895eaa9d0e245ea28810a94be3079b55505cf0eb1644f94

Note that if you use multiple data suppliers, I would recommend using a bleeding-edge install of Kur. There were a couple of bugs we fixed up related to this since the last official release on PyPI.

from kur.

Yep, this is probably caused by not enough data, so like @liaoweiguo said, see issue #6 for alternative datasets that we provide.

from kur.

#6

from kur.

Thanks a lot! I'll try with larger datasets. Should the validation set remain the same?
In #6 it is mentioned that train set is sampled from LibreSpeech train. Is it safe to assume that test is sampled from LibreSpeech test?

from kur.