`IndexError` in `DelayedFormat` when providing kwargs about sisyphus HOT 5 CLOSED

If you think I'm using the code wrong, please let me know.

additionally to alberts suggestion above (which provides a positional arg to fill a positional arg formatting slot) I would offer

returnn.config.CodeWrapper(
    DelayedFormat(
        "lambda files: get_sub_epoch_dataset(files, dataset={dataset}, num_workers={num_workers}, local_caching={local_caching})",
        dataset=dataset_copy,
        num_workers=num_workers,
        local_caching=local_caching,
    )
),

which uses kwargs for both the formatting string and the arguments to str.format.

There's no way any keyword arguments will be respected in the formatting function. Moreover, if I remember correctly the dictionary composed of the kwargs isn't guaranteed to have the right order before python 3.something (3.7?), so kwargs.values() wouldn't work either.

In this case you are responsible yourself that the kwargs defined in the formatting string match those that are passed to the function. If they match, then the order would not matter.
(dicts are sorted in order of insertion in python3.6+)

from sisyphus.

I don't exactly understand why you think there is any issue in DelayedFormat. This exception is exactly what you would expect here. All is correct. If you want to use kwargs this way, the Python str.format works this way:

"{a}.format(a="a")

The example with CodeWrapper I gave before (here) was slightly wrong, it should be like this:

CodeWrapper(DelayedFormat('lambda files: get_sub_epoch_dataset(files, **({}))', whatever_extra_kwargs_you_want))

from sisyphus.

I see, I didn't know that the formatted string should have the kwarg keyword between braces, thanks for clarifying.

I just tried what I show below:

returnn.config.CodeWrapper(
    DelayedFormat(
        "lambda files: get_sub_epoch_dataset(files, **({})", dataset=dataset_copy, num_workers=num_workers, local_caching=local_caching,
    )
),

But I still get the error IndexError: Replacement index 0 out of range for positional args tuple. Perhaps I'm still using it wrong?

from sisyphus.

Yes it's exactly wrong in the same way? You are using here a positional arg ({} is a positional arg, i.e. not a keyword arg; it refers to the first positional arg) but then you only provide keyword args? Of course that's wrong. For example, you could do it like this:

returnn.config.CodeWrapper(
    DelayedFormat(
        "lambda files: get_sub_epoch_dataset(files, **({}))",
        dict(dataset=dataset_copy, num_workers=num_workers, local_caching=local_caching),
    )
),

from sisyphus.

Thanks for the feedback everyone. I'll close this issue since the error was mine.

Edit: just to clarify, everything is working as intended, I just had to set the string to what @michelwi said above.

from sisyphus.