PutContexts failed: Given node already exists about ml-metadata HOT 6 CLOSED

hi @calvinleungyk , this is WAI. in mlmd, the context {name, type} is unique [1]. In this case, this context has been created five times. First time it will succeed, the rest of it, will return an error. In the tfx runtime, this is ignored and log errors to the users, and continue.

[1] https://github.com/tensorflow/tfx/blob/deb618730dc7675c8e9dc75e03b8ca795d49653d/tfx/orchestration/metadata.py#L1021

from ml-metadata.

Thanks for the response @hughmiao. Is it something I've done in my pipeline that it's created 5 times, or is it something done in a default way in TFX? I don't remember doing any creation other than the one InteractiveContext

from ml-metadata.

I believe this is handled by tfx and the interactive context implementation. Let me cc some tfx folks to take a look. @ruoyu90 @charlesccychen

from ml-metadata.

@calvinleungyk this is expected. Basically every node you run will try to register the pipeline context and reuse the one if exists. This is the reason you constantly see four warnings.

from ml-metadata.

thanks @ruoyu90 to confirm.

from ml-metadata.

Thanks @hughmiao and @ruoyu90 !

from ml-metadata.