mattcasters / kettle-beam-examples Goto Github PK

When submitting the input-process-output.ktr transformation for Dataflow processing, I get the following error. I can't find any way to see what's actually being sent in order to take any additional troubleshooting steps. My GS bucket name is only 12 characters, so I don't think that's contributing to the issue.

Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request { "code" : 400, "errors" : [ { "domain" : "global", "message" : "(5d2feec528391b35): The workflow could not be created. Causes: (5d2feec528391c82): SDK pipeline options or staging file list exceeds size limit. Please keep their length under 256K Bytes each and 512K Bytes in total. For example, shorten pipeline options or staging file paths, or reduce the number of staging files by building a Java uber JAR.", "reason" : "badRequest" } ], "message" : "(5d2feec528391b35): The workflow could not be created. Causes: (5d2feec528391c82): SDK pipeline options or staging file list exceeds size limit. Please keep their length under 256K Bytes each and 512K Bytes in total. For example, shorten pipeline options or staging file paths, or reduce the number of staging files by building a Java uber JAR.", "status" : "INVALID_ARGUMENT" }