Error due to Flink CDC using deprecated `flink-conf.yaml` in light of Flink's full YAML 1.2 support since version 1.19 about flink-cdc HOT 2 CLOSED

Steps to Reproduce

1. Upgrade to Flink version 1.19 or later where full YAML 1.2 support is introduced.
2. Attempt to run a Flink CDC job using the latest version of Flink CDC, which still references the flink-conf.yaml file.
3. Using flink-cdc.sh script :

bin/flink-cdc.sh mysql2doris.yaml

exception:

Exception in thread "main" java.io.FileNotFoundException: Cannot find configuration file at "/opt/flink/conf/flink-conf.yaml"

Environment Information

• Flink Version: 1.19.0
• Flink CDC Version: flink-cdc-3.0.1

Suggested Solution

To enable Flink CDC to simultaneously support both new and old Flink configuration file standards, it is recommended to implement a simple logic check within the Flink CDC codebase to determine whether to use config.yaml or flink-conf.yaml. This can be achieved by utilizing the Files.exists method to check for the presence of the config.yaml file in the system. If it exists, Flink CDC should use config.yaml as the configuration file; if it does not, then it should fall back to using flink-conf.yaml. Such an implementation will ensure that Flink CDC can seamlessly transition between different versions of Flink while maintaining backward compatibility.

from flink-cdc.

If the issue still exists, please report it on Apache Jira under the project Flink, using the component tag Flink CDC. Thank you!

from flink-cdc.