kafka-connect-vault-config-provider's Introduction

Kafka Connect Vault config provider

Example configuration with docker-compose

To use this config provider in your Kafka Connect worker instances you should pass the following environment variables:

...
environment:
    CONNECT_CONFIG_PROVIDERS: vault
    CONNECT_CONFIG_PROVIDERS_VAULT_CLASS: com.provectus.kafka.connect.config.VaultConfigProvider
    CONNECT_CONFIG_PROVIDERS_VAULT_PARAM_VAULT_AUTH_METHOD: token
    CONNECT_CONFIG_PROVIDERS_VAULT_PARAM_URI: http://<your-vault-hostname>:8200
    CONNECT_CONFIG_PROVIDERS_VAULT_PARAM_TOKEN: <your-vault-token>

kafka-connect-vault-config-provider's People

Contributors

Stargazers

Watchers

kafka-connect-vault-config-provider's Issues

Missing a full example

Thanks for this opensource vault provider

I could not make it work fully , the kafka-connect worker start correctly but when I submit a connector it fail

kafka connect worker config :

      CONNECT_CONFIG_PROVIDERS: 'file,vault'
      CONNECT_CONFIG_PROVIDERS_FILE_CLASS: 'org.apache.kafka.common.config.provider.FileConfigProvider'
      CONNECT_CONFIG_PROVIDERS_VAULT_CLASS: 'com.provectus.kafka.connect.config.VaultConfigProvider'
      CONNECT_CONFIG_PROVIDERS_VAULT_PARAM_VAULT_AUTH_METHOD: token
      CONNECT_CONFIG_PROVIDERS_VAULT_PARAM_URI: http://vault:8200
      CONNECT_CONFIG_PROVIDERS_VAULT_PARAM_TOKEN: s.kunJxvnkfyXXXXXXXXXXX

Connector config :

"database.password": "${vault:cubbyhole/INVENTORY_CONNECTOR_POSTGRES:PASSWORD}",

The secret in vault :

If I curl the secret with the same token then the kafka-conect config

curl --header "X-Vault-Token: s.kunJxvnkfyXXXXXXXXXXX" localhost:8200/v1/cubbyhole/INVENTORY_CONNECTOR_POSTGRES

it answer

{"request_id":"d16b6c14-7a37-068d-346c-dad7a8bb107c","lease_id":"","renewable":false,"lease_duration":0,"data":{"PASSWORD":"postgres"},"wrap_info":null,"warnings":null,"auth":null}

but when I submit the connector I have this error :

{"error_code":500,"message":"com.bettercloud.vault.VaultException: Vault responded with HTTP status code: 404\nResponse body: {\"errors\":[]}\n"}(venv)

Thanks for your help.

Recommend Projects