Added

• Kubernetes secrets are currently supported with the standard syntax for user passwords, configuration settings, and configuration files, for example:

    users:
      user1/password:
        valueFrom:
          secretKeyRef:
            name: clickhouse_secret
            key: pwduser1
    settings:
      s3/my_bucket/access_key:
        valueFrom:
          secretKeyRef:
            name: s3-credentials
            key: AWS_ACCESS_KEY_ID
    files:
      server.key:
        valueFrom:
          secretKeyRef:
            name: clickhouse-certs
            key: server.key

See updated Security Hardening Guide for more detail.

• Added experimental support for ClickHouse Keeper by @frankwg in https://github.com/Altinity/clickhouse-operator/pull/1218

kind: ClickHouseKeeperInstallation

See examples in there: https://github.com/Altinity/clickhouse-operator/tree/0.23.0/docs/chk-examples The implementation is not final, following things yet needs to be done:

1. dynamic reconfiguration, that is required in order to support adding and removing Keeper replicas
2. integration with ClickHouseInstallation, so Keeper could be referenced by a reference, instead by a service

• CHI labels are now added to exported Prometheus metrics

Changed

• Services are now re-created if ServiceType is changed in order to workaround Kubernetes issue. Closes https://github.com/Altinity/clickhouse-operator/issues/1302
• Operator now waits for ClickHouse service endpoints to respond when checking node is up.
• CHI templates are now automatically reloaded by operator. Before, templates were only reloaded during startup. In order to apply changes, CHI update needs to be triggered.
• Operator will now crash if operator configuration is broken or can not be parsed. That prevents the fallback to the defaults in case of errors.

Fixed

• Fixed schema propagation on new replicas for ClickHouse 23.11 and above
• Fixed data recovery when PVC is deleted by a user. Closes https://github.com/Altinity/clickhouse-operator/issues/1310

Improved

• Improve helm, update values.yaml to properly generate helm/README.md by @Slach in https://github.com/Altinity/clickhouse-operator/pull/1278
• Improve clickhouse-keeper manifests by @Slach in https://github.com/Altinity/clickhouse-operator/pull/1234
• chore: remove refs to deprecated io/ioutil by @testwill in https://github.com/Altinity/clickhouse-operator/pull/1273
• Update URL for accepted logging levels by @madrisan in https://github.com/Altinity/clickhouse-operator/pull/1270
• Add a chi example for sync users by @ccsxs in https://github.com/Altinity/clickhouse-operator/pull/1304
• Bump zookepper operator version to 0.2.15 by @GrahamCampbell in https://github.com/Altinity/clickhouse-operator/pull/1303
• Optional values.rbac to deploy rbac resources by @Salec in https://github.com/Altinity/clickhouse-operator/pull/1316
• update helm chart generator to treat config.yaml as yaml in values by @echozio in https://github.com/Altinity/clickhouse-operator/pull/1317

Full Changelog: https://github.com/Altinity/clickhouse-operator/compare/release-0.22.2...release-0.23.0