New features:

• Added liveness (/ping) and readiness (/replicas_status) probes to ClickHouse pods. Those can be overwritten on podTemplate level
• Customizable graceful reconcile logic. Now it is possible to turn-on 'wait' behaviour that would apply configuration changes and upgrades using the following algorithm:
  • Host is (optionally) excluded from ClickHouse remote_servers
  • Operator (optionally) waits for exclusion to take an effect
  • Host is updated
  • If it is a new host, schema is created at this stage. That ensures host is not in the cluster until schema is created. Fixes #561
  • Host is added back to remote_servers
  • Operator (optionally) waits for inclusion to take an effect before moving to the next host.

'Optional' steps are turned-off by default and can be turned on in operator configuration:

reconcileWaitInclude: false
reconcileWaitExclude: false

or enabled for particular CHI update:

spec:
  reconciling:
    policy: "nowait"|"wait"

• Cluster 'stop' operation now correctly removes CHI from monitoring and deletes LoadBalancer service
• podTemplate metadata is now supported (annotations, labels). Fixes #554
• 'auto' templates are now available. If templating.policy=auto is specified for ClickHouseInstallationTemplate object, those templates are automatically applied to all ClickHouseInstallations.
• Minor changes to ClickHouse default profile settings.

Bug fixes:

• External labels, annotations and finalizers are correctly preserved for services.
• It was possible that finalizer has been inserted multiple times to CHI

** Note: existing ClickHouse clusters will be restarted after operator upgrade because of adding Liveness/Readiness probes **