Release date: May 25, 2024

New Features

• Stream Load supports data compression during transmission, reducing network bandwidth overhead. Users can specify different compression algorithms using parameters compression and Content-Encoding. Supported compression algorithms including GZIP, BZIP2, LZ4_FRAME, DEFLATE, and ZSTD. #43732
• Optimized the garbage collection (GC) mechanism in shared-data clusters. Supports manual compaction for tables or partitions stored in object storage. #39532
• Flink connector supports reading complex data types ARRAY, MAP, and STRUCT from StarRocks. #42932 #347
• Supports populating Data Cache asynchronously during queries, reducing the impact of populating cache on query performance. #40489
• ANALYZE TABLE supports collecting histograms for external tables, effectively addressing data skews. For more information, see CBO statistics. #42693
• Lateral Join with UNNEST supports LEFT JOIN. #43973
• Query Pool supports configuring memory usage threshold that triggers spilling via BE static parameter query_pool_spill_mem_limit_threshold. Once the threshold is reached, intermediate results of queries will be spilled to disks to reduce memory usage, thus avoiding OOM.#44063
• Supports creating asynchronous materialized views based on Hive views.#45085

Improvements

• Optimized the error message returned for Broker Load tasks when there is no data under the specified HDFS paths. #43839
• Optimized the error message returned when the Files function is used to read data from AWS S3 without Access Key and Secret Key specified. #42450
• Optimized the error message returned for Broker Load tasks that load no data to any partitions. #44292
• Optimized the error message returned for INSERT INTO SELECT tasks when the column count of the destination table does not match that in the SELECT statement. #44331

Bug Fixes

Fixed the following issues:

• Concurrent read or write of the BITMAP-type data may cause BE to crash. #44167
• Primary key indexes may cause BE to crash. #43793 #43569 #44034
• Under high query concurrency scenarios, the str_to_map function may cause BE to crash. #43901
• When the Masking policy of Apache Ranger is used, an error is returned when table aliases are specified in queries. #44445
• In shared-data clusters, query execution cannot be routed to a backup node when the current node encounters exceptions. The corresponding error message is optimized for this issue. #43489
• Memory information is incorrect in the container environment. #43225
• An exception is thrown when INSERT tasks are canceled. #44239
• Expression-based dynamic partitions cannot be automatically created. #44163
• Creating partitions may cause FE deadlock. #44974