3.2.4
版本发布时间: 2024-03-12 16:52:20
StarRocks/starrocks最新发布版本:3.1.11(2024-04-28 19:55:04)
Release date: March 12, 2024
New Features
- Cloud-native Primary Key tables in shared-data clusters support Size-tiered Compaction to reduce the write I/O amplification. #41034
- Added the date function
milliseconds_diff
. #38171 - Added the session variable
catalog
, which specifies the catalog to which the session belongs. #41329 - Supports setting user-defined variables in hints. #40746
- Supports CREATE TABLE LIKE in Hive catalogs. #37685
- Added the view
information_schema.partitions_meta
, which records detailed metadata of partitions. #39265 - Added the view
sys.fe_memory_usage
, which records the memory usage for StarRocks. #40464
Behavior Changes
-
cbo_decimal_cast_string_strict
is used to control how CBO converts data from the DECIMAL type to the STRING type. The default valuetrue
indicates that the logic built in v2.5.x and later versions prevails and the system implements strict conversion (namely, the system truncates the generated string and fills 0s based on the scale length). The DECIMAL type is not strictly filled in earlier versions, causing different results when comparing the DECIMAL type and the STRING type. #40619 - The default value of the Iceberg Catalog parameter
enable_iceberg_metadata_cache
has been changed tofalse
. From v3.2.1 to v3.2.3, this parameter is set totrue
by default, regardless of what metastore service is used. In v3.2.4 and later, if the Iceberg cluster uses AWS Glue as metastore, this parameter still defaults totrue
. However, if the Iceberg cluster uses other metastore service such as Hive metastore, this parameter defaults tofalse
. #41826 - The user who can refresh materialized views is changed from the
root
user to the user who creates the materialized views. This change does not affect existing materialized views. #40670 - By default, when comparing columns of constant and string types, StarRocks compares them as strings. Users can use the session variable
cbo_eq_base_type
to adjust the rule used for the comparison. For example, users can setcbo_eq_base_type
todecimal
, and StarRocks then compares the columns as numeric values. #40619
Improvements
- Shared-data StarRocks clusters support the Partitioned Prefix feature for S3-compatible object storage systems. When this feature is enabled, StarRocks stores the data into multiple, uniformly prefixed partitions (sub-paths) under the bucket. This improves the read and write efficiency on data files in S3-compatible object storages. #41627
- StarRocks supports using the parameter
s3_compatible_fs_list
to specify which S3-compatible object storage can be accessed via AWS SDK, and supports using the parameterfallback_to_hadoop_fs_list
to specify non-S3-compatible object storages that require access via HDFS Schema (this method requires the use of vendor-provided JAR packages). #41123 - Optimized compatibility with Trino. Supports syntax conversion from the following Trino functions: current_catalog, current_schema, to_char, from_hex, to_date, to_timestamp, and index. #41217 #41319 #40803
- Optimized the query rewrite logic of materialized views. StarRocks can rewrite queries with materialized views created upon logical views. #42173
- Improved the efficiency of converting the STRING type to the DATETIME type by 35% to 40%. #41464
- The
agg_type
of BITMAP-type columns in an Aggregate table can be set toreplace_if_not_null
in order to support updates only to a few columns of the table. #42034 - Improved the Broker Load performance when loading small ORC files. #41765
- The tables with hybrid row-column storage support Schema Change. #40851
- The tables with hybrid row-column storage support complex types including BITMAP, HLL, JSON, ARRAY, MAP, and STRUCT. #41476
- A new internal SQL log file is added to record log data related to statistics and materialized views. #40453
Bug Fixes
Fixed the following issues:
- "Analyze Error" is thrown if inconsistent letter cases are assigned to the names or aliases of tables or views queried in the creation of a Hive view. #40921
- I/O usage reaches the upper limit if persistent indexes are created on Primary Key tables. #39959
- In shared-data clusters, primary key index directories are deleted every 5 hours. #40745
- After users execute ALTER TABLE COMPACT by hand, the memory usage statistics for compaction operations are abnormal. #41150
- Retries of the Publish phase may hang for Primary Key tables. #39890