Gravitino Release 0.4.0

Gravitino 0.4.0 is the fourth release since its inception and the second release since becoming open-source. With substantial contributions from the open-source community, this release has addressed over 280 issues.

This release is a stable release that mainly focuses on bug fixes. In the meantime, this release also introduces several features, like the public preview of Gravitino web UI, the support of unified partition management, the column default value and indexing support for table, the Kerberos support for client-server communication, the user impersonation support, the Kerberos support of hive catalog, the multiple Java version support, etc.

To download Gravitino 0.4.0, please visit the releases pages, For detailed changes, you can visit Gravitino milestone 0.4.0 for more details. We have also curated a list of high-level changes here, grouped by major modules.

Highlights

• Add the UI support for Gravitino #605
• Add partition support for Gravitino #1575
• Support default value for column #896
• Support auto increment property for column #1277
• Support index for table #1398 #1707 #1736
• Support Kerberos for client-server communication #1185 #1618
• Support user impersonation #596
• Support Kerberized Hive metastore #1415
• Support Java 8, 11 and 17 for Gravitino #1098
• Introduce fine-grained lock support in Gravitino #778
• Support partitioning, bucketing, sorting for Trino Gravitino connector #1510
• Support query optimization in Trino connector #1491

Gravitino core

• Improve the ConfigEntry to support configuration without default value #950
• Add CORS filter for Jetty server Support Java 8, 11 and 17 for Gravitino #42
• Support auto increment property for column #1277
• Ensure the correct semantics of dropTable and purgeTable #1436
• Support index for table #1398
• Support default value for column #896
• Add partition support for Gravitino #1575
• Support Kerberos for client-server communication #1185 #1618
• Introduce fine-grained lock support in Gravitino #778
• Refine Literal APIs #1379

Catalogs

Hive

• Add partition support for Hive #1575
• Add user impersonation support for Hive catalog #596
• Support Kerberized Hive metastore #1451

Iceberg

• Add the reigster IcebergCatalogConfig abstract class #874
• Support Distribution for Iceberg #1460
• Add the basic framework to store Iceberg metrics #1187
• Support struct column for Iceberg #1313 #1471

MySQL & PostgreSQL

• Support auto increment property for column #1388 #1279
• Support PostgreSQL index #1736
• Support MySQL index #1707
• Refactor to get metadata from JDBC #1737 #1468
• Add column default value support for MySQL and PostgreSQL #1531

Trino connector

• Add the Trino TPC-H and TPC-DS test sets to the Trino connector integration test #1291
• Optimize Trino connector's property mapping system #1455
• Create docker-compose container for Trino test #919
• Support partitioning, bucketing, sorting for Trino Gravitino connector #1512
• Support query optimization in Trino connector #1491

UI

• Add the UI support for Gravitino #605

Build and others

• Remove sequence dependencies in test with annotation Order improvement #995
• Support Java 8, 11 and 17 for Gravitino #1098
• Add multiple MySQL and PostgreSQL version support in integration test #1367 #1361
• Upgrade Jersey version to 2.41 #1756
• Upgrade Guava version 32.1.3-jre #1755
• Add test framework for web UI #1694
• Support query optimization in Trino connector #1491
• Pass the Trino-connector attributes when creating a Graviton catalog #1688

Fixed known CVEs

• Upgrade Jersey version to 2.41 #1756
• Upgrade Guava version 32.1.3-jre #1755

Know issues

• Varchar type of PG catalog is not handled correctly by Gravitino #2035
• OAuth mode, authentication will expire after a few minutes #2099
• Gravitino web UI has issues on Safari #2100

Limitation:

• Audit information is empty for MySQL schema #1767

Credits

@abant07 @amananand20 @austin362667 @brandboat @BWbwchen @ch3yne @Clearvive @coolderli @cottage14 @cxzl25 @diqiu50 @FANNG1 @FrankYang0529 @hiirrxnn @jerryshao @justinmclean @mchades @NIRMALraki @pan3793 @qqqttt123 @SophieTech88 @SteNicholas @TEOTEO520 @xnge @xunliu @yuqi1129 @YxAc @724thomas