Linkis 1.0.0-RC1 is an important release that marks the start of the 1.0 version, including all of Project Linkis 1.0.0 RC1.

With the design of supporting full-stack computation/storage engines, this release brings a brand new implemention for the architecture of computation governance, provides a variety of new features and Provides a strong compatibility guarantee for later 1.x version.

New Feature

• [Linkis-572] Add the EngineConn management plug-in in the Entrance module.
• [Linkis-576] Add a new module EngineConnPlugin for the Linkis1.0 architecture to simplify the user's implementation of a new Linkis underlying computation storage engine.
• [Linkis-584] Add a new LinkisManager Common module to collect all commonly used interfaces in LinkisManager.
• [Linkis-585] Add a new LinkisManager Monitor module to monitor the status of instances managed by LinkisManager.
• [Linkis-587] Add the common module of EngineConn of Linkis1.0 architecture.
• [Linkis-591] Add the Common Module for Computation Governance.
• [Linkis-600] Add the linkis-manager-service-common module, it can be used by AppManager and ResourceManager.
• [Linkis-602] Add the Persistence Module for Linkis Manager to provide the persistence capability.
• [Linkis-604] Add the ability of microservice tagging, and support the tagging of each micro-service.
• [Linkis-599] Add the Linkis ResourceManager Common Module.
• [Linkis-609] Add a universal label module to provide basic support for linkis label capability.
• [Linkis-630] Add the launch module of EngineConn of Linkis1.0 architecture.

Enhancement

• [Linkis-569] Enhance the processing capacity of Linkis RPC, and backward compatibility with Linkis0.x RPC.
• [Linkis-570] Enhance the ability of RM and integrate it into Linkis Manager.
• [Linkis-574] Enhance the label management function of Linkis, so it can manage the Label of EngineConnManager and EngineConn.
• [Linkis-580] Enhance SparkEngineConn module, adapts to Linkis1.0's new architecture.
• [Linkis-583] Enhance ShellEngine, adapts to Linkis1.0's new architecture.
• [Linkis-590] Enhance the core module of EngineConn, provide the abstractions and interfaces of the core functions.
• [Linkis-592] Enhance JDBCEngine, adapts to Linkis1.0's new architecture.
• [Linkis-594] Enhance IOEngine, adapts to Linkis1.0's new architecture.
• [Linkis-596] Enhance HiveEngine, adapts to Linkis1.0's new architecture.
• [Linkis-597] Enhance PipelineEngine, adapts to Linkis1.0's new architecture.
• [Linkis-608] Enhance scritps for starting and shutting down services, optimize the steps of construction.
• [Linkis-618] Enhance the Context Service module of Public Enhancements and adapt it with Linkis 1.0.
• [Linkis-638] Enhance the encryption function of linkis-common.
• [Linkis-643] Enhance the Linkis DataSource Module to adapt to the structure of Linkis 1.0.
• [Linkis-645] Enhance the linkis-hadoop module to support the new feature of multi hadoop cluster.
• [Linkis-648] Enhance linkis-httpclient module to support PUT and Delete requests.
• [Linkis-650] Optimize linkis-mybatis module to integrate with mybatis-plus.
• [Linkis-652] Enhance the module of linkis-protocol, adapts to Linkis1.0's new architecture.
• [Linkis-654] Enhance the Linkis Gateway Module to support forwarding requests by labels in Linkis 1.0.
• [Linkis-655] Enhance the Linkis JobHistory Module to support task cache, label persistent and manager of job history.
• [Linkis-656] Optimize the implementation of the serializer of the linkis-rpc module.
• [Linkis-660] Enhance the linkis-scheduler module to automatically clean up idle Consumers.
• [Linkis-662] Enhance the linkis-user-control Module, adapts to Linkis1.0's new architecture.
• [Linkis-663] Enhance the linkis-entrance module, adapts to Linkis1.0's new architecture.
• [Linkis-666] Optimize directory hierarchy structures and remove useless directories.
• [Linkis-668] Enhance the linkis-storage module to support viewFS and multi hadoop cluster.
• [Linkis-674] Enhance the PythonEngineConn, adatps to Linkis1.0 architecture.
• [Linkis-675] Optimize directories and files, update the version of all pom files.

Credits

The release of Linkis 1.0.0-RC1 is inseparable from the contributors of the WeDataSphere community. They selflessly contributed their time and made lots of valueable suggestions for the document construction, deployment simplification and user experience perfection. Without their help, Linkis 1.0.0-RC1 can not be released so smoothly. Thank you all Contributors of the community!

Upgrade Wizard

In principle, Linkis 1.0.0-RC1 is backward compatible with all the interfaces of Linkis0.X, so the upgrade has little effect to the upper layer applications. As a computation middleware, except for the related user configuration data of PublicService, other data in the Linkis database has no need for migration. For the migration of the user configuration data of PublicService, please refer to: Linkis1.0.0-RC1 Upgrade Document

Cloud Resource

1. Tencent Cloud:

   URL: https://osp-1257653870.cos.ap-guangzhou.myqcloud.com/WeDatasphere/Linkis/1.0.0-RC1/wedatasphere-linkis-1.0.0-RC1-dist.tar.gz