Dinky-1.0.2 Release Note

Upgrade Instructions

• 1.0.2 is a BUG repair version with table structure/data changes, please execute DINKY_HOME/sql/upgrade/1.0.2_schema/data source type/dinky_dml.sql

About SCALA version: The release version uses Scala-2.12. If your environment must use Scala-2.11, please compile it yourself. Please refer to Compile Deployment and change the scala-2.12 in the profile. for scala-2.11

New Feature

• Adapt to various Rest SvcTypes in KubernetsApplicationOperator mode and modify JobId to obtain judgment logic
• Added SSE heartbeat mechanism
• Added the function of automatically retrieving the latest highly available JobManager address (currently implemented in Yarn; not yet implemented in K8s)
• Added the function of clearing logs in the console during data development
• Support Flink1.19
• Add task group related configuration when pushing to Apache DolphinScheduler
• Added a user designated by the user to submit YarnApplication tasks
• The startup script adds GC related startup parameters and supports configuring the DINKY_HOME environment variable
• Implement FlinkSQL configuration item in cluster configuration to support RS protocol (Yarn mode only)

Fix

• Fixed the problem of global variables not being recognized in YarnApplication mode, and reconstructed the YarnApplication submission method
• Fixed the problem of data source heartbeat detection feedback error
• Fix the possible 404 issue in front-end route jump
• Fixed the issue of incorrect error prompt when global variable does not exist
• Fixed the issue of cursor movement and flickering in the editor during front-end data development
• Fixed the path error problem in the docker file of DockerfileDinkyFlink
• Fixed the problem of unrecognized configuration Python options
• Fixed null pointer exception in role user list
• Fixed some issues when submitting K8s tasks
• Fixed Oracle's Time type conversion problem when synchronizing the entire database
• Fixed the problem that k8s pod template cannot be parsed correctly
• Fixed the issue where SPI failed to load CodeGeneratorImpl
• Fixed an issue where numeric columns declared with UNSIGNED / ZEROFILL keywords would cause parsing mismatches
• Fixed the issue where the status of batch tasks is still unknown after completion
• Fixed some unsafe interfaces that can be accessed without login authentication
• Fixed the problem of unknown status in Pre-Job mode
• Fixed the problem of retrieving multiple job instances due to duplicate Jid
• Fixed the problem that the user list cannot be searched using worknum
• Fixed the problem that the query data button on the right side of the result Tag page cannot be correctly rendered when querying data.
• Fixed issues with print table syntax
• Fixed the problem that the resource list cannot be refreshed after adding or modifying it
• Fixed the issue of incorrect console rolling update task status for data development
• Fixed the problem of occasional packaging failure
• Fixed problems when building Git projects

Optimization

• Optimize start and stop scripts
• Optimize the problem of partial overflow of the global configuration page
• Tips for optimizing UDF management
• Optimize the user experience of the operation and maintenance center list page and support sorting by time
• Optimize the warehouse address of default data in Git projects
• Optimize flink jar task submission to support batch tasks
• Optimize the problem that the right-click menu cannot be clicked when it overflows the visual area.
• Optimize the primary key key of the list component of the operation and maintenance center
• When modifying tasks, the modifiable template is optimized to an unmodifiable template.
• Optimize the display method and type of cluster configuration
• Optimize the logic of deleting clusters in K8s mode
• Fixed the problem that the cluster is not automatically released in Application mode
• Remove the logic of using Paimon for data source caching and change it to the default memory cache, which can be configured as redis cache
• Removed the automatic pop-up of Console when switching tasks
• Optimize the rendering logic of resource management. The resource management function cannot be used when resources are not turned on.
• Optimize the detection logic of login status
• Optimize login page feedback prompts
• Removed some useless code on the front end
• Optimize the problem that when the entire library is synchronized to build operator graphs multiple times, the order of the operator graphs is inconsistent, resulting in the inability to recover from the savepoint.
• Some tips for optimizing resource allocation
• Optimize and improve the replication function of the resource center, supporting all reference scenarios within Dinky currently

Safety

• Exclude some high-risk jmx exposed endpoints

Document

• Optimize expression variable expansion documentation
• Optimize some practical documents for synchronization of the entire database
• Add JDBC FAQ about tinyint type
• Added a carousel image on the home page of the official document website
• Fixed the description problem of resource configuration in document global configuration
• Added documents related to environment configuration in global configuration
• Delete some configuration items of Flink configuration in the global configuration
• Added document configuration description for alarm type email