MyGit

0.9.60

mage-ai/mage-ai

版本发布时间: 2024-01-20 01:45:10

mage-ai/mage-ai最新发布版本:0.9.68(2024-03-28 23:35:49)

What's Changed

🎉 Exciting New Features

🌊 [Streaming] Google Cloud Storage Destination

🎉 Google Cloud users rejoice! Streaming pipelines just even got better— Mage now supports Google Cloud Storage as a streaming destination! Check out the docs here and get started today!

by @wangxiaoyou1993 in https://github.com/mage-ai/mage-ai/pull/4340

👷‍♂️ Overwrite SQL types

For anyone with a data warehouse, listen up! (We assume that's most of you 😅)

You can now specify custom column types when exporting to SQL destinations. This is useful when you want to export a dataframe with a column that has a type that is not supported by the default mapping. You can read more about overwriting types here.

Here's an example of an exporter that overwrites column types for a PostgreSQL destination:

@data_exporter
def export_data_to_postgres(df: DataFrame, **kwargs) -> None:
    schema_name = 'your_schema_name'  # Specify the name of the schema to export data to
    table_name = 'your_table_name'  # Specify the name of the table to export data to
    config_path = path.join(get_repo_path(), 'io_config.yaml')
    config_profile = 'default'
    overwrite_types = {'column_name': 'VARCHAR(255)'}

    with Postgres.with_config(ConfigFileLoader(config_path, config_profile)) as loader:
        loader.export(
            df,
            schema_name,
            table_name,
            index=False,  # Specifies whether to include index in exported table
            if_exists='replace',  # Specify resolution policy if table name already exists
            allow_reserved_words=True,
            unique_conflict_method='UPDATE',
            unique_constraints=['col'],
            overwrite_types=overwrite_types,
        )

This feature is currently supported for PostgreSQL, Redshift, Trino, MSSQL, MySQL, Clickhouse, and BigQuery.

by @Luishfs in https://github.com/mage-ai/mage-ai/pull/3474

👨‍💻 [Command Center] Version Control & Files

The Mage Command Center can now be used for version control commands! You can both configure git and run your favorite version control commands directly from the Mage UI. Additionally, you can manage your files via nav and Mage's new file explorer (🧙 Arcane Library)!

As a reminder, to enable the command center, you can do so by going to Settings (the wizard icon) and click the Command Center toggle. It can be accessed via ⌘ + . (Mac) or Win + . (Windows).

by @tommydangerous in https://github.com/mage-ai/mage-ai/pull/4273

👾 [Command Center] Terminal App

Mage LEGEND @tommydangerous is back at it again— he's implemented a full terminal app into the command center. For those of you with this beta feature enabled, you'll now have a terminal at your fingertips at all times.

Check out the following video for sample usage:

https://github.com/mage-ai/mage-ai/assets/1066980/82db6eb4-ecca-49e4-aa77-f464e6a94620

As a reminder, to enable the command center, you can do so by going to Settings (the wizard icon) and click the Command Center toggle. It can be accessed via ⌘ + . (Mac) or Win + . (Windows).

by @tommydangerous in https://github.com/mage-ai/mage-ai/pull/4365

JSON Logging

A huge shoutout to @dy46 for adding JSON logging to Mage! This will make it easier to parse logs and integrate with other logging tools. Just specify SERVER_LOGGING_FORMAT=json to change the output to something like the following:

by @dy46 in https://github.com/mage-ai/mage-ai/pull/4336

🐛 Bug Fixes

💅 Enhancements & Polish

Full Changelog: https://github.com/mage-ai/mage-ai/compare/0.9.59...0.9.60

相关地址：原始地址 下载(tar) 下载(zip)

查看：2024-01-20发行的版本

微信小程序
MyGit:GitHub仓库更新&通知小工具