What's Changed

🎉 Exciting New Features

🗑️ Delete backfills

• Add delete button to backfills table that allows user to delete backfills individually.
• Prevent user from setting a backfill interval unit value less than 1, which could cause issues loading the backfills.

by @johnson-mage in https://github.com/mage-ai/mage-ai/pull/4726

🪪 Support AzureDevOps using Entra ID/AD authentication

If you have an Azure DevOps organization connected to your Active Directory/Microsoft Entra ID tenant, you can enable DevOps in the version control app.

• First, you will need to enable the Active Directory integration in order for Mage to authenticate your user.
• Once the Active Directory integration is enabled, you simply need to add your DevOps organization as an environment variable, and you should be able to authenticate with DevOps in the version control app
  • export AZURE_DEVOPS_ORGANIZATION=<organization_name>

by @dy46 in https://github.com/mage-ai/mage-ai/pull/4721

📅  Scheduler status endpoint

Add /api/status endpoint to scheduler when running scheduler in standalone mode. This endpoint can be used to check the liveness of the scheduler.

by @wangxiaoyou1993 in https://github.com/mage-ai/mage-ai/pull/4736

🔐 Read authentication settings from AWS secrets manager

Add support for reading settings from AWS secrets manager. The existing authentication settings have been moved to using the new Settings class.

In order to set the settings backend, the user will need to add a section to the project metadata. Here is an example to set the setting backend to AWS secrets manager:

settings_backend:
  backend_type: aws_secrets_manager
  prefix: default_repo/settings/

Read the doc for details.

by @dy46 in https://github.com/mage-ai/mage-ai/pull/4674

💅 Enhancements & Polish

• [jk] Limit block output for dynamic blocks in UI by @johnson-mage in https://github.com/mage-ai/mage-ai/pull/4693
• [xy] Add auto clean name flag to io classes. by @wangxiaoyou1993 in https://github.com/mage-ai/mage-ai/pull/4698
• [dy] Add interval variables for cron based schedules by @dy46 in https://github.com/mage-ai/mage-ai/pull/4699
• [dy] Add error stack trace to the message for pipeline run failure by @dy46 in https://github.com/mage-ai/mage-ai/pull/4697
• [dy] Add unique_conflict_method for mssql by @dy46 in https://github.com/mage-ai/mage-ai/pull/4712
• [jk] Scrollbar polish by @johnson-mage in https://github.com/mage-ai/mage-ai/pull/4732
• [xy] Remove Redshift stl insert query. by @wangxiaoyou1993 in https://github.com/mage-ai/mage-ai/pull/4735
• [edw] e2e test: load pages no errors by @edmondwinston in https://github.com/mage-ai/mage-ai/pull/4429
• [dy] Share main project logging config with workspaces by @dy46 in https://github.com/mage-ai/mage-ai/pull/4656

🐛 Bug Fixes

• [jk] Fix "filter is not a function" type error in schema props by @johnson-mage in https://github.com/mage-ai/mage-ai/pull/4686
• [xy] Fix list index out of range for dynamic blocks. by @wangxiaoyou1993 in https://github.com/mage-ai/mage-ai/pull/4688
• [xy] Set default domain for salesforce source by @wangxiaoyou1993 in https://github.com/mage-ai/mage-ai/pull/4689
• [dy] Handle JSON reading errors for elasticsearch by @dy46 in https://github.com/mage-ai/mage-ai/pull/4696
• [dy] Add try/except by @dy46 in https://github.com/mage-ai/mage-ai/pull/4683
• [jk] Update backfill policy to allow update on settings by @johnson-mage in https://github.com/mage-ai/mage-ai/pull/4706
• [dy] Fix logging for elasticsearch destination by @dy46 in https://github.com/mage-ai/mage-ai/pull/4709
• [xy] Add upstream_dbt_blocks method back to DBTBlockSQL. by @wangxiaoyou1993 in https://github.com/mage-ai/mage-ai/pull/4711
• [jk] Bugfix for pipeline interactions by @johnson-mage in https://github.com/mage-ai/mage-ai/pull/4710
• [xy] Catch sync schedules exception. by @wangxiaoyou1993 in https://github.com/mage-ai/mage-ai/pull/4717
• [xy] Fix pipeline metadata encoding issue. by @wangxiaoyou1993 in https://github.com/mage-ai/mage-ai/pull/4718
• [jk] Fix buggy pipeline dashboard by @johnson-mage in https://github.com/mage-ai/mage-ai/pull/4714
• Bugfix: Fix migration crash when using MSSQL as mage database by @tuokor in https://github.com/mage-ai/mage-ai/pull/4695
• [xy] Set repo_path when syncing trigger configs. by @wangxiaoyou1993 in https://github.com/mage-ai/mage-ai/pull/4719
• [jk] Allow file to be opened in Pipeline Editor without Command Center enabled by @johnson-mage in https://github.com/mage-ai/mage-ai/pull/4728
• [jk] Bugfix dock overlay by @johnson-mage in https://github.com/mage-ai/mage-ai/pull/4733
• [dy] Display error on oauth by @dy46 in https://github.com/mage-ai/mage-ai/pull/4734
• [jk] Avoid client error when making request before interactions are done loading by @johnson-mage in https://github.com/mage-ai/mage-ai/pull/4744
• Trino temp table location fix - Fixes issue https://github.com/mage-ai/mage-ai/issues/4738 by @sumanshusamarora in https://github.com/mage-ai/mage-ai/pull/4739
• [xy] Fix alter Snowflake table with lower_case=false by @wangxiaoyou1993 in https://github.com/mage-ai/mage-ai/pull/4750
• [jk] Fix block run sorting by @johnson-mage in https://github.com/mage-ai/mage-ai/pull/4751
• [dy] Fix sign in issue by @dy46 in https://github.com/mage-ai/mage-ai/pull/4753
• [dy] Fix elasticsearch destination by @dy46 in https://github.com/mage-ai/mage-ai/pull/4687
• fix the incorrect spelling by @ckfear in https://github.com/mage-ai/mage-ai/pull/4680
• [Bug] Resolve "parsing error" in the trino.mdx screen by @devharipragaz007 in https://github.com/mage-ai/mage-ai/pull/4702
• Pyarrow version conflicts from Snowflake connector by @Jawahars in https://github.com/mage-ai/mage-ai/pull/4707
• [dy] Update access token user queries and add tests by @dy46 in https://github.com/mage-ai/mage-ai/pull/4713
• bug fix with stripe sync by @sumanshusamarora in https://github.com/mage-ai/mage-ai/pull/4748

✨ New Contributors

• @devharipragaz007 made their first contribution in https://github.com/mage-ai/mage-ai/pull/4702
• @Jawahars made their first contribution in https://github.com/mage-ai/mage-ai/pull/4707
• @tuokor made their first contribution in https://github.com/mage-ai/mage-ai/pull/4695

Full Changelog: https://github.com/mage-ai/mage-ai/compare/0.9.65...0.9.66