November 11, 2024 Lakehouse Studio Product Update Release Notes

This release (Release 2024.11.11, v1.4) introduces a series of new features, enhancements, and bug fixes. Please note that these updates will be rolled out in phases to the following regions, and will be completed within one to two weeks from the release date, depending on your region.

Tencent Cloud Beijing
Tencent Cloud Shanghai
Tencent Cloud Guangzhou
Alibaba Cloud Shanghai
Alibaba Cloud Singapore
AWS Beijing
AWS Singapore

Breaking Changes

Permission Management: The permission scope of default roles has been adjusted. The original workspace_dev role has been split into workspace_dev and workspace_sre roles, separating development and operations roles. To use operations capabilities, the workspace_sre role must be added.

New Features

Real-time Sync: Added comparison and rollback capabilities on top of task version management.
Real-time Sync: Added quick copy functionality for virtual tables and virtual table rules.
Real-time Sync: Optimized data object selection filtering with support for multiple filter criteria.
Real-time Sync: Backfill sync filter conditions in operations now support multi-select.
Batch Sync: Added support for writing to Redis data sources in batch sync.
Security Center: Global audit now includes operation auditing for ad-hoc queries and result downloads.
Approval Center: Added quick filtering by operator in the completed approvals list.

Improvements

Product-Wide: Optimized and adjusted the overall layout and grouping of the primary navigation.
Real-time Sync: Added source table count statistics for sync objects, making it easier to quickly determine additions and deletions.
Task Development: Individual nodes on the task group DAG now support direct click-to-submit/publish and go-to-operations actions.
Task Development: Optimized the workflow for creating folders under the root node when creating new tasks.
Task Scheduling: Cron expressions for task scheduling are now translated into a human-readable format.
Operations Center: Optimized role-based fine-grained permission control capabilities.
Data Catalog: Optimized the processing pipeline for table structure changes (e.g., data object creation scenarios), improving the real-time display of data catalog information.
Data Catalog: Optimized the data management detail page style, with emphasis on field detail information.
Data Upload: Added automatic recognition of the JSON data format during file upload. Currently supports recognition with escape characters (/) before double quotes only.
Permission Approval: When clicking to request permissions, the current requester is now set as the default grantee user.

Bug Fixes

Approval Center: Fixed an issue where the withdraw action was not exposed for pending-approval items in list view on the request list page.
Approval Center: Fixed an issue where the page did not refresh after clicking an action on the approval page.
Permission Management: Fixed an issue where switching between Chinese and English after a newly created user logs in could clear permissions.

Known Limitations

Data Upload: Added automatic recognition of the JSON data format during file upload. Currently supports recognition with escape characters (/) before double quotes only.