2025.04.01 Lakehouse Studio Release Notes

In this release (Release 2025.04.01, v1.8), we have introduced a series of new features, enhancements, and fixes. Please note that these updates will be rolled out gradually to the following regions over one to two weeks starting from the release date, depending on your region:

• Tencent Cloud Shanghai
• Tencent Cloud Beijing
• Tencent Cloud Guangzhou
• Alibaba Cloud Shanghai
• Alibaba Cloud Singapore
• AWS Singapore
• AWS Beijing

Incompatible Changes

• None

New Features

• Data Sync:

  • Multi-table Real-time Sync: MySQL CDC sync to Lakehouse tables now supports synchronizing comments from source tables and fields to the target.
  • Batch Sync: DynamoDB now supports writing user-defined custom field types.

• Task Development:

  • Query results now include visualization chart capability, supporting transformation of data results into visual charts and conveying logical relationships through trend charts and bar charts to assist in analysis and decision-making. See: Data Visualization
  • Task groups now support batch cluster modification capability.
  • File directory tree now supports search and filtering by file ID.

• Compute Clusters:

  • Added cluster resource monitoring to view historical changes in cluster specifications and instance counts, providing insight into cluster auto-scaling behavior.
  • Added job concurrency monitoring to view job concurrency status, facilitating reference for job concurrency numbers and queue conditions to adjust compute cluster resource specifications.

• Data Quality: Added support for data quality monitoring of three object types: Pipe, Volume, and Table Stream, including metrics such as consumption backlog delay.

• Management Center: Supports adding note information for users.

• Security Center: Added support for instance-level custom role functionality. Instance-level custom roles can be granted data permissions across multiple workspaces simultaneously, facilitating cross-workspace data usage.

Optimizations

• Product-wide:

  • Distinguished between strong and weak prompt information within the product, emphasizing important prompts to reduce misoperations caused by missing critical information.
  • Optimized personal information popup display to surface all key information.
  • Changed product help documentation jump address to the official product website.

• Data Sync:

  • Batch sync task configuration now supports filtering data source selection by data source type and data source name.
  • Batch tasks: DDL statements for table creation now handle special characters in source table names compatibly, automatically converting them to underscores to avoid table creation failures.

• Task Development:

  • After using use schema or use vcluster statements in code, they now automatically echo back and link with the schema and VC configured on the page.
  • When batch copying task groups and merging copied tasks into a new folder, supports the option to not add suffixes.
  • Added search functionality for table information under the data tree to help users quickly search column information within tables.
  • Task groups now support adding virtual nodes.
  • Field selection in visualization charts now supports fuzzy search.

• Management Center: Added strong prompts for account disabling and deletion, reminding operators to transfer ownership of tasks and other objects before proceeding with the operation.

Bug Fixes

• Management Center: Fixed issue with occasional incomplete permission initialization for newly registered accounts affecting feature usage.

• Data Sync:

  • Fixed issue where target tables were cleared when importing from Hive to Lakehouse if errors occurred on the source side.
  • Fixed sync error issue for Oracle data source number[1,6] field and clob field types.

• Task Development: Fixed issue where entering keywords in code search could not find corresponding files.

• Security Center: Fixed issue with incomplete permission grants for workspace_dev role in some workspaces.

• Operations Center: Fixed issue where overall backfill status did not change when backfill instances were killed due to exceeding scheduled wait time in backfill tasks.

• Job History: Fixed rendering stage issue for DESC statements.

Known Limitations

• There are no known major limitations introduced in this release.