Data Integration
Singdata Lakehouse Studio includes a full-featured data integration capability that supports 40+ data sources with visual configuration — no coding required. It covers real-time CDC sync, offline batch sync, full-database migration, and more.
Choosing a Sync Approach
| My scenario | Recommended approach | Documentation |
|---|---|---|
| MySQL / PG / Oracle or similar — single-table real-time CDC | Real-time sync task | Real-time Sync Task |
| Full-database migration, syncing multiple tables together | Multi-table real-time sync | Multi-table Real-time Sync Complete Guide |
| Scheduled batch sync (T+1 or hourly) | Offline sync task | Offline Sync Task |
| Full-database offline migration, multiple tables at once | Multi-table offline sync | Multi-table Offline Sync Task |
| Not sure which to use | Check supported sources | Data Source Support |
Quick Start
Step 1 — Configure a data source: add the connection details for your source database
Step 2 — Create a sync task based on your scenario (see the table above)
Step 3 — Configure a scheduling policy and publish the task
Step 4 — Monitor run status and configure alerting
Scheduling, Deployment, and Operations
| Scenario | Documentation |
|---|---|
| Configure scheduled runs and task dependencies | Task Scheduling · Task Scheduling Dependencies |
| Publish / unpublish a task | Task and Instance Operations |
| View run history, logs, and failure details | Task and Instance Operations |
| Configure alert notifications (DingTalk / Lark / email) | Monitoring and Alerting |
| Understand monitoring metric definitions | Monitoring Metric Specifications |
| Backfill historical data | Data Backfill Tasks |
Contents of This Section
| Page | Description |
|---|---|
| Overview | Basic concepts, task types, and core components of data sync |
| Data Source Management | Add and manage data source connections |
| Supported Data Sources | List of 40+ supported data sources |
| Data Source Configuration Guide | Detailed setup steps for each database type |
| Offline Sync Task | Scheduled batch sync with full and incremental modes |
| Multi-table Offline Sync Task | Full-database offline migration |
| Real-time Sync Task | Single-table real-time CDC sync |
| Multi-table Real-time Sync Task | Full-database real-time CDC sync |
| Multi-table Real-time Sync Complete Guide | End-to-end SOP for full-database migration |
| Offline Sync FAQ | Common questions and usage guide |