Activities
Monitor pipeline runs, task executions, and orchestrations with detailed status tracking and object-level metrics.
Overview
Activities track every pipeline run, task execution, and orchestration with execution status, duration, row counts, and detailed object-level breakdowns.
Activity types:
- Pipeline Run - Ingestion pipeline execution (clickable for details)
- Activation Run - Activation pipeline execution (clickable for details)
- Task Run - SQL or Python task execution (list view only, not clickable)
Each pipeline run and activation run shows object-level details including ingestion mode (Historical or Incremental), incremental sync timestamps, and per-stage metrics (Ingest → Load).
To access: Navigate to Activities in the sidebar.
Activities List
The activities list shows all executions with search, filters, and auto-refresh.
List Columns
| Column | Description |
|---|---|
| Name | Activity name with icon (Pipeline Run, Activation Run, or Task Run) Activity ID shown below in gray |
| Started | Relative time (e.g., "6 days ago") |
| Duration | Execution time (e.g., "14s", "39m 59s") |
| Objects | Number of tables/objects synced (pipeline/activation runs only) Shows "-" for task runs |
| Rows | Total rows processed (pipeline/activation runs only) Shows "-" for task runs |
| Status | Status badge: Completed, Failed, Timed out, Running, etc. |
Search and Filters
Search Bar:
- Search by activity name
- Real-time filtering as you type
Type Filter:
- Default shows 2 types: Pipeline Run and Task Run
- Click to select/deselect: Pipeline Run, Activation Run, Task Run
- Shows count of selected types (e.g., "Type (2)")
Status Filter:
- Select multiple statuses: Completed, Failed, Timed out, Running, Queued, etc.
- Click Apply to filter
- Click Clear to reset
Refresh:
- Manual refresh button
- Shows "Last refreshed: less than a minute ago"
- Auto-refresh: ON when activities are running, OFF when all completed
Clicking an Activity
Pipeline Run and Activation Run:
- Click the row to open the activity detail page
- Shows detailed object-level breakdowns, ingestion modes, and stage metrics
Task Run:
- Not clickable - no detail page available
- View summary information in the list only
Canceling a Running Activity
To cancel:
- Hover over the status badge on any running activity (shows "In progress", "Queued", or "Picked")
- Badge transforms to show "Cancel" with an X icon
- Click the "Cancel" button
- Confirm cancellation in the modal
What happens:
- Activity stops executing
- Status changes to "Cancelled"
- Cannot be undone
Note: There may be a slight delay before execution fully stops.
Activity Detail Page
To open: Click any Pipeline Run or Activation Run in the activities list
The detail page shows comprehensive execution information with object-level breakdowns.
Header
Elements:
- Back arrow - Returns to activities list
- Pipeline name - Clickable link to open pipeline in IDE
- Status badge - Current status (Completed, Failed, Running, etc.)
Cancel button (running activities only):
- Hover over the status badge (transforms to "Cancel")
- Click to cancel execution
- Confirmation required before stopping
Summary Cards
Three cards display aggregate metrics:
Details Card
- Source → Destination with connector icons
- Started at - When execution began
- Duration - Total execution time
Objects Card
- Successful - Objects completed
- Queued - Objects waiting
- Failed - Objects with errors
- Running - Objects currently processing
Rows Card
- Ingested - Total rows read from source
- Loaded - Total rows written to destination
- Failed - Total rows that failed
- Max Latency - Highest latency observed
Totals are calculated from the object and stage metrics reported by the job. For a failed run, use the object list to identify whether the failure occurred during ingestion or loading.
Objects List
Display:
- Search bar to filter objects
- Status filter dropdown
- Refresh button with auto-refresh indicator
- Table showing all synced objects
Table Columns:
| Column | Description |
|---|---|
| Object Name | Table/object name with ingestion mode label Historical - Full sync Incremental - Only changes synced Hover to see incremental timestamp (e.g., "UPDATE_DATE: 2025-12-12T22:06:07.167535642") |
| Duration | Time to sync this object |
| Max Latency | Latency for this object |
| # Ingested | Rows read during ingestion |
| # Loaded | Rows written to destination |
| # Failed | Rows that failed |
| Status | Completed, Failed, Running, etc. |
Expand Object Details:
Click the chevron (▸) to expand any object and see stage-level breakdown:
Stage: Ingest
- Rows ingested from source
- Duration and latency metrics
Stage: Load
- Rows loaded to destination
- Duration and latency metrics
Hover or focus a failed status badge to read the status message reported for the job, object, or stage. Use the most specific stage message when troubleshooting; it is closer to the operation that failed than the overall job summary.
Merge Changed to Append
An object's Job Details can show Requested MERGE → APPEND when Generate UUID is selected and the object has no stable key. For a historical read, every returned row is appended, including rows already loaded. For an incremental read, changed records become additional rows and overlapping reads can repeat rows.
Choose a primary or unique key to update records in place. Where supported, Row hash can skip exact repeats, but changed rows are still added and identical source rows are merged into one. See Objects without a primary or unique key, including the reset that changing this setting requests.
Incremental Sync Positions
For objects synced incrementally, the ingestion mode shows "Incremental" label.
To view the cursor timestamp:
- Hover over the object name row
- Tooltip displays the incremental position (e.g., "UPDATE_DATE: 2025-12-12T22:06:07.167535642")
This timestamp shows where the last sync ended. The next incremental sync will start from this position.
Activity Statuses
| Status | Description |
|---|---|
| Completed | Successfully finished |
| Failed | Execution encountered errors |
| Timed out | Exceeded maximum execution time |
| Running | Currently executing (clickable to cancel) |
| Queued | Waiting to start |
Troubleshooting
Activity Stuck in "Running"
Problem: Activity shows "Running" status for extended period.
Solution:
- Hover over the status badge and click "Cancel" to stop the activity
- Check pipeline configuration for issues
- Verify source/destination connectivity
- Retry the pipeline run
Activity Failed
Problem: Activity shows "Failed" status.
Solution:
- Click the activity to view detail page
- Look for failed objects in the objects list
- Expand failed objects to see stage-level errors
- Common causes:
- Expired credentials
- Insufficient permissions
- Schema mismatches
- Connection timeouts
- Fix the underlying issue and retry
No Objects or Rows Shown
Problem: Objects and Rows columns show "-".
Solution:
- This is normal for Task Run activities (only pipeline/activation runs have object-level metrics)
- Ensure Type filter includes "Pipeline Run" or "Activation Run"
- If activity is still running, metrics populate when complete
Incremental Sync Not Working
Problem: Every run syncs full data instead of only changes.
Solution:
- Click activity to view detail page
- Check if objects show "Historical" instead of "Incremental"
- Verify pipeline has incremental cursor field configured
- Check source supports incremental sync
Related Pages
- Ingestion Pipelines - Create pipelines that generate activities
- Activation Pipelines - Reverse ETL activities
- Tasks - SQL and Python task executions
- Schedules - Automate activity execution
- Orchestrations - Multi-step workflow activities
Support
Need help? Contact us at support@supa-flow.io
Ask Claude