Comet Data Operations Dashboard
Agent-managed view of data operations lifecycle with real-time ingestion status, transfer metrics, and anomaly detection.
Comet Data Transfer Engine
Real-time monitoring of data ingestion and transfer operations
Active Pipelines
1 failed
Total Throughput
+12% from yesterday
Files Processed
of 83.5K total
Anomalies
1 critical, 1 warning
Throughput History (24h)
Transfer rates by data modality over time
Active Pipelines
Real-time status of data transfer pipelines
Imaging Pipeline - Microscopy
Updated 2 min ago
Throughput
2.4 GB/min
Files Processed
12,847 / 15,000
Progress
85.6%
Omics Pipeline - RNA-Seq
Updated 1 min ago
Throughput
890 MB/min
Files Processed
342 / 500
Progress
68.4%
Tabular Pipeline - Assay Results
Updated 5 min ago
Throughput
45 MB/min
Files Processed
8,921 / 10,000
Progress
89.2%
Metadata Pipeline - Annotations
Updated 30 sec ago
Throughput
12 MB/min
Files Processed
45,230 / 50,000
Progress
90.5%
Imaging Pipeline - Pathology
Updated 15 min ago
Throughput
0 GB/min
Files Processed
2,341 / 8,000
Progress
29.3%
Volume by Modality
Total data transferred today
Detected Anomalies
Agent-identified issues requiring attention
Imaging Pipeline - Pathology
Pipeline halted: Connection timeout after 3 retries
15 min ago
Suggested action: Check storage backend connectivity
Tabular Pipeline - Assay Results
Throughput degradation detected: 40% below 24h baseline
5 min ago
Suggested action: Review source system load
Omics Pipeline - RNA-Seq
Unusual file size distribution in batch OMC-2024-0892
1 hour ago
Suggested action: Verify source data integrity
Recent Transfers
Latest file transfer activity
microscopy_batch_2024_01_30.tar.gz
2.4 GB
rnaseq_sample_cohort_A.fastq.gz
890 MB
assay_results_plate_042.csv
45 MB
67%
pathology_slide_WSI_0892.svs
1.8 GB
sample_annotations_v3.json
12 MB
Features
Real-time Ingestion Tracking
Monitor data ingestion status across pipelines with live progress indicators and throughput metrics.
Data Modality Breakdown
View transfer volumes by modality: imaging, omics, tabular, and metadata with visual breakdowns.
Anomaly Detection
Agent-powered anomaly highlighting surfaces failures and unusual patterns without manual log inspection.
Historical Metrics
Time-series visualization of transfer rates and pipeline health over configurable time windows.
Data Modalities
Use Cases
- • Data platform operations monitoring
- • Pipeline health dashboards
- • Transfer throughput optimization
- • Failure triage and root cause analysis
- • Capacity planning and forecasting
Key Dependencies
Built with shadcn/ui components and Recharts for visualization. All data is mocked for demonstration.