In recent years, multi-modal time series analysis has gained increasing attention for integrating insights from diverse data sources, enhancing both predictive performance and explanations across various domains. This growing interest is driven by the rapid production of heterogeneous data in the real world, where temporal signals often come not only in numerical form but are also accompanied by complementary modalities such as text, images, or structured metadata. By effectively leveraging information from different modalities, researchers can discover richer patterns and improve model performance in the application. We plan to present a comprehensive half-day tutorial at AAAI 2026, tailored for researchers and practitioners interested in multi-modal time series analysis. This tutorial provides insights into the theoretical and practical aspects of multi-modal time series, covering data characteristics and cross-modality modeling strategies for various downstream tasks. Attendees will also learn best practices for applying multi-modal time series analysis to real-world domains such as finance, healthcare, and transportation. Through these examples, participants will gain a clearer understanding of how to move from theoretical modeling to impactful deployment. The tutorial offers a comprehensive and in-depth understanding, practical skill development, and networking opportunities, connecting theory with real-world applications.
| Time | Speaker | Title |
|---|---|---|
| 2:00 pm - 2:10 pm | Dongjin Song | Opening and Introduction |
| 2:10 pm - 2:50 pm | Dongjin Song | Taxonomy of Multi-Modal Time Series Methods - Part 1 |
| 2:50 pm - 3:30 pm | Jinchao Ni | Taxonomy of Multi-Modal Time Series Methods - Part 2 |
| 3:30 pm - 4:00 pm | - | Break |
| 4:00 pm - 4:40 pm | Siru Zhong | Multi-Modal for Spatial-Temporal Data |
| 4:40 pm - 4:55 pm | Dongjin Song | Multi-Modal Time Series Applications and Datasets |
| 4:55 pm - 5:05 pm | Dongjin Song | Future Directions |
| 5:05 pm - 5:15 pm | - | Q&A |
File: MMTSA @ AAAI 2026_V3_online.pdf | Size: ~27 MB | Last updated: January 2026
Use the navigation buttons above to browse through the slides, or download the complete PDF for offline viewing.