div class="header-overlay">

MMTSA: AAAI'26 Tutorial




Multi-Modal


Time Series Analysis:




Methods, Datasets, and Applications


In recent years, multi-modal time series analysis has gained increasing attention for integrating insights from diverse data sources, enhancing both predictive performance and explanations across various domains. This growing interest is driven by the rapid production of heterogeneous data in the real world, where temporal signals often come not only in numerical form but are also accompanied by complementary modalities such as text, images, or structured metadata. By effectively leveraging information from different modalities, researchers can discover richer patterns and improve model performance in the application. We plan to present a comprehensive half-day tutorial at AAAI 2026, tailored for researchers and practitioners interested in multi-modal time series analysis. This tutorial provides insights into the theoretical and practical aspects of multi-modal time series, covering data characteristics and cross-modality modeling strategies for various downstream tasks. Attendees will also learn best practices for applying multi-modal time series analysis to real-world domains such as finance, healthcare, and transportation. Through these examples, participants will gain a clearer understanding of how to move from theoretical modeling to impactful deployment. The tutorial offers a comprehensive and in-depth understanding, practical skill development, and networking opportunities, connecting theory with real-world applications.

Schedule

Time: 2PM-6PM January 20 | Room: Garnet 217

Tutorial Details | AAAI-26 Tutorial and Lab Forum Schedule

TimeSpeakerTitle
2:00 pm - 2:10 pm Dongjin Song Opening and Introduction
2:10 pm - 2:50 pm Dongjin SongTaxonomy of Multi-Modal Time Series Methods - Part 1
2:50 pm - 3:30 pm Jinchao NiTaxonomy of Multi-Modal Time Series Methods - Part 2
3:30 pm - 4:00 pm - Break
4:00 pm - 4:40 pm Siru ZhongMulti-Modal for Spatial-Temporal Data
4:40 pm - 4:55 pm Dongjin Song Multi-Modal Time Series Applications and Datasets
4:55 pm - 5:05 pm Dongjin Song Future Directions
5:05 pm - 5:15 pm - Q&A
 

Presenters

 

Dongjin Song

Associate Professor
University of Connecticut

 

Jingchao Ni

Assistant Professor
University of Houston

 

Siru Zhong

Ph.D.
Hong Kong University of Science and Technology (GZ)

 

Contributors

 

Yuxuan Liang

Assistant Professor
Hong Kong University of Science and Technology (GZ)

 

Zijie Pan

Ph.D.
University of Connecticut

 

Haifeng Chen

Department Head
NEC Laboratories America

 
 
 
 

Yuriy Nevmyvaka

Managing Director
Morgan Stanley

Tutorial Slides

Total Pages: 166

File: MMTSA @ AAAI 2026_V3_online.pdf | Size: ~27 MB | Last updated: January 2026

Use the navigation buttons above to browse through the slides, or download the complete PDF for offline viewing.