Continual and Multimodal Learning for Internet of Things

August 21, 2021 • Montreal, Qu├ębec, Canada

Co-located with IJCAI 2021


Internet of Things (IoT) provides streaming, large-amount, and multimodal sensing data over time. The statistical properties of these data are often significantly different by sensing modalities and temporal traits, which are hardly captured by conventional learning methods. Continual and multimodal learning allows integration, adaptation and generalization of the knowledge learnt from previous experiential data collected with heterogeneity to new situations. Therefore, continual and multimodal learning is an important step to improve the estimation, utilization, and security of real-world data from IoT devices.

Call for Papers

This workshop aims to explore the intersection and combination of continual machine learning and multimodal modeling with applications in Internet of Things. The workshop welcomes works addressing these issues in different applications and domains, such as natural language processing, computer vision, human-centric sensing, smart cities, health, etc. We aim at bringing together researchers from different areas to establish a multidisciplinary community and share the latest research.

We focus on the novel learning methods that can be applied on streaming multimodal data:

  • continual learning
  • transfer learning
  • federated learning
  • few-shot learning
  • multi-task learning
  • reinforcement learning
  • learning without forgetting
  • individual and/or institutional privacy
  • manage high volume data flow

  • We also welcome continual learning methods that target:

  • data distribution changed caused by the fast-changing dynamic physical environment
  • missing, imbalanced, or noisy data under multimodal sensing scenarios

  • Novel applications or interfaces on streaming multimodal data are also related topics.

    As examples, the data modalities include but not limited to: image, video, audio, speech, natural language, virtual reality, biochemistry, WiFi, GPS, RFID, vibration, accelerometer, pressure, temperature, humidity, etc.

    Important Dates

  • Submission deadline: May 4, 2021
  • Notification of acceptance: May 25, 2021
  • Deadline for camera ready version: June 8, 2021
  • Workshop: August 21, 2021
  • Submit Now

    Submission Guidelines (TBA)

    Keynote (TBA)


    Workshop Chairs (Feel free to contact us by, if you have any questions.)
  • Tong Yu (Adobe Research)
  • Susu Xu (Stony Brook University)
  • Handong Zhao (Adobe Research)
  • Ruiyi Zhang (Duke University)
  • Shijia Pan (UC Merced)

  • Advising Committee (TBA)

    Technical Program Committee (TBA)

    Agenda (TBA)

    Copyright © All Rights Reserved | This template is made with by Colorlib