IAS Workshop on Mathematical Theory for Emergent Intelligence (July 17 - 18, 2023) IAS Workshop on Mathematical Theory for Emergent Intelligence (July 17 - 18, 2023)

Announcement
July 17, 2023 | 19:20 HKT
The workshop will be resumed tomorrow (July 18) following the schedule of Day 2 (July 18) as shown in the schedule page with registration time from 08:30 and first talk at 09:00.
 
July 17, 2023 | 07:30 HKT
As Hong Kong Observatory has issued the No. 8 SE Gale and Storm Signal, sessions of the workshop on July 17 will be cancelled.
Resumption of workshop will depend on the time when the Signal will be lowered. Please stay tuned for the latest updates on our website.

Stay safe everyone!
 
Overview

By any measure the success of contemporary approaches to artificial intelligence has been stunning. While the rise of neural networks, deep learning, and large language models has led to applications unthinkable even a few short years ago, many puzzles remain. Most perplexing perhaps is the deep question of *why* these models have proven so successful. This workshop intends to bring together mathematicians, computer scientists, and other researchers to explore this and related questions from a mathematical perspective. For instance,

Why did intelligence seem to appear when LLMs are big enough?
How big is big enough? 175B parameters (OpenAI GPT3)?
The intelligence “emerged” from GPT2 to GPT3 when model scaled 2 orders of magnitude. Will the same happened when we scale another 2 orders in model parameters from GPT3?
What kinds of training data will help intelligence “emerge”? Coding data?
Why are we still looking for “theory of anything” for deep learning especially with LLMs?
What might be the mathematical principles behind the emergent intelligence?
What are the right mathematical tools to study the emergent intelligence?

We hope to study these and many relevant and exciting problems at the workshop. Send us your questions and join us at HKUST for the workshop!

Group Photo

Organizers and the participants gather for a group photo.

Organizers
Harry SHUM
HKUST (IAS Professor-at-Large Emeritus)
Yi MA
The University of Hong Kong and University of California, Berkeley
Andrew COHEN
HKUST (IAS Director, and Lam Woo Foundation Professor)
Qifeng CHEN
HKUST
Sponsor
Citadel | Citadel securities