I'm a first-year PhD student in Cognitive Sciences at UC Irvine, advised by Mark Steyvers and Aaron Bornstein. With Mark I work on AI intervention in learning; we build Bayesian cognitive models of stuckness in problem solving and use them to decide when an AI should step in. Aaron and I study multi-agent foraging. We model how learning agents converge to the ideal free distribution and ask whether groups forage best near the edge of chaos.

Over the past few years I've worked on computational models of episodic memory, theory of mind in LLMs, visual reasoning in vision-language models, multi-agent reinforcement learning, collective behavior and nonlinear dynamics, human-AI interaction in learning, and, on the side, anomaly detection in blockchain transactions. Outside of projects I keep coming back to cellular automata, chaotic attractors and spiking neural networks, to some mathematics (algebraic topology, fractal geometry), and to philosophy of mind (perception and consciousness above all) and philosophy of logic.

Before UCI I did an M.S. at NYU with Sebastian Michelmann and Marcelo Mattar on episodic memory encoding with generative models. I studied computer science at Tsinghua and, from 2022 to 2024, worked on multi-agent reinforcement learning at BIGAI. In summer 2023 I was at MIT with Tianmin Shu and Josh Tenenbaum on machine theory of mind.

Hao Liu in front of the old gate at Tsinghua University

News

  • 2026-10Preprint on episodic memory encoding, with Marcelo Mattar and Sebastian Michelmann, is on bioRxiv. Code and data are on Zenodo.
  • 2026-10HopToM, on higher-order theory of mind in LLMs, is on arXiv.
  • 2026-09Started my PhD at UC Irvine.
  • 2026-05KnotBench is on arXiv.

Publications

Learning distributed representations with complementary components: A generative approximation framework for episodic memory encoding
Hao Liu, Marcelo Mattar, Sebastian Michelmann
bioRxiv, 2026 [bioRxiv] [code & data]
[bib]
@article{liu2026learning,
  title   = {Learning distributed representations with complementary components: A generative approximation framework for episodic memory encoding},
  author  = {Liu, Hao and Mattar, Marcelo and Michelmann, Sebastian},
  journal = {bioRxiv},
  year    = {2026},
  doi     = {10.64898/2026.10.18.759853}
}
Beyond Belief Nesting: Rethinking Higher-Order Theory of Mind in Large Language Models
Shanshan You, Zhengqi Wang, Hao Liu, Yuqin Liu, Ya He, Xin Hao, Liyuan Wang
arXiv:2610.17777, 2026 [arXiv]
[bib]
@article{you2026beyond,
  title   = {Beyond Belief Nesting: Rethinking Higher-Order Theory of Mind in Large Language Models},
  author  = {You, Shanshan and Wang, Zhengqi and Liu, Hao and Liu, Yuqin and He, Ya and Hao, Xin and Wang, Liyuan},
  journal = {arXiv preprint arXiv:2610.17777},
  year    = {2026}
}
The Gordian Knot for VLMs: Diagrammatic Knot Reasoning as a Hard Benchmark
Hao Liu, Jicheng Liu
arXiv:2605.09900, 2026 [arXiv]
[bib]
@article{liu2026gordian,
  title   = {The Gordian Knot for VLMs: Diagrammatic Knot Reasoning as a Hard Benchmark},
  author  = {Liu, Hao and Liu, Jicheng},
  journal = {arXiv preprint arXiv:2605.09900},
  year    = {2026}
}
BlockScan: Detecting Anomalies in Blockchain Transactions
Jiahao Yu, Xian Wu, Hao Liu, Wenbo Guo, Xinyu Xing
NeurIPS 2025 [arXiv]
[bib]
@inproceedings{yu2025blockscan,
  title     = {BlockScan: Detecting Anomalies in Blockchain Transactions},
  author    = {Yu, Jiahao and Wu, Xian and Liu, Hao and Guo, Wenbo and Xing, Xinyu},
  booktitle = {Advances in Neural Information Processing Systems},
  year      = {2025}
}
AdaSociety: An Adaptive Environment with Social Structures for Multi-Agent Decision-Making
Yizhe Huang, Xingbo Wang, Hao Liu, Fanqi Kong, Aoyang Qin, Min Tang, Song-Chun Zhu, Mingjie Bi, Siyuan Qi, Xue Feng
NeurIPS 2024, Datasets and Benchmarks [arXiv] [code]
[bib]
@inproceedings{huang2024adasociety,
  title     = {AdaSociety: An Adaptive Environment with Social Structures for Multi-Agent Decision-Making},
  author    = {Huang, Yizhe and Wang, Xingbo and Liu, Hao and Kong, Fanqi and Qin, Aoyang and Tang, Min and Zhu, Song-Chun and Bi, Mingjie and Qi, Siyuan and Feng, Xue},
  booktitle = {Advances in Neural Information Processing Systems},
  volume    = {37},
  year      = {2024}
}

Projects

● has a paper

  1. 2026–○
    Stuckness and AI intervention in learning
    UC Irvine, with Mark Steyvers · ongoing
    • When should an AI intervene while someone is learning to solve problems, and with what kind of help? Stepping in too early can cut short productive struggle, which often helps people learn.
    • We build Bayesian cognitive models that infer, from moves, restarts and response times, whether a solver is in productive struggle or stuck.
    • Data come from online Sokoban experiments. Later ones vary hint timing and hint type, next-step versus strategy-level.
    Three small Sokoban levels drawn flat: grey walls, black boxes, green goal dots, boxes already on goals in green, and a ring for the playerThree small Sokoban levels drawn flat: grey walls, black boxes, green goal dots, boxes already on goals in green, and a ring for the player
    Push every box onto a green dot; the ring is the player. Three Microban levels by David W. Skinner.
  2. 2026–○
    Multi-agent foraging and the edge of chaos
    UC Irvine, with Aaron Bornstein · ongoing
    • Our working hypothesis is that collective foraging is most efficient near the edge of chaos, between ordered and chaotic regimes.
    • How do groups of learning agents converge to the ideal free distribution, and what does each forager need to predict about the patches and the other foragers?
    • Agent-based models with depleting patches, in which foragers forecast yield and crowding and share what they saw by word of mouth. We analyze them with bifurcation diagrams and Lyapunov exponents, and plan a multiplayer version for human groups.
    Three panels of 100 simulated foragers over 120 steps, green when at patch A, with the share at A above each: speckled and steady at beta 400, bursts at beta 1300, nobody moving at beta 2500Three panels of 100 simulated foragers over 120 steps, green when at patch A, with the share at A above each: speckled and steady at beta 400, bursts at beta 1300, nobody moving at beta 2500
    1,000 simulated foragers who share news by word of mouth; 100 of them shown, green when at patch A. As choices get sharper the crowd goes from steady to chaotic to frozen.
    Bifurcation diagram: one branch splits in two, then period doubling leads into chaotic bands with periodic windows, which end in a period-4 cycleBifurcation diagram: one branch splits in two, then period doubling leads into chaotic bands with periodic windows, which end in a period-4 cycle
    Bifurcation diagram of the two-patch model with an infinite crowd: period doubling into chaos as β grows.
  3. 2026●
    Higher-order theory of mind in LLMs (HopToM)
    Tsinghua, with Liyuan Wang's group [arXiv]
    Figure 2 of the HopToM paper: belief nesting can overstate effective order
    Fig. 2 of the paper
    • Many benchmark questions that look higher-order can be answered with lower-order reasoning. We define a question's effective order by the distinct events behind each belief prefix, and by that measure existing benchmarks overstate the order they test.
    • HopToM has questions certified to need full-order reasoning. Accuracy of four frontier LLMs falls from 73.5% at first order to 20.0% at fourth order.
    • HopTrace encodes each interaction once into perspective records and answers nested queries from them, gaining 22.0 and 38.5 points at fourth and fifth order with 20 to 39 times fewer tokens than multi-call methods.
  4. 2026●
    Diagrammatic knot reasoning in vision-language models (KnotBench)
    with Jicheng Liu [arXiv]
    Three drawings of the trefoil knot with 3, 5 and 7 crossings
    Fig. 2 of the paper: three drawings of the same knot
    • 858,318 knot diagrams from 1,951 prime knots with crossing numbers 3 to 19. Answers are checked against Regina's canonical knot signature, so no human labels are involved.
    • 14 tasks in four families (equivalence judgment, move prediction, identification, cross-modal grounding). Each task has an image and a symbolic version, which separates failures of perception from failures of operating on the structure.
    • Frontier VLMs, with and without reasoning modes, stay near chance on many tasks. They seem to encode features of a diagram but cannot simulate Reidemeister moves on it.
  5. 2024–26●
    Episodic memory encoding as generative approximation
    Figure 2A to C of the memory paper: reconstructions over inversion steps and the encoding and reinstatement schematic
    Fig. 2A–C of the paper
    • A pretrained generative network approximates each input through its frozen weights, and the memory is the starting point from which the same weights reinstate it. This removes the need for mutually invertible cortical-hippocampal mappings and trades computational effort for mnemonic precision.
    • Implemented with a toy model and with large image generators (Stable Diffusion, StyleGAN-XL). Shallow encoding selectively impairs lure rejection on the Mnemonic Similarity Task, as in aging, and domain-finetuned models need fewer approximation steps for in-domain images.
    • The representational geometry of the latent starting points resembles the medial temporal lobe, while reinstatement traverses the visual hierarchy in reverse order.
  6. 2025○
    Hierarchical and meta-reinforcement learning of task representations in sparse-reward environments. NYU, with Marcelo Mattar & Qihong Lu
  7. 2025○
    A side project that renders citation networks as weather maps, with paper density as pressure and citation flow as wind.
  8. 2024●
    Anomaly detection in blockchain transactions (BlockScan)
    Northwestern, with Xinyu Xing & Wenbo Guo [arXiv]
    Figure 1 of the BlockScan paper: how transactions are tokenized
    Fig. 1 of the paper
    • A Transformer built for blockchain transactions, which mix chain-specific tokens with text and numbers. A modular tokenizer balances information across these modalities, and pretraining uses a masked language modeling objective adapted to long transaction sequences.
    • On Ethereum and Solana it keeps false positives low. On Solana it was the only method tested that found the anomalous transactions with high accuracy.
  9. 2023–24○
    Emergent communication in cooperative multi-agent RL, beyond referential games. Tsinghua, with Hang Su
  10. 2023○
    LLM agents with theory of mind that decide when to communicate in embodied household tasks (Watch-Talk-Help). MIT, with Tianmin Shu & Josh Tenenbaum
  11. 2022–24●
    Multi-agent environment with adaptive social structures (AdaSociety)
    BIGAI, with Siyuan Qi & Xue Feng [arXiv] [code]
    Figure 1 of the AdaSociety paper: physical and social components of the environment
    Fig. 1 of the paper
    • A customizable multi-agent environment whose state and action spaces grow as agents act. Social structure is an explicit, changeable part of the state and decides how rewards and information are shared. Three mini-games vary it.
    • Some social structures improve both individual and group outcomes, but current RL and LLM-based agents make little use of them.
  12. 2022○
    A Chinese financial language model pretrained on 15 GB of market text. Tsinghua, with Maosong Sun
  13. 2021–22○
    Retrieval-based question answering over a million Zhihu question-answer pairs, with BM25 and BERT. Tsinghua, with Minlie Huang
  14. 2021–22○
    Self-supervised ViT pretraining on ImageNet-1K, implemented from scratch.
  15. 2017–19○
    Classifying pollution images with hand-crafted features, my high school project. Nankai, with Ming-Ming Cheng

Background

  • 2026–PhD, Cognitive Sciences, UC Irvine
  • 2024–26M.S., Cognitive Psychology, New York University
  • 2023Summer research intern, Brain and Cognitive Sciences, MIT
  • 2022–24Research intern, multi-agent group, BIGAI
  • 2020–24B.E., Computer Science and Technology, Tsinghua University (first year in Electronic Engineering)

454 visits since April 2026. Counted by GoatCounter, no cookies.

United States: 10Canada: 5Hong Kong: 1

where visits came from since 2026-11-01: 16 visits, 3 countries