Welcome to Xingyue Huang’s Personal Website

Welcome! 👋

I’m Xingyue Huang (黄星越), a DPhil student in Computer Science at the University of Oxford, supervised by Prof. Michael M. Bronstein and Dr. İsmail İlkan Ceylan. My work focuses on language models, AI agents, and foundation models, with an emphasis on structured reasoning and generalization.

I work on language model pre-training, long-context modeling, and efficient attention, as well as agent systems and architectures for tool-using, reasoning-oriented AI. My research background is in graph machine learning, knowledge graphs, and relational learning — studying how models reason over structured data and generalize to new entities, relations, and tasks.

My work has been published at ACL, NeurIPS, ICML, and ICLR. I’m especially interested in building LLM-based systems that reason reliably and use context effectively, and I’m open to connecting with people working on language models, agents, foundation models, and applied AI.

Research interests: Large Language Models, AI Agents, Foundation Models, Long-Context Modeling, Structured Reasoning, Retrieval-Augmented Generation, Knowledge Graphs, Graph Neural Networks, Relational Learning.


📰 News

RelAgent Released on arXiv

Published:

Our paper “RelAgent: LLM Agents as Data Scientists for Relational Learning” is now available on arXiv.

TDA Accepted to ACL 2026

Published:

Our paper “Threshold Differential Attention for Sink-Free, Ultra-Sparse, and Non-Dispersive Language Modeling” has been accepted to ACL 2026.

HTP Accepted to ACL 2026 (Oral)

Published:

Our paper “Hierarchical Token Prepending: Enhancing Information Flow in Decoder-based LLM Embeddings” has been accepted to ACL 2026 (Oral).

AnyCQ Released on arXiv

Published:

Our paper “One Model, Any Conjunctive Query: Graph Neural Networks for Answering Complex Queries over Knowledge Graphs” is now available on arXiv.

🛠️ Service

  • Reviewer: NeurIPS 2025 Top Reviewer, ICML 2026 Silver Reviewer, ICLR 2026
  • Workshop Organizer: NeurIPS 2025 SEA, ICML 2026 GFM