Ax Yunhe Li, Hao Shi, Bowen Deng, Wei Wang, Mengzhe Ruan, Hanxu Hou, Zhongxiang Dai, Siyang Gao, Chao Wang, Shuang Qiu, Linqi Song 4/20/2026

Learning to Reason with Insight for Informal Theorem Proving

arXiv paper proposing framework for informal theorem proving with LLMs using insight-driven reasoning.

Ax Luke Braithwaite, Alessio Borgi, Gabriele Onorato, Kristjan Tarantelli, Iulia Duta, Francesco Restuccia, Fabrizio Silvestri, Pietro Li\`o 4/20/2026

Heterogeneous Sheaf Neural Networks

arXiv paper proposing HetSheaf, a framework for heterogeneous graph neural networks across different node/edge types.

Ax Daniel Jenson, Jhonathan Navott, Mengyan Zhang, Makkunda Sharma, Elizaveta Semenova, Seth Flaxman 4/20/2026

Transformer Neural Processes - Kernel Regression

arXiv paper on HetSheaf framework for heterogeneous graph neural networks supporting multiple node/edge types in real-world applications.

Ax Witold Wydma\'nski, Marek \'Smieja 4/20/2026

AutoNFS: Automatic Neural Feature Selection

arXiv paper on Few-Shot Preference Optimization (FSPO) for personalizing LLMs using meta-learning on synthetic preference data.

Ax Zhucong Li, Powei Chang, Jin Xiao, Zhijian Zhou, Qianyu He, Jiaqing Liang, Fenglei Cao, Xu Yinghui, Yuan Qi 4/20/2026

ChemAmp: Amplified Chemistry Tools via Composable Agents

ChemAmp: Framework for composable LLM agents in chemistry using tool amplification to enhance multi-tool orchestration capabilities.

Ax Paul Janson, Benjamin Therien, Quentin Anthony, Xiaolong Huang, Abhinav Moudgil, Eugene Belilovsky 4/20/2026

PyLO: Towards Accessible Learned Optimizers in PyTorch

PyLO: PyTorch package making learned optimizers accessible, providing drop-in replacements for standard optimizers like Adam.

Ax Tian Qin, Felix Bai, Ting-Yao Hu, Raviteja Vemulapalli, Hema Swetha Koppula, Zhiyang Xu, Bowen Jin, Mert Cemri, Jiarui Lu, Zirui Wang, Meng Cao 4/20/2026

COMPASS: Benchmarking Constrained Optimization in LLM Agents

COMPASS benchmark evaluating LLM agents' ability to perform constrained optimization in multi-turn conversations for travel planning and scheduling tasks.

Ax William Merrill, Yanhong Li, Tyler Romero, Anej Svete, Caia Costello, Pradeep Dasigi, Dirk Groeneveld, David Heineman, Bailey Kuehl, Nathan Lambert, Chuan Li, Kyle Lo, Saumya Malik, DJ Matusz, Benjamin Minixhofer, Jacob Morrison, Luca Soldaini, Finbarr Timbers, Pete Walsh, Noah A. Smith, Hannaneh Hajishirzi, Ashish Sabharwal 4/20/2026

Olmo Hybrid: From Theory to Practice and Back

Hybrid language models mixing RNNs and attention mechanisms, comparing performance advantages over pure transformers with theoretical and practical evidence.

Ax Mingchen Zhuge, Changsheng Zhao, Haozhe Liu, Zijian Zhou, Shuming Liu, Wenyi Wang, Ernie Chang, Gael Le Lan, Junjie Fei, Wenxuan Zhang, Yasheng Sun, Zhipeng Cai, Zechun Liu, Yunyang Xiong, Yining Yang, Yuandong Tian, Yangyang Shi, Vikas Chandra, J\"urgen Schmidhuber 4/20/2026

Neural Computers

Proposes Neural Computers that unify computation, memory, and I/O in learned runtime states, exploring general-purpose neural machine architectures.