Ax Yuntong Hu, Yuting Zhang, Matthew Trager, Yi Zhang, Shuo Yang, Wei Xia, Stefano Soatto 19h ago

EvoMAS: Evolutionary Generation of Multi-Agent Systems

EvoMAS uses evolutionary methods to automatically generate LLM-based multi-agent system architectures, addressing brittleness and generalization challenges in MAS design.

Ax Jinwoo Kim, Taylor Berg-Kirkpatrick, Loris D'Antoni 19h ago

Continuous Diffusion Models Can Obey Formal Syntax

Training-free guidance for continuous diffusion language models to satisfy formal syntax constraints. Enables JSON/structured output generation without retraining.

Ax Gabriel Franco, Carson Loughridge, Mark Crovella 19h ago

Singular Vectors of Attention Heads Align with Features

Analysis of attention head singular vectors aligning with learned features in language models. Provides theoretical justification for mechanistic interpretability observations.

Ax Adam Zweiger, Xinghong Fu, Han Guo, Yoon Kim 19h ago

Fast KV Compaction via Attention Matching

Fast KV cache compaction using attention matching. Reduces key-value cache size for long-context LLM inference while maintaining performance.

Ax Hanna Herasimchyk, Robin Labryga, Tomislav Prusina, S\"oren Laue 19h ago

A Structural Theory of Position Bias in Transformers

Structural theory explaining position bias and Lost-in-the-Middle phenomenon in Transformers. Analyzes causal attention architecture origins of token position bias.

Ax Gabriel Raya, Bac Nguyen, Georgios Batzolis, Yuhta Takida, Dejan Stancevic, Naoki Murata, Chieh-Hsin Lai, Yuki Mitsufuji, Luca Ambrogioni 19h ago

Noise Scheduling as Information-Guided Allocation in Diffusion Training

InfoNoise adaptive noise scheduling for diffusion model training. Data-adaptive allocation based on conditional entropy to optimize denoising difficulty.

Ax Abduragim Shtanchaev, Albina Ilina, Yazid Janati, Arip Asadulaev, Martin Takac, Eric Moulines 19h ago

Sparse Scheduled Diffusion Guidance for Inverse Problems

Sparse scheduled diffusion guidance for Bayesian inverse problems. Reduces computational cost by applying guidance selectively through reverse trajectory.

HN uriva 20h ago

Why I Wrote Safescript

Safescript language design motivation: preventing supply chain attacks and hidden logic in AI-generated code via static analysis.

HN zfancy 1d ago

AgingBench: AI Agents Age Too

AgingBench research on long-context memory degradation in AI agents. Studies information loss and retrieval problems over time.