Accelerating Sparse Transformer Inference on GPU
Optimizes sparse Transformer inference on GPUs through parallelization and operator fusion to reduce computation from mask-induced sparsity in LLMs.
Optimizes sparse Transformer inference on GPUs through parallelization and operator fusion to reduce computation from mask-induced sparsity in LLMs.
Fine-tuning approach for LLMs specialized in algorithm design through supervised learning, comparing against general-purpose models.
Fusion-attention network for indoor scene inference in integrated sensing and communication systems using multi-encoder approach.
Neural operator method for long-term turbulence forecasting combining differential and integral operations for physical fidelity.
Aggregation algorithms for multi-agent LLM reasoning leveraging model heterogeneity and answer correlations beyond majority voting.
Transformer architecture for spatio-temporal field reconstruction from sparse sensor networks with locality inductive biases.
Framework for training diffusion-based neural samplers on multimodal distributions using proximal stochastic optimal control.
Hierarchical approach to model merging via Re-Basin algorithm that improves robustness properties of merged neural networks.
Benchmark with 438 web navigation subtasks for evaluating multimodal AI agents on real-world UI interactions.
Semi-supervised deep learning method for archaeological site discovery using asymmetric pseudolabeling under label scarcity.
RL method for training LLM agents without hand-crafted tasks via self-play search, enabling unsupervised agent capability scaling.
Noise-robust variant of Group Relative Policy Optimization for LLM alignment and reasoning models under reward noise.
Method addressing temporal leakage and data limitations in information cascade prediction for social networks.
Theoretical framework for online bilevel optimization with stochastic regret guarantees for dynamic ML objectives.
Industrial recommendation system scaling long-sequence user behavior modeling to 10K histories using cross-attention mechanisms.
Training-free optimization technique for accelerating diffusion model sampling by finding optimal timestep schedules.
Self-supervised ML method for annotating birdsong audio with minimal training data using residual neural networks.
Graph neural network architecture using gauge equivariance and interference cancellation for heterophilic graph learning.
Research on domain adaptation for ML systems handling data distribution shifts and open-set recognition with theoretical guarantees.
BERTO: BERT-based framework for network traffic forecasting with natural language preference operators.
MaxShapley algorithm for fair attribution and compensation of content sources in generative search systems.
Information-theoretic approach to reduce inductive bias in reward models for RLHF training of LLMs.
Conformal prediction method using density-weighted quantile regression for conditional coverage guarantees in ML.
Federated learning framework using bi-level optimization for one-shot knowledge distillation on non-IID medical data.
Framework for recovering reward functions in two-player games using inverse game theory with entropy regularization.
Q-learning algorithm for continuous-action RL that optimizes diffusion/flow-matching policies using first-order critic information.
Defense framework providing certified robustness for deep learning models against feature-space attacks.
Training-free inference method for RL-aligned LLMs using energy-guided sampling without costly post-training.
Improves GRPO reinforcement learning for LLMs by addressing gradient vanishing and diversity collapse through transformation augmentation.
Analysis of weight update sparsity in distributed RL for LLM post-training, showing 99% invisible updates enabling communication-efficient training.
Continual learning method using Douglas-Rachford operator to reduce gradient conflicts without external memory or parameter regularization.
Analysis of RL for diffusion models showing importance of likelihood estimation beyond loss design for policy-gradient methods on visual tasks.
Study demonstrating vanilla LoRA with proper learning rate tuning matches or exceeds recent LLM fine-tuning variants, challenging complexity claims.
CMAD framework for composing multiple pre-trained diffusion models via stochastic optimal control without explicit target distribution knowledge.
Reward-Conditioned RL (RCRL) off-policy method conditioning agents on reward parameterizations for robustness to reward misspecification.
Overview and benchmarking of synthetic data generation methods for brain-computer interfaces to address limited neural recording data.
RE-SAC ensemble DRL approach for bus fleet control that disentangles aleatoric and epistemic uncertainty to improve stability.
Causal evidence that language models use internal confidence signals to control behavior like answer abstraction. Four-phase investigation paradigm.
Empirical study examining how class ontology and data scale affect transfer learning performance in audio deep learning tasks.
Target-Aligned Reinforcement Learning (TARL) addresses stability-recency tradeoff in value-based deep RL by refining target network mechanisms.
Discrete Tilt Matching: Likelihood-free RL fine-tuning for masked diffusion LLMs. Addresses intractability of sequence-level likelihoods in masked language model training.
MoBayes: Modular Bayesian framework separating reasoning from language in clinical decision support. Adds explicit posterior tracking and auditable reasoning to LLM-based systems.
Proposes agent-native research artifacts to replace linear paper narratives. Addresses storytelling and engineering tax by enabling AI agents to process and use full research exploration.
Studies transfer of frozen Gemma 4 31B attention head patterns across modalities. Analyzes head importance fingerprints for non-text tasks using text-pretrained weights.
Decision-Focused Learning via tangent-space projection. Derives closed-form geometric characterization for regret gradients in decision-focused prediction tasks.
Skill Neologisms approach for continual learning in LLMs. Uses soft tokens to add new skills without catastrophic forgetting or context limitations.
GRALIS: Unified mathematical framework for XAI attribution methods (GradCAM, SHAP, LIME, Integrated Gradients). Establishes representation theory via Riesz representation theorem.
Cubit: Token mixer alternative to attention using kernel ridge regression interpretation. Proposes replacement for transformer attention mechanism based on Nadaraya-Watson regression.
HoReN: Codebook-based method for continual model editing in LLMs. Enables scalable factual updates to deployed models while preserving other knowledge and generalizing across paraphrases.
SACHI framework for multi-agent coordination in reinforcement learning. Addresses information bottleneck problem where agents must act on partial observations and local information.