Neural Collapse Dynamics: Depth, Activation, Regularisation, and Feature Norm Threshold
Analysis of neural collapse dynamics identifying critical feature norm threshold for convergence.
Analysis of neural collapse dynamics identifying critical feature norm threshold for convergence.
MAC-Attention acceleration technique for LLM long-context decoding that preserves attention computation fidelity without compression.
Knowledge-Data ML framework integrating numeric data with knowledge for model construction.
Reinforcement learning framework for autonomous solver selection in chemical kinetics integration.
Agent system using RL to select optimal deep generative models for tabular data synthesis.
Conditional decoding strategy (CASA) for improving safety alignment in multimodal LLMs against cross-modal attacks.
AI safety research on vulnerabilities in autonomous agents with filesystem/email access via circuit analysis.
Method for encoding graph structure into LLMs via graph pooling tokens for Graph Question Answering tasks.
Gradient-based data valuation for curriculum learning in game-theoretic motion planning using TracIn scoring.
Study showing deep networks assign higher density to simpler out-of-distribution data than in-distribution test data.
Tuning-free GNN prompting framework for cross-graph adaptation without task-specific parameter updates.
Membership inference attack on LLMs via gradient-induced feature drift to detect training data exposure.
Research on scheduling LLM inference using uncertainty-aware output length predictions instead of point estimates.
arXiv: Generalization bounds for overparameterized shallow neural networks using initialization-dependent distance norms.
arXiv: Decoupled basis-vector-driven generative framework for dynamic multi-objective optimization addressing irregular mutations and cold-start.
arXiv: MOON3.0 multimodal representation learning framework for fine-grained e-commerce product understanding using reasoning-aware embeddings.
arXiv: First algorithm for Lipschitz dueling bandits over continuous action spaces using adaptive reference arms.
arXiv: Multi-format quantization-aware training enables single model robustness across multiple numeric precisions for elastic inference.
arXiv: Multi-task representation learning in linear bandits with shared latent representations for knowledge transfer.
arXiv: Test-time adaptation for LLMs under continual distribution shift and open-set tasks, preserving source knowledge.
arXiv: HabitatAgent multi-agent LLM system for housing consultation with transparent reasoning and factuality guarantees.
arXiv: Study on how representation choice affects interpretation of protein conformational dynamics from molecular dynamics simulations.
arXiv: Sparse Identification Graph Neural Network for discovering interpretable governing equations in ultra-large complex systems.
arXiv survey: On-policy distillation transfers reasoning from frontier LLMs to smaller models, addressing exposure bias in knowledge distillation.
arXiv: Prompt-based online continual learning for next activity prediction in dynamic processes using catastrophic forgetting mitigation.
arXiv: Variational Neural Stochastic Differential Equations model complex socioeconomic time-series data with heterogeneous dynamics.
arXiv: Full-gradient successor feature representations improve convergence guarantees for transfer learning in RL with non-linear function approximation.
arXiv: Empirical comparison of neural operator surrogates including Fourier neural operators vs polynomial methods for parametric PDEs.
arXiv: Group Relative Policy Optimization for RL addresses advantage collapse in reinforcement learning with verifiable rewards using hints.
Analysis of silent data corruption during LLM training on hardware, studying gradient corruption impacts and detection mechanisms.
Spectral Compact Training method reduces LLM training memory footprint by replacing dense weight matrices with truncated SVD factors.
Open-ended narrative framework for wearable human activity recognition using compositional, unscripted activities instead of closed-set classification.
ThoughtSteer backdoor attack exploiting continuous reasoning in language models that operate silently in hidden states without token output.
Method to reduce neural network multi-class classification complexity from O(n) to O(1) by leveraging known latent space geometry properties.
Optimus training library for pretraining mixture-of-experts LLMs at exascale on Aurora supercomputer, demonstrating 1000s GPU tile scaling.
Experimental evaluation of Free-Market Algorithm orchestrated Mixture-of-Experts with cost-penalized fitness for domain adaptation.
Optimal decomposition technique for low-rank approximation of LLM weights enabling efficient fine-tuning and inference.
Method for language agents to optimize test-time adaptation policies through iterative refinement during inference.
Reinforcement learning approach with verification for iteratively improving LLM policies based on actual performance gains.
Framework for human-AI cooperation that models fatigue-induced performance degradation in learning-to-defer systems.
Method for verifiable repair of transformer vulnerabilities to adversarial perturbations with inner-layer guarantees.
Graph partitioning technique using embeddings to enable scalable distributed training of graph neural networks.
Transfer learning methodologies for Bayesian network structure learning with scarce data.
Model-based learning approach for finite-window policies in partially observable Markov decision processes.
Method for efficiently evaluating LLM downstream performance during training without expensive full inference.
Theoretical analysis of dependency networks using information geometry perspective for modeling complex systems.
Analysis showing how irrelevant context degrades LLM reasoning performance despite test-time scaling capabilities.
Generative model approach using adversarial distribution alignment to bridge simulation-to-experiment gap in scientific domains.
ORCA framework calibrating LLM sampling through conformal prediction to improve test-time reasoning efficiency and generalization.
Multiscreen mechanism for language models enabling absolute query-key relevance assessment beyond relative attention redistribution.