Scalar Representations of Neural Network Training Dynamics
Application of scalar embeddings to analyze neural network training trajectories as temporal networks for understanding optimization dynamics.
Application of scalar embeddings to analyze neural network training trajectories as temporal networks for understanding optimization dynamics.
Speculate-reuse-repair runtime optimizing dynamic sparse attention for long-context LLM decoding by exploiting temporal locality in block selections.
Evaluation of tabular foundation models on diverse out-of-distribution tasks revealing limitations of current benchmark protocols and model generalization.
Framework combining diffusion model distillation with RL fine-tuning via Rewarded Moment Matching Distillation to improve generative quality.
Method for improving LLM reasoning via reinforcement learning with verifiable rewards by reusing accumulated experience rather than on-policy optimization from scratch.
Formal framework for proving ML model ownership through game-theoretic analysis between model owner, thief, and judge.
4B-parameter text-to-design model generating executable parametric CAD programs from natural language descriptions for mechanical part design.
Research on when online imitation learning improves LLM post-training, showing benefits depend on realizability rather than error accumulation reduction.
Study of internal-state probes for monitoring AI agents, finding they read situation context rather than enabling pre-action misalignment detection across model families.
Analysis of statistical characteristics and performance measurements of enterprise tabular data versus public ML benchmarks for business applications.
Proposes HSAP sequence parallelism framework for hybrid-context packed sequences in large language models, fixing cross-contamination in causal attention.
Introduces MuonSSM framework stabilizing state space models for long-sequence modeling by conditioning update geometry rather than recurrent weights.
Proposes lightweight approach for clustered federated learning using random network distillation to discover client collaborations without coupling cluster assignment to training.
Studies Muon optimizer dynamics on matrix factorization problems, showing it avoids slow saddle-to-saddle transitions compared to gradient descent.
Theoretical framework linking information theory and topology to explain generalization in overparameterized deep networks, addressing theory-practice gap.
Proposes ITSPACE algorithm for optimal transport updates on covariance matrices using Bures-Wasserstein distance for domain adaptation.
Theoretical analysis of convergence properties in continual learning with deep networks, characterizing sequential projections onto task margin sets.
TraceLab characterizes real-world coding agent workloads and LLM serving patterns across multiple models for systems optimization.
Study analyzing attractor state emergence in multi-turn LLM conversations, showing topic-independent stable behaviors in debate interactions.
SWE-Interact testbed evaluating coding agents on multi-turn interactive tasks with progressive user requirements instead of complete upfront specifications.
Cross-sample Consistency Regularization method addressing feature splitting and absorption problems in Sparse Autoencoders for LLM interpretation.
Study showing conservative offline training paradoxically amplifies reward hacking in reasoning models during online adaptation with DPO.
Analysis showing one-step gradient delay doesn't hinder asynchronous pipeline parallelism for large-scale LLM pretraining with PipeDream-2BW.
ReFreeKV method for KV cache compression in LLM inference without requiring pre-determined domain-specific thresholds.
TextClusterLab framework for reliable evaluation of text clustering algorithms addressing dataset quality and semantic boundary challenges.
PixelRAG method for retrieval-augmented generation using website screenshots in pixel space instead of parsed text for improved context.
Argues AI agent safety is epistemic property dependent on system correctability during learning, not just current behavior snapshots.
Theoretical framework studying language generation in the limit and hallucinations as unavoidable consequence of learning.
Unsupervised method for detecting complex driving scenarios using Joint Embedding Predictive Architecture without labels.
RADIANT-PET framework combining segmentation models with LLM adjudication for improved lesion segmentation in PET/CT medical imaging.
RadarTwin framework for generating synthetic mmWave radar training data using 3D reconstruction and vision-language models for mobile perception.
Research proposing meta-learning as principle for human-like visual representations in neural networks to support open-ended task flexibility.
Method to reduce hallucinations in Vision-Language Models using preference alignment constructed from vision-driven synthesis rather than intervention-based approaches.
Systematic review of reinforcement learning techniques for C/C++ vulnerability detection and static analysis following PRISMA guidelines.
LoRA fine-tuning of LLMs for dementia detection using multi-modal speech features with automatic speech recognition transcripts.
Research on how world models organize physical information in latent representations using diagnostic protocols for passive object-state prediction.
Theoretical analysis of spectral phase transitions in neural network weight matrices during SGD training.
Turn-averaged sparse autoencoders for interpretable feature extraction in language models with long context.
DataComp benchmark for evaluating vision-language model dataset curation strategies with 160 open datasets.
Study of sparse attention mechanisms using Fibonacci-spaced offsets in language models with depth-based scheduling.
Energy-aware learning approach for neuromorphic computing in closed-loop deep brain stimulation systems.
Reproducibility study of FACTER framework for fairness and coverage in LLM-based recommendation systems.
Transformer-based active learning approach for efficient vaccine epitope selection using molecular docking simulations.
LLM-based system for explaining patterns in multi-aspect tensor data without requiring labels or metadata.
AI agent that autonomously discovers mathematical theorems in formal axiomatic systems without human priors, advancing machine reasoning capabilities.
Multi-stage LLM pipeline for preserving document structure and formatting in machine translation of Indian government documents to Marathi.
Memory-managed attention mechanism separating long-context compression from explicit memory write/edit operations in language models.
SAGA: Agent framework for synthetic aperture radar data augmentation with task-driven generation and quality validation.
Probabilistic theoretical framework explaining in-context learning in LLMs with rigorous performance analysis.
Position paper on cybersecurity as testbed for LLM-based autonomous agents handling heterogeneous tools and data.