From Memorization to Creativity: LLM as a Designer of Novel Neural Architectures
NNGPT framework uses LLMs for neural architecture synthesis through iterative supervised fine-tuning cycles generating validated PyTorch networks.
NNGPT framework uses LLMs for neural architecture synthesis through iterative supervised fine-tuning cycles generating validated PyTorch networks.
ORBIT system for controlling reasoning budget in Large Reasoning Models via on-policy exploration-exploitation to reduce computational cost.
Theoretical analysis of differential privacy limitations in DP-SGD using f-differential privacy framework with shuffled sampling.
Threshold Differential Attention mechanism for long-context language modeling, addressing attention sink and sparsity issues without projection overhead.
Comprehensive circular taxonomy surveying 50+ LLMs from 2019-2025 across 15 organizations, documenting architectural innovations and scaling properties.
Study of temporal embedding models for electronic health records of chronic kidney disease patients, balancing predictive performance with clinical interpretability.
Framework for LLM-driven automated heuristic generation for combinatorial optimization with dynamics-aware evaluation beyond endpoint metrics.
Research on model-free reinforcement learning for continuous-time processes with function approximation using ellipticity properties and Hilbert-space methods.
MedVerse framework enables parallel reasoning in LLMs for medical diagnosis using DAG-structured execution instead of sequential autoregressive decoding.
arXiv paper on approximation rates for group equivariant neural networks. Theoretical ML research.
Adaptive optimizer using exponential moving average with theoretical guarantees for zero-noise convergence without restrictive boundedness conditions.
Client-side optimization framework for LLM-based agents that compose local tools, remote APIs, and multiple models efficiently.
Memory-efficient optimizer for LLM training using sign-adaptive gradient updates to reduce optimizer state overhead.
Studies deliberative alignment approach for improving LLM safety at inference time through reasoning model distillation and behavior attribution.
Studies which samples are forgotten during fine-tuning of image classifiers and whether forgetting patterns depend on architecture.
Comprehensive evaluation framework for assessing time-series foundation models with benchmarks and community standards.
Deep reinforcement learning system for autonomous braking that adapts to driver drowsiness using physiological state detection.
Proposes intentional analysis framework to improve language model reasoning by explicitly understanding user intent behind questions.
Identifies reward-generation gap in Direct Alignment Algorithms like DPO and SimPO for LLM alignment, proposes methods to bridge the discrepancy.
Proposes scalar metrics for measuring multi-calibration of probabilistic predictions across multiple subpopulations.
Theoretical analysis extending random matrix theory to understand behavior of overparameterized deep neural networks in high-dimensional settings.
KnowRL reinforcement learning approach to reduce hallucination in LLMs by providing factual supervision during reasoning process.
Constrained decoding approach for ensuring safe navigation in robotic foundation models with explicit behavioral constraints.
Multi-modal policy consensus approach factorizing robotic manipulation policies into modality-specific diffusion models for flexible integration.
Flow matching policies for contact-rich robotic manipulation tasks using force and demonstration-guided simulation data.
Philosophical analysis arguing static value alignment insufficient for robust AI alignment under capability scaling and distributional shift.
Model-free methods for assessing simulator fidelity and quantifying sim-to-real gaps in generative AI models.
Adaptive layer selection technique for layer-wise token pruning to reduce KV cache in LLM inference with improved efficiency.
DAS method for authorship de-anonymization at scale using tournament-style attribution with LLMs, analyzing privacy implications.
Evaluation of LLM mathematical reasoning capabilities in low-resource languages Sinhala and Tamil.
Conformal policy control framework using safe reference policies as regulators for untested policies in high-stakes agent exploration.
IROSA framework combining foundation models with imitation learning for robot skill adaptation via natural language instructions.
Survey unifying LLM post-training methods (SFT, preference optimization, RL, process supervision) through lens of off-policy and on-policy learning.
Reproducibility study of ColBERT-v2 and ConstBERT showing 86-97% performance drop on long narrative queries due to architectural limitations.
Research on CLIP and dual-encoder vision-language models showing compositional limitations stem from inference protocol, not representations.
Research using SAE features and emotion vectors to study Claude Mythos Preview system behavior during misaligned responses.
Research formalizing user 'vibe-testing' practices for evaluating LLMs, moving from informal experience-based evaluation to structured methodology for reproducibility.
Research paper proposing NuHF Claw cognitive agent framework using LLMs for safety-critical decision support in nuclear control rooms.
Heartbeat-driven autonomous thinking framework for LLM agents enabling proactive scheduling and continuous reflection instead of reactive control flows.
Synthetic multivariate time series generator with fine-grained anomaly annotations and variable-level dependencies for benchmarking detection methods.
Survey of interpretable surrogate modeling for complex system simulations, covering explainable AI techniques for decision-making and black-box model transparency.
Training dynamics analysis unifying supervised fine-tuning and reinforcement learning for LLMs via reward perspective, with group advantage optimization and coefficient rectification.
Vision-language model trained on radiologist gaze and reasoning patterns to improve chest X-ray interpretation by emulating expert diagnostic workflows.
Biologically-inspired mistake-gated learning mechanism reducing synaptic plasticity costs, achieving energy and memory efficient continual learning in neural networks.
Framework for declarative control of LLM agent pipelines using beliefs and policies, enabling transparent behavior adaptation and stateful decision-making.
Geometric MoE architecture using cosine-similarity routing in low-dimensional space, achieving 80% fewer routing parameters while maintaining language modeling quality.
Agentic system for interactive data exploration that reifies vague information needs into explicit relational specifications with iterative refinement and provenance tracking.
Demonstrates causal meaningfulness of individual experts in sparse MoE models via geometric routing, showing monosemantic expert behavior despite routing topology equivalence.
AutoML system that automates AI model development including architecture design, feature engineering, training pipeline implementation, and empirical refinement.
Framework for value-aware AI interventions in sequential decision-making, accounting for human execution limitations rather than assuming optimal follow-up actions.