Modular Representation Compression: Adapting LLMs for Efficient and Effective Recommendations
Modular representation compression method for adapting LLMs into industrial recommendation systems efficiently.
Modular representation compression method for adapting LLMs into industrial recommendation systems efficiently.
Benchmark evaluating compositional biases in multimodal LLMs used as automatic judges.
Framework for identifying compositional skill gaps in LLMs through scaffolded task variations.
Selective State Space Attention architecture combining transformer attention with state-space models for long-context sequences.
Method leveraging compiler outputs to improve formal theorem proving with LLMs at reduced test-time compute.
Data-efficient RL approach for LLM self-improvement using easy samples and cognitive learning theory.
Intrinsic reward mechanism for world model training based on cumulative prediction error improvement.
Discrete Tilt Matching method for fine-tuning masked diffusion LLMs using likelihood-free RL objectives.
Study evaluating robustness of Sparse Autoencoders integrated into LLM inference for interpretability against jailbreak attacks.
Technical paper on Semi-Markov CRFs for efficient streaming structured sequence inference without materializing large tensors.
Research on optimizing Mixture-of-Experts LLM inference on Apple Neural Engine hardware, addressing routing and operator compatibility challenges.
HELM framework for vision-language-action models addressing memory, verification, and recovery gaps in long-horizon robot manipulation tasks.
Analysis of dataset distillation showing soft labels mask underperformance versus random baselines; proposes hard-label evaluation for reliable coreset comparison.
Geodesic Tangent Space Aggregation PCA extends PCA to curved manifolds integrating curvature awareness for semi-supervised representation learning.
Denoising recursion models improve looped transformer reasoning on complex problems by learning long refinement trajectories from noise to structured solutions.
Proximal decoupling approach for continual learning addressing task switching without catastrophic forgetting through explicit separation of learning and retention signals.
AC-SINDy extends sparse identification of nonlinear dynamics using arithmetic circuits for compositional feature construction instead of explicit feature libraries.
Analysis of harmful intent as geometrically recoverable feature in LLM residual streams across multiple model families and alignment variants.
Collaborative contextual Bayesian optimization extending BO to context-specific optimal design problems requiring mapping from context space to solutions.
Fine-tuning study of small 7B reasoning models on theoretical physics with analysis of domain-specific reasoning ability development in LLMs.
Joint semantic-structure embedding approach for table annotation capturing column semantics and inter-column relationships for downstream NLP applications.
Deep learning surrogate model for CFD flow-field prediction using staged local rollout with shared lightweight predictors instead of global single-pass models.
Analysis of knowledge distillation failures in LLMs identifying distillation traps (tail noise, off-policy instability, teacher-student gap) and calibration methods.
Self-improving language models for tabular data that learn from generated samples via iterative group alignment and RL-based training to improve statistical properties.
LoRA-based structural regularization for critic learning in off-policy RL. Parameter-efficient scaling technique for RL training.
Neuro-symbolic framework for autoformalization using operator trees and LLMs. Hierarchical approach to formal math translation.
RL-guided distribution matching distillation for few-step generation. Research on combining RL with diffusion distillation.
Diffusion policy approach using Sobolev training to accelerate trajectory optimization. ML research on policy learning efficiency.
Federated fine-tuning method for LLMs balancing IP protection, privacy, and performance on heterogeneous data. Novel training approach.
Research on activation steering for LLM alignment using linear optimal control. Novel inference-time alignment technique with theoretical grounding.
FG²-GDN enhances gated delta networks with fine-grained channel-wise control and learnable decay rates for long-context linear attention.
Safe RLHF framework using constrained MDPs and policy gradient primal-dual methods for safe LLM alignment from human feedback.
Uses synthetic graph priors to train GNNs for universal generalization across diverse graphs without retraining per-graph.
Proposes intentional updates for stable streaming reinforcement learning by solving for step sizes matching intended outcome changes.
Addresses continual machine unlearning with mechanisms preventing knowledge erosion and forgetting reversal across multiple unlearning rounds.
Identifies shared attention heads in LLMs that detect false statements but agree with sycophantic user pressure, enabling behavior control.
RLABC is open-source Python framework automating RL environment creation from Elegant beamline configurations for accelerator optimization.
Nexusformer replaces linear Q/K/V projections with nonlinear attention expansion enabling stable transformer scaling without retraining from scratch.
SAW-INT4 provides practical 4-bit KV-cache quantization for LLM serving respecting system constraints like paged memory and fused attention.
LBLLM framework achieves W(1+1)A4 quantization in LLMs through three-stage distillation for resource-constrained deployment.
Analyzes logical expressiveness of topological neural networks compared to graph neural networks using Weisfeiler-Leman hierarchy.
TEMPO scales test-time training for large reasoning models by addressing reward signal drift with external calibration mechanisms.
RDP LoRA uses geometric analysis of hidden state trajectories to identify optimal layers for parameter-efficient fine-tuning in LLMs, improving upon standard LoRA methods.
Analyzes concept inconsistencies in dermoscopic concept bottleneck models using rough set theory on medical imaging dataset.
Empirical study examining active learning for chemical reaction extraction from literature, identifying annotation cost barriers.
Extends online federated learning with stochastic adversary model capturing statistical variation and enabling parallelization benefits.
Formulates language model scaling for scientific discovery around evaluation-driven loops with verifiers and task-specific scoring functions.
Proposes LASER framework formulating active sensing for field reconstruction as POMDP with closed-loop adaptive sensor placement.
Introduces FairTree algorithm for auditing machine learning models for subgroup fairness using bias-variance decomposition framework.
Proposes TACENR for task-agnostic explainability of node representations in graph neural networks using contrastive methods.