Template-assisted Contrastive Learning of Task-oriented Dialogue Sentence Embeddings
Proposes contrastive learning method for dialogue sentence embeddings using token-level template annotations instead of utterance-level labels.
Proposes contrastive learning method for dialogue sentence embeddings using token-level template annotations instead of utterance-level labels.
SciTune framework aligns LLMs with scientific domain knowledge through instruction fine-tuning on multimodal scientific publication data.
MM-LIMA demonstrates multimodal LLM fine-tuning achieves strong results with only 200 high-quality instruction examples, reducing data requirements.
Proposes CROP, a model-based offline reinforcement learning method addressing distribution shift through conservative reward estimation.
Framework using LLMs with philosophical relevance concepts to improve utility-based result ranking in retrieval-augmented generation systems.
MegaFake dataset of LLM-generated fake news for studying mechanisms of misinformation generation and detection methods.
Deep Optimizer States method enables scalable training of transformer models using interleaved offloading to overcome memory constraints.
PoTable framework improves table reasoning in LLMs using plan-then-execute reasoning stages for systematic thinking.
WebLLM inference engine enabling high-performance LLM execution directly in web browsers for on-device deployment without server GPUs.
HumanVBench benchmark for evaluating human-centric video understanding in multimodal large language models with 16 fine-grained tasks.
Three human studies examining whether humans can be influenced to conform to preference models used in RLHF algorithms for LLMs.
Novel curriculum learning approach for sample-efficient reinforcement learning applied to quadrotor stabilization control.
Combines semi-supervised and active learning for semantic segmentation to reduce manual annotation costs and improve model performance.
Proposes using LLMs to help mitigate barren plateaus in quantum neural network training through adaptive parameter initialization.
Study evaluating emergent lifelong learning behaviors in LLMs during multi-turn interactions, proposing new evaluation benchmarks for character-like consistency.
TARAC method addresses hallucinations in vision-language models by improving temporal attention mechanisms during generation without extensive retraining.
Research on energy-efficient optimization techniques for LLM deployment, including quantization and local inference strategies to reduce carbon emissions.
PODS decouples rollout generation from policy updates in LLM RL, addressing compute asymmetry through down-sampling.
LOOPE method learns optimal patch ordering in Vision Transformer positional embeddings for improved spatial information encoding.
RL^V framework unifies LLM reasoners with verifiers using value functions for improved test-time compute scaling during reasoning.
Bayesian approach for Vision Language Models to reduce hallucinations and overconfidence in VQA through selective prediction.
TokUR enables LLMs to self-assess uncertainty at token-level for improved reasoning and response reliability in multi-step tasks.
SpatialScore: comprehensive benchmark for evaluating spatial intelligence of multimodal LLMs with data-driven and agent-based assessment approaches.
GoT-R1: reinforcement learning framework enhancing multimodal LLM reasoning for complex visual generation with precise spatial relationships and attributes.
Fine-tuning approach for LLMs to predict diverse user behaviors, addressing overfitting to frequent behaviors while capturing long-tailed behavior distribution.
World models for interactive video generation with action conditioning and autoregressive decoding to support planning and future prediction.
Framework using LLMs for few-shot code generation to create safety-critical driving scenarios in CARLA simulator for autonomous driving evaluation.
LLM-based autonomous agent for power system voltage control, using experience-driven learning to generate dispatch strategies in distribution networks.
Data Mixing Agent: LLM-based method to automatically re-weight training data domains during continual pre-training, preventing catastrophic forgetting.
PRIX: efficient end-to-end autonomous driving model planning from raw camera pixels without LiDAR, reducing model size and computational requirements.
MDM-OC: framework for scalable, reversible model composition enabling continual learning without task interference or catastrophic forgetting.
Genetic programming approach for symbolic distillation of neural networks, using teacher-student smoothness alignment to improve explainable AI model accuracy.
Protocol for reliable evaluation of low-precision retrieval systems, addressing spurious ties and variability in relevance scoring with reduced numerical precision.
Analysis of LLM use in newsmaking across 40,000+ articles using AI-text detectors, showing increased GenAI adoption in local and college media.
Proximal SFT: supervised fine-tuning method using trust-region constraints to prevent capability deterioration when adapting foundation models to new tasks.
LLM-based synthetic training reduces maritime domain model costs 261x by using LLMs as teachers for small language model training.
FS-DFM enables fast long text generation using few-step diffusion language models with parallel position generation.
StyleBench evaluates trade-offs between structured reasoning styles and efficiency/robustness in LLM inference.
Position paper analyzing measurement gaps in reinforcement learning with verifiable rewards for LLMs on structured tasks.
SecureVibeBench evaluates code generation security of LLM-powered code agents against realistic vulnerability scenarios.
Mathematical framework interpreting Transformers as discretizations of integro-differential equations.
LLM-based system for generating standards-aligned math word problems customized to student interests and ability levels.
HiPRAG uses hierarchical process rewards to improve agentic RAG efficiency, reducing over-search and under-search behaviors.
Unified framework analyzing sequence models (Transformers, SSMs, gated RNNs) through coefficient dynamics lens.
Survey of inductive reasoning in LLMs, covering particular-to-general thinking patterns and knowledge generalization capabilities.
RAGen framework for generating domain-specific question-answer pairs to adapt RAG systems to specialized applications.
Risk-sensitive abstention in bandit algorithms for high-stakes AI where errors are irreparable without expert guidance.
Multi-hop reasoning over knowledge graphs using multi-view RAG with LLMs, addressing Transformer attention specialization patterns.
SimBench provides first standardized benchmark for evaluating how faithfully LLMs simulate human behaviors across diverse tasks and metrics.
AtlasKV enables RAG systems to integrate billion-scale knowledge graphs efficiently in limited VRAM by avoiding expensive external retrieval modules.