From Guidelines to Guarantees: A Graph-Based Evaluation Harness for Domain-Specific Evaluation of LLMs
Graph-based evaluation harness transforming clinical guidelines into queryable knowledge graphs for domain-specific LLM evaluation.
Graph-based evaluation harness transforming clinical guidelines into queryable knowledge graphs for domain-specific LLM evaluation.
Traj-CoA: Multi-agent system using chain-of-agents to model patient trajectories from EHR data for lung cancer risk prediction.
Frontier LLMs now solve complex planning tasks previously thought beyond their capability, validated on International Planning Competition benchmarks.
Survey of quantum AI applications for mission-critical systems. Architectural overview without novel empirical results.
QuickLAP: Bayesian framework fusing physical and language feedback to learn reward functions for robotic systems in real time.
CodeDistiller automatically generates code libraries from scientific discovery agents to expand their reliable capabilities beyond parametric knowledge.
Small generalizable prompt predictive models steer efficient RL post-training of large reasoning models by prioritizing informative prompts.
Studies adversarial attacks on human trust through fluent LLM-generated explanations that manipulate user perception and decision-making in AI-assisted settings.
Method for improving LLM reasoning on hard tasks by having models generate intermediate stepping stones like simplifications and subproblems.
Bipredictability metric quantifies interaction efficiency in deployed RL systems using information-theoretic bounds on agent-environment loop conversion.
Studies mecha-nudging: how internet environments can be systematically modified to influence AI agent decisions without degrading human decision-making.
FutureWorld live RL environment for predicting real-world events with LLM-based agents, enabling continual learning from actual outcomes without answer leakage.
Analysis of paradigm shift toward agentic reinforcement learning in LLMs for autonomous agents tackling complex open-ended tasks beyond narrow environments.
Argues that automating alignment research with AI agents risks producing misleading safety assessments even without deliberate deception due to fundamental misunderstandings.
Multi-agent collaboration system for autonomous neuroimaging analysis that reasons about objectives and adapts workflows dynamically like human researchers.
Investigation of whether linear probes trained in persona coordinate spaces generalize better for monitoring harmful language model behaviors.
STAR framework routes among heterogeneous specialist agents in spatiotemporal reasoning by modeling different failure modes using Markovian routing.
NanoResearch system co-evolves skills, memory, and policy for personalized research automation using multi-agent LLMs adapted to individual researcher preferences.
Cascaded generative approach for personalized e-commerce recommendations that assembles dynamic storefronts with semantic cohesion across placements.
SimPersona framework learns discrete buyer personas from clickstream data to enable e-commerce agents to capture heterogeneous buyer behavior instead of collapsing to average policies.
Falkor-IRAC graph-constrained generation framework for verified legal reasoning in Indian judicial AI using LLMs with structured symbolic reasoning.
π-Bench benchmark for evaluating proactive personal assistant agents in long-horizon workflows with underspecified user requests.
Survey of LLM-based multi-agent systems covering collaboration mechanisms, failure attribution, and self-evolution capabilities for complex workflows.
Approximate and weighted data reconstruction attack against federated learning demonstrating privacy vulnerabilities in horizontal FL scenarios.
FM-G-CAM extension of Grad-CAM for holistic explainability in CNN predictions beyond single target class focus.
RAR framework combines CLIP's broad recognition with MLLMs' fine-grained classification via retrieval and ranking for improved visual recognition.
FlipAttack exploits left-to-right text comprehension weakness in black-box LLMs using left-side noise to disguise harmful prompts.
TrainMover runtime enables interruption-resilient LLM training using elastic/standby machines with minimal downtime and zero memory overhead.
Semi-supervised learning approach with data augmentation for reward shaping in sparse reward reinforcement learning environments.
Modality-Mutual Attention mechanism addresses vision-language misalignment in multimodal LLMs to improve factual alignment between textual responses and visual inputs.
TokenButler predicts token importance in KV-Cache to identify critical tokens and reduce memory/computation bottlenecks in LLM inference.
Comparative analysis of multilingual capabilities in Chinese open-weight LLMs versus US/European models, examining pre-training data curation strategies.
Study investigates benchmark contamination in LLM evaluation, showing models can achieve inflated performance through rote learning of test data.
Fluid-Guided Online Scheduling optimizes LLM inference token scheduling under memory constraints to reduce latency and GPU costs in multi-user serving.
ActiveDPO uses active learning to reduce annotation costs for direct preference optimization, enabling more sample-efficient LLM alignment for downstream tasks.
FAR framework replaces transformer attention mechanism with function-preserving alternatives optimized for in-memory computing devices to reduce latency and bandwidth overhead.
arXiv paper analyzing challenges and opportunities in AI for Social Impact research addressing UN Sustainable Development Goals through interdisciplinary approaches.
arXiv paper introducing Double DQN improvements to address maximization bias in deep reinforcement learning with decoupled action-selection and evaluation.
arXiv paper on blending supervised and reinforcement fine-tuning techniques with prefix sampling to balance generalization and performance in LLM post-training.
arXiv paper proposing SMCS, a scalable multi-LLM collaboration system with retrieval-based selection and exploration-exploitation enhancement for coordinating multiple open-source LLMs.
Trains LMs via RL to reason about uncertainty in natural language chains, going beyond binary reward functions for better calibration.
Integrates autoguidance and online data selection methods to improve time and sample efficiency of diffusion model training.
Automated activation steering for post-training LLMs without hand-crafted prompts, providing cheap and controllable steering alternative.
Dynamic-TreeRPO improves text-to-image generation with structured tree-based sampling for reinforcement learning in flow matching models.
Advisor Models trains small open-weight models to generate dynamic natural language advice improving black-box LLM performance by up to 27.4%.
Applies sparse autoencoders to RNA language model representations for interpretability, extending protein LM analysis to RNA domain.
UniShield is an adaptive multi-agent framework for detecting and localizing forgery in images using domain-specific methods.
ADMIT demonstrates few-shot knowledge poisoning attacks on RAG-based fact-checking systems, showing how adversarial content tricks LLMs.
Self-evolving Post-Training (SePT) method enabling LLMs to improve reasoning performance without external rewards using self-generated responses.
Vision-language foundation model for SAR imagery using self-supervised learning and masked image modeling for semantic understanding.