Efficient Test-Time Finetuning of LLMs via Convex Reconstruction and Gradient Caching
Efficient test-time finetuning of LLMs via convex reconstruction and gradient caching to speed up per-query adaptation without sacrificing quality.
Efficient test-time finetuning of LLMs via convex reconstruction and gradient caching to speed up per-query adaptation without sacrificing quality.
Transfer learning approach for adapting pretrained CFD surrogate models to new vehicle families using geometry encoders and Transformer architecture.
RightNow-Arabic-0.5B-Turbo: open-source 518M-parameter Arabic-specialized LLM using vocabulary injection for efficient edge deployment, weights released.
End-to-end deep learning framework for portfolio optimization using financial metrics. Finance application of neural networks, not core AI/tech focus.
Research on how LLMs reorganize internal representations during in-context learning without parameter updates. Mechanistic analysis of LLM adaptation.
PyTorch framework for solving inverse problems constrained by PDEs using differentiable ML. Scientific computing application with limited developer tool focus.
LLM-based approach for spatiotemporal intent sequence recommendation in Amap. Applies LLMs to user behavior prediction in location services.
Investigates neural scaling laws for particle jet generation. Explores scaling law patterns in specialized physics domain with neural models.
Theoretical analysis of momentum optimizer dynamics under sparse gradient updates in high dimensions. Optimization research with limited application scope.
arXiv paper on Hadamard matrix decomposition algorithms. Theoretical ML research without application to LLMs or AI agents.
First systematic empirical study of prompt injection attacks in LLM-based resume screening with ~200 test cases. Measures real-world vulnerability impact.
arXiv: Multi-agent reinforcement learning method for opponent shaping through belief manipulation, extending beyond parameter-space techniques.
arXiv: Efficient safety guardrails for LLMs using latent reasoning to reduce latency/token overhead while maintaining reasoning-based safety.
arXiv: eXTC - combines reinforcement learning and structured prompts for interpretable LLM-based text classification with reasoning.
ReasonBreak demonstrates vulnerabilities in vision-language-action models for autonomous driving, achieving up to 89% attack success on reasoning components.
Anytime-valid federated conformal RAG provides distribution-free coverage guarantees for swarms of weak language models under adaptive control.
Neuro-symbolic knowledge graph construction using LLMs with ontology-grounded post-extraction correction for improved multi-hop QA and reasoning.
libhmm is a C++20 library for Hidden Markov Model parameter estimation and decoding with correct maximum likelihood emission M-steps.
Survey of LLM fingerprinting and watermarking techniques for identity, ownership verification, and provenance tracking across datasets and generated content.
DenseSteer improves math reasoning in small LLMs (≤3B params) by training dense reasoning with fewer but information-dense steps instead of longer chains-of-thought.
Prediction-powered inference method uses abundant proxy measurements with few high-quality labels for statistical validity across many related tasks.
OmniRetrieval unifies retrieval across heterogeneous knowledge sources (text, tables, knowledge graphs) under a single interface for LLM applications.
Analyzes how human curation affects preference alignment when multiple foundation models train on synthetic data from prior iterations in self-consuming loops.
Studies how to allocate limited LLM call budgets in evolutionary search systems, analyzing run-to-run reliability across depth-breadth tradeoffs.
CoHyDE co-trains an LLM rewriter and dense encoder to improve tool retrieval for LLM agents by bridging colloquial queries with technical API vocabulary.
GrepSeek trains LLM search agents to directly interact with corpora using grep-like operations instead of traditional keyword-based retrieval systems.
EDistill compresses LLMs via structured pruning but causes reasoning collapse. Proposes activation-aware initialization to preserve multi-step reasoning in distilled models.
Research on supply chain attacks where LLM-powered coding agents hallucinate non-existent packages that attackers can then register and exploit.
PassNet uses LLMs to generate compiler passes for tensor optimization, addressing performance issues in long-tail workloads where default compilation causes 43% of subgraphs to slow down.
BrahmicTokenizer-131K: drop-in BPE tokenizer replacement supporting Indic scripts while maintaining English and code compression performance of o200k_base.
Empirical analysis of persona prompting effectiveness in LLMs across 1,140 examples, examining whether role injection consistently improves response quality.
Kronecker Embeddings: parameter-efficient token representation using byte-level factorization that reduces embedding table size by 91-94% in large language models.
PhoneWorld: scalable pipeline converting real mobile GUI trajectories into controllable environments for training and evaluating phone-use AI agents.
Framework for dynamic multi-agent LLM collaboration that reconfigures agent topologies during execution to avoid cascading errors and trajectory divergence.
Trains action-only deliberative monitors as smaller open-weight models to detect scheming behavior in black-box autonomous agents.
Context-conditioned predicate semantics learning for scene graph generation using prototype feedback to handle polysemy.
COMET analyzes modality gap in audio-text contrastive embeddings via concept space dissection beyond mean shift correction.
MoSSP momentum-based single-loop algorithm for nonconvex constrained stochastic optimization with DC regularization.
Minimax rate analysis for federated language modeling with quantized logit distillation under heterogeneous bandwidth constraints.
AMDP proposes asynchronous multi-directional pipeline parallelism for large-scale model training with improved convergence.
Random matrix theory analysis of deterministic equivalents for nonlinear feature maps in neural networks on nonlinearly separable data.
Heterogeneous multi-agent paradigm orchestrating collaboration between generalist LLMs and domain-specific medical specialist models for healthcare AI.
Instance-dependent analysis of Lipschitz bandit problems with improved regret bounds using zooming-based adaptive guarantees.
SAAS addresses over-search mitigation in agentic search by teaching LLM agents to recognize knowledge boundaries and self-terminate searches appropriately.
AgentDoG 1.5 presents a lightweight scalable alignment framework for AI agent safety and security in open-world environments.
Comparative analysis of Confident Learning and Dataset Cartography for automatic label error detection on Russian text classification corpora.
Cert-LAS introduces layer-adaptive smoothing for certified model ownership verification in text-to-image diffusion models via backdoor-based watermarking.
OptSkills proposes a method for LLMs to learn generalizable optimization skills from problem archetypes via cluster-based distillation, improving generalization beyond case-level reuse.
Mechanistic interpretability study analyzing how LLMs detect code vulnerabilities using circuit analysis on Gemma-2.
Research paper on impact of planning representations for LLM-based web agents. PlanAhead framework evaluates plan formats.