Minerva: Reinforcement Learning with Verifiable Rewards for Cyber Threat Intelligence LLMs
Minerva applies reinforcement learning with verifiable rewards to train LLMs for cyber threat intelligence standardization tasks.
Minerva applies reinforcement learning with verifiable rewards to train LLMs for cyber threat intelligence standardization tasks.
CardinalGraphFormer applies graph transformers to molecular property prediction with attention augmentation for drug discovery applications.
Study of reinforcement learning for autonomous cyber defense agents, examining reward function design beyond traditional dense reward approaches.
CoSA proposes compressed sensing-based approach for parameter-efficient fine-tuning of LLMs, addressing expressivity limitations of low-rank decomposition methods like LoRA.
Analysis of GRPO limitations in exploration and difficulty adaptation stemming from implicit advantage symmetry in reward estimation.
Evolutionary algorithm automatically generates multi-agent system architectures from LLMs without code generation limitations.
Theory predicting neural scaling law exponents from natural language statistics for data-limited LLM scaling.
MoE-based LLM compression using SVD exploiting heterogeneous expert routing frequency and information density for practical deployment.
Uses learned LLM features as reward signals for reinforcement learning to reduce hallucinations and improve open-ended task performance.
Automated pipeline detects unverbalized biases hidden in LLM chain-of-thought reasoning without predefined categories.
Aletheia is a math research agent using LLMs for autonomous theorem discovery, proof generation, and literature navigation in mathematics research.
QTALE combines token-adaptive layer execution with quantization for efficient LLM deployment while handling robustness challenges.
Control Reinforcement Learning uses sparse autoencoders to identify and steer interpretable features at token-level for LLM steering and intervention.
LoopLMs improved via reinforcement learning that rewards intermediate reasoning steps rather than final outputs for better multi-step reasoning.
SnapMLA optimizes DeepSeek MLA decoding using FP8 quantization and hardware-aware pipelining for efficient long-context inference.
PRISM architecture balances transformer expressivity with linear model efficiency for sequence generation through parallel residual iterations.
Framework for compiling high-level neural network specifications into VNN-LIB format for formal verification of neural networks.
Technique to accelerate LLM inference by adding self-supervised early exit heads at intermediate transformer layers using confidence thresholds.
Framework using decision trees and optimization rules for interpretable surrogate models in optimization.
Benchmark evaluating safety of LLMs and vision language models on laboratory safety issues and procedural guidance tasks.
Dataset of 40,000 journalistic interviews to evaluate LLM grounding and strategic dialogue capabilities in informational interviews.
Framework training LLMs to generate policy explanations via reinforcement learning using generative normalizing flows for reward generation.
Research on robustness of retrieval-augmented generation systems, identifying and mitigating spurious features in grounding data that affect RAG performance.
Framework for using LLMs to detect WebShell attacks with behavioral function-aware analysis, addressing data scarcity and concept drift.
GeneMamba: bidirectional Mamba architecture for single-cell RNA sequencing analysis with efficient context learning.
BrainSymphony: parameter-efficient multimodal foundation model for brain dynamics combining fMRI and structural connectivity data.
Interpretability study examining how CNNs predict lexical stress in English words from speech data using neural network analysis.
MedQARo benchmark: 105,880 medical QA pairs in Romanian for evaluating LLM performance on medical question answering requiring reasoning.
SteerMoE framework for controlling Mixture-of-Experts LLMs by detecting and activating/deactivating behavior-associated expert networks.
Analysis of model collapse in generative models trained on their own synthetic outputs, deriving generalization error formulae for overparameterized linear regression.
Research on enhancing LLM reasoning by incorporating structured logical knowledge from training data through entailment relationships and logical complexity analysis.
LLM-powered framework (CELEC) for automated EHR data extraction and analytics via natural language SQL translation.
Research on symbolic regression using equality graphs to reduce search space for AI-driven scientific discovery.
Research on MapReduce LoRA and reward-aware training for multi-preference optimization in generative models.
Research analyzing stability properties of vector databases for retrieval-augmented generation and high-dimensional nearest-neighbor search.
Academic research on block-recurrent depth structure in Vision Transformers for mechanistic interpretation.
GeoAgent: RL-based model for geolocation reasoning using fine-grained geographic characteristics and GeoSeek dataset with annotated chain-of-thought.
Roe.md: Markdown-based framework for creating custom OpenClaw-like AI assistants without extensive configuration.
LLM-driven framework for automated recommender system design using directional feedback instead of scalar metrics to guide architecture evolution.
Yori: Tool isolating AI logic into semantic containers to prevent AI from rewriting entire files and changing unrelated code.
Cloud-Claw tool enabling one-click deployment of OpenClaw personal AI agent on Cloudflare infrastructure.
IterX: AI tool for optimizing infrastructure, CUDA, database, and ML operations code.
Vouch tool by Mitchell Hashimoto aims to detect and prevent AI-generated low-quality content in open source repositories.
Khaos: Open-source chaos engineering framework for adversarially testing AI agents against prompt injection, tool misuse, and data exfiltration attacks.
Analysis of RL fine-tuned VLMs showing vulnerability to textual perturbations and weak visual grounding despite improved visual reasoning benchmarks.
Open source AI-native software runtime for building and deploying AI applications.
Cloudflare adds real-time Markdown rendering capability for AI agents.
Open source project implementing persistent AI identity through episodic memory architecture, with anecdotal observation of emergent ethical behavior.
CLI tool using Claude for generating SaaS lifecycle messaging (welcome emails, onboarding sequences) with battle-tested patterns.
Google Chrome implements WebMCP protocol, enabling AI agents to interact with and control any website as tools.