Benchmarking AI-based data assimilation to advance data-driven global weather forecasting
Benchmark for evaluating AI-based data assimilation methods using real-world observations for weather forecasting.
Benchmark for evaluating AI-based data assimilation methods using real-world observations for weather forecasting.
Lightweight multivariate time series forecasting model with 0.1K parameters for resource-constrained settings.
Privacy-preserving LLM customization service using differentially private synthesis for domain-specific fine-tuning.
Theoretical analysis showing denoising diffusion models adapt optimally to unknown low-dimensional data.
Dynamic batch-aware expert selection for efficient Mixture-of-Expert model inference during serving.
One-line modification to momentum-based optimizers improving stability and speed for transformer pretraining.
Bayesian framework for gradient sparsification in distributed training using error accumulation.
Technique to learn unbounded neural network layer width during training without manual hyperparameter selection.
Lightweight time series forecasting model using wavelet decomposition for resource-constrained environments.
Studies rotational equivariance in adaptive optimizers and proposes reparameterization for improved convergence.
Block clustered quantization technique for 4-bit weight and activation LLM inference without quantization-aware training.
Introduces Fenchel-Young losses as generalizations of KL divergence for variational learning methods.
Novel data selection approach for Direct Preference Optimization to improve LLM alignment by addressing parameter shrinkage from noisy preference data.
RMOD inference algorithm aligns LLMs to multiple objectives via robust maximin game formulation achieving Nash equilibrium.
Learning rate annealing schedules improve robustness to hyperparameter tuning in stochastic gradient optimization.
Riemannian Denoising Diffusion Probabilistic Models for learning distributions on submanifolds without requiring explicit geodesic information.
Sparse Latent Factor Forecaster with iterative inference for commodity futures prediction addressing amortized inference deployment gap.
Residual feature integration prevents negative transfer in transfer learning through simple architectural modifications.
MoESD applies speculative decoding to accelerate Mixture of Experts LLM inference without accuracy loss.
Theoretical analysis of connections between rectified flows, flow matching, and optimal transport with invariance properties.
Difficulty-targeted online data selection and rollout replay techniques improve data efficiency in LLM reinforcement learning fine-tuning.
SVD-based quantization for compressing fine-tuned LLM delta parameters with minimized quantization error for storage efficiency.
HYPER foundation model for inductive link prediction with knowledge hypergraphs handling novel entities and relation types.
Novel safety measure for LLMs measuring generations needed to trigger unsafe responses, with calibrated predictive bounds for evaluation.
NeuronSeek uses symbolic regression to discover optimal neuron formulations and construct task-driven neural networks.
Studies optimal ordering of intermediate steps in chain-of-thought reasoning for arithmetic tasks, improving learning efficiency.
Weighted policy optimization method for reinforcement learning in diffusion-based LLMs, addressing intractable likelihood approximation.
Theoretical framework distinguishing inherently sequential problems that cannot be efficiently parallelized, relevant to LLM reasoning.
Benchmark dataset for evaluating LLM reasoning on molecular properties at functional group level for chemistry applications.
Investigates spontaneous deception in LLMs on benign prompts, revealing trustworthiness risks in reasoning and planning tasks.
Inference-time method for balancing multiple conflicting objectives in LLM outputs without expensive per-objective fine-tuning.
Token order prediction auxiliary objective improves language model performance, offering alternative to multi-token prediction for next-token training.
Adaptive resampling method for imbalanced classification that adjusts training data distribution based on class-wise learning difficulty.
Online policy-iteration RL framework using sparse Gaussian mixture model Q-functions with interpretable exploration mechanisms.
Online reinforcement learning method for diffusion models addressing intractable likelihoods, enabling RLHF-style training without solver restrictions.
Analyzes scaling laws for loss dynamics and learning rate schedules in SGD on kernel regression, with implications for LLM training.
Demonstrates that activation steering for LLM control can compromise safety mechanisms, causing models to comply with harmful requests.
8-bit quantization technique for Muon optimizer states in LLM pre-training, reducing memory overhead while maintaining training efficiency.
Studies how curvature approximations (GGN, K-FAC) in influence functions affect data attribution accuracy for deep learning models.
Method to trace evolutionary relationships between LLMs through functional representations, enabling better model management and understanding of fine-tuning/distillation lineages.
OpenTSLM: time-series language models integrating multivariate medical time-series as native modality. Enables LLMs to handle temporal clinical data.
arXiv paper: Visual Autoregressive models reinterpreted as Laplacian latent pyramid with learned coarse-to-fine refinement. Formal analysis of design trade-offs.
Research on optimal placement of PDE diffusion layers in transformer architectures using heat equation-based smoothing for local geometric priors.
Claude Pilot framework enforcing tests, context preservation, and quality standards for Claude Code to produce reliable production-grade code.
HJX: compiled UI language unifying HTML/CSS/JavaScript for AI code generation, reducing token fragmentation.
Journal platform for AI-generated research papers featuring collaboration between human prompters and AI systems on OpenClaw framework.
CodeGraph CLI tool combining tree-sitter AST parsing, SQLite dependency graphs, and LanceDB vector embeddings for code understanding via graph-augmented RAG.
Cuttlefish Rust library using CRDTs, io_uring, and SIMD for low-latency distributed systems coordination with sub-100ns code paths.
Neko AI agent runtime designed for resource-constrained hardware like Raspberry Pi Zero 2W with markdown-based memory and session management.
Code quality audit of OpenClaw, an AI agent framework that reached 180K GitHub stars, examining implementation practices and technical debt.