Ax Yufei Xu, Fanxu Meng, Fan Jiang, Yuxuan Wang, Ruijie Zhou, Zhaohui Wang, Jiexi Wu, Zhixin Pan, Xiaojuan Tang, Wenjie Pei, Tongxuan Liu, Di Yin, Xing Sun, Muhan Zhang 27d ago

HISA: Efficient Hierarchical Indexing for Fine-Grained Sparse Attention

HISA: hierarchical indexing system for efficient sparse attention in LLMs, reducing indexer bottleneck in token-level sparse mechanisms.

Ax Gabriel U. Talasso, Meghdad Kurmanji, Allan M. de Souza, Nicholas D. Lane, Leandro A. Villas 27d ago

Task-Centric Personalized Federated Fine-Tuning of Language Models

arXiv paper on personalized federated fine-tuning of language models. Federated learning approach for task-centric LLM adaptation on private distributed data.

Ax Ken M. Nakanishi 27d ago

Screening Is Enough

arXiv paper introducing Multiscreen attention mechanism for language models. Alternative to softmax attention enabling absolute relevance scoring in transformers.

Ax Haitham Kanj, Seonho Kim, Kiryung Lee 27d ago

Sparse Max-Affine Regression

Sparse Gradient Descent algorithm for variable selection in convex piecewise linear regression models.

Ax Gordana Ispirova, Michael Sebek, Giulia Menichetti 27d ago

Informatics for Food Processing

Review of ML/AI applications in food processing, classification systems, and food informatics.

Ax Tianze Yang, Tyson Jordan, Ruitong Sun, Ninghao Liu, Jin Sun 27d ago

Common Inpainted Objects In-N-Out of Context

COinCO dataset with 97,722 images created via diffusion-based inpainting for training context-aware vision models.