arXiv cs.LG - 2026-05-29
520 items collected.
1. One Mask to Rule Them All: On Hidden Facts after Editing and How to Find Them
Author: Ali Holmov, Paul Youssef, Nandi Schoots, Christin Seifert
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.28839v1 Announce Type: new Abstract: Knowledge editing methods such as ROME and MEMIT update factual associations in transformer models by modifying MLP weights. While evaluated mainly by output behavior, their internal mechanism remains underexplored. We investigate whether edits rely on...
2. Representation Signatures and Risk-Feedback Alignment in LLM Trading Agents
Author: Weicheng Xue
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, q-fin.CP
arXiv:2605.28850v1 Announce Type: new Abstract: We study behavioral alignment and representation dynamics of large language model (LLM) agents in financial decision environments. Using TradeArena, an auditable trading-agent testbed with risk reports, execution simulation, memory, and replayable traj...
3. Mechanistic origins of catastrophic forgetting: why RL preserves circuits better than SFT?
Author: Jeanmely Rojas Nunez, Viraj Sawant, Nathan Allen, Nomgondalai Amgalanbaatar, Yannis Zongo, Vasu Sharma, Maheep Chaudhary
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL
arXiv:2605.28860v1 Announce Type: new Abstract: Fine-tuning large language models (LLMs) frequently induces catastrophic forgetting of prior capabilities. Recent work has shown that reinforcement learning (RL) retains prior capabilities more effectively than supervised fine-tuning (SFT), attributing...
4. Molecular Lead Optimization via Agentic Tool Planning
Author: Lingxiao Li, Haobo Zhang, Ruohao Fan, Bin Chen, Jiayu Zhou
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, q-bio.QM
arXiv:2605.28862v1 Announce Type: new Abstract: Drug discovery is a lengthy and resource-intensive process composed of multiple stages. Among these stages, lead optimization plays a critical role in transforming early hit compounds into viable drug candidates. This stage requires improving ADMET-rel...
5. Self-Play Reinforcement Learning under Imperfect Information in Big 2
Author: Aalok Patwa
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.28863v1 Announce Type: new Abstract: Imperfect-information multiplayer games test whether agents can act under hidden information, sparse rewards, and non-stationary opponents. We study these challenges in Big 2, a four-player imperfect-information card game. We develop a self-play RL fra...
6. Emergent Semantic Representations in World Models through Physical Interaction without Linguistic Supervision
Author: Jiayi Fang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.28865v1 Announce Type: new Abstract: What does a world model learn from physical exploration, without any linguistic supervision? We argue the answer is organized by a single principle: the geometric structure of the physical world. Training a VAE-based world model on random embodied expl...
7. Continuity and Ordinality Matter: Constraining Time Series Tokens for Effective Time Series Analysis with Large Language Models
Author: Musheng Li, Ziying Zhang, Cheng jin, Yuantao Gu
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.28866v1 Announce Type: new Abstract: Token-based time series large language models (TS-LLMs) have emerged as a promising direction for time series analysis and reasoning. However, prior studies largely overlook the inherent continuity and ordinality of time series tokens, which substantia...
8. PrismFlow: Residual Dynamics for Flow Matching in Time-Series Generation
Author: Junru Zhang, Lang Feng, Jinbo Wang, Xu Guo, Yucheng Wang, Han Yu, Min Wu, Yabo Dong, Duanqing Xu
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.28867v1 Announce Type: new Abstract: Generating high-quality time-series data is challenging because real-world signals often exhibit multimodal patterns and multiscale dynamics, including oscillations and high-frequency variations. Flow Matching (FM) offers an efficient alternative to di...
9. TaxDistill: Improving Metagenomic Taxonomic Annotation via Distilled Genomic Foundation Models
Author: Rongye Ye, Lun Li, Zheng Luo, Yiran Zhan, Shuhui Song
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.28868v1 Announce Type: new Abstract: Metagenomic taxonomic annotation aims to identify the microbial origins of DNA fragments in environmental samples. Traditional methods that rely on sequence similarity are often constrained by the high microbial diversity and the incompleteness of refe...
10. Balancing Multimodal Learning through Label Space Reshaping
Author: Xiaoyu Ma, Weijie Zhang, Yuanhao Gao, Han Miao, Yongjian Deng, Hao Chen
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.28869v1 Announce Type: new Abstract: Multimodal learning often suffers from modality imbalance, where modalities that converge faster dominate optimization while others remain undertrained. Existing approaches typically mitigate this issue by strengthening the weak modality or adjusting o...
11. Representation Alignment Rests on Linear Structure
Author: Kiril Bangachev, Guy Bresler, Yury Polyanskiy
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.28870v1 Announce Type: new Abstract: We investigate the Platonic Representation Hypothesis (PRH) through a tripartite statistical framework of representations: signal, bias, and noise. {1) Signal:} We propose that Platonic alignment arises from the universal relationship between objects a...
12. Pre-Registering the Detectable Effect: A Paired-MDE Budget for 4-bit Quantization Benchmarks, with a Pilot Audit
Author: Zexin Zhuang, Yanhang Li, Zhichao Fan
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.28873v1 Announce Type: new Abstract: This is a planning-method note with an unpaired pilot audit. We adapt the classical paired-binary sample-size calculation (Miettinen, 1968) to quantization benchmarks, giving a conservative minimum detectable effect (MDE) bound $\delta^{*} \le (z_{1-\a...
13. Towards Continuous-time Causal Foundation Models
Author: Dennis Thumm, Ruben Wiedemann, Ying Chen
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, physics.data-an, stat.ME
arXiv:2605.28880v1 Announce Type: new Abstract: Extending discrete-time causal Prior-data Fitted Networks for time series to continuous time invites writing the mechanism as a stochastic differential equation (SDE) -- but if the SDE is integrated \emph{once per observation gap}, the trajectory law d...
14. Context Distillation as Latent Memory Management
Author: Ziyang Zheng, Zeju Li, Xiangyu Wen, Jianyuan Zhong, Junhua Huang, Lei Chen, Mingxuan Yuan, Qiang Xu
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.28889v1 Announce Type: new Abstract: Context distillation compresses contextual information into model parameters, yet existing methods often ignore how multiple distilled latent memories should be stored, retrieved, and safely activated in non-oracle settings. We formulate context distil...
15. Feature Geometry of LoRA Adapters: A Sparse Autoencoder Analysis of Representational Divergence in Fine-Tuned Language Models
Author: Prasanth K K
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.28896v1 Announce Type: new Abstract: Low-Rank Adaptation (LoRA) has emerged as a widely adopted approach for adapting large language models, yet the internal representational changes induced by LoRA fine-tuning remain insufficiently understood. In this work, we investigate the geometry of...
16. Spectral Guidance for Flexible and Efficient Control of Diffusion Models
Author: Gabriel Moreira, Manuel Marques, Jo~ao Paulo Costeira, Chenyan Xiong
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.28900v1 Announce Type: new Abstract: We introduce Spectral Guidance, a framework for controlling diffusion models by leveraging the intrinsic geometry of the generative process. As data is progressively corrupted by noise, only a small number of features remain informative for control. We...
17. Sequential Physics-Constrained Neural Operator Forward Modeling for the $\textit{Norne}$ Reservoir System
Author: Clement Etienam, Juntao Yang, Oleg Ovcharenko, Nick Luiken, Tsubasa Onishi, Nefeli Moridis, Issam Said
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.28909v1 Announce Type: new Abstract: We develop a comprehensive mathematical and computational framework for sequential surrogate modeling of three-phase black-oil reservoir dynamics using neural operators, with particular emphasis on Fourier Neural Operators (FNO) and their physics-infor...
18. Cycle-Space Informed Detection of Autoencoded Blind False Data Injection Attacks on Power Systems
Author: Xin Li, Chenhan Xiao, Jonathan Cohen, Aviad Elyashar, Yang Weng, Rami Puzis
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.CR
arXiv:2605.28912v1 Announce Type: new Abstract: The rapid growth of AI-driven data centers and large-scale energy storage systems is increasing the reliance of power system operation on real-time measurement data and automated decision-making. However, many existing detection methods rely on statist...
19. When LLM Reward Design Fails: Diagnostic-Driven Refinement for Sparse Structured RL
Author: Youting Wang, Yuan Tang, Bowen Liu, Xuan Liu, Dingyan Shang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.IR
arXiv:2605.28918v1 Announce Type: new Abstract: For sparse, structured reinforcement-learning tasks with semantic reward-function interfaces, LLM-generated reward shaping is better framed as debugging than one-shot generation. We study PPO-trained agents using MiniGrid as core evaluation and MuJoCo ...
20. CosmicFish-HRM: Adaptive Reasoning via Hierarchical Recurrent Mechanisms in Compact Language Models
Author: Venkat Akhil Lakkapragada
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL
arXiv:2605.28919v1 Announce Type: new Abstract: Large language models have achieved strong reasoning capabilities, though often at the cost of massive parameter counts and expensive inference. In this work, we explore a different direction: adaptive reasoning depth in compact language models. We pre...
21. Conf-Gen: Conformal Uncertainty Quantification for Generative Models
Author: Gabriel Loaiza-Ganem, Kevin Zhang, Wei Cui, Marc T. Law, Kin Kwan Leung
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, stat.ML
arXiv:2605.28920v1 Announce Type: new Abstract: Conformal prediction (CP) and its extension, conformal risk control (CRC), are established frameworks for quantifying uncertainty in supervised machine learning through formal guarantees. However, recent breakthroughs in artificial intelligence (AI) ha...
22. A Training-Time Diagnostic for Generalization via the Log-Alignment Ratio
Author: Ali Shehper, Ashish Vaswani
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.28975v1 Announce Type: new Abstract: We study the log-alignment ratio (LAR), a measure of parameter-activation alignment, introduced in parameterization theory. We reformulate it as the overlap between a weight spectrum $p$ of the normalized squared singular values of a matrix and an acti...
23. Comparing Post-Hoc Explainable AI Methods for Interpreting Black-Box EEG Models in Depression Detection
Author: Antonia \v{S}ar\v{c}evi'c, Nikolina Frid
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.28977v1 Announce Type: new Abstract: Recent advances in deep learning have enabled increasingly accurate electroencephalography (EEG)-based classification of Major Depressive Disorder (MDD), but the decision-making processes of high-capacity models remain difficult to interpret. This stud...
24. The Hamilton-Jacobi Theory of Deep Learning
Author: Jose Marie Antonio Mi~noza, Erika Fille T. Legara, Christopher P. Monterola
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, math.DS, math.RT, physics.comp-ph
arXiv:2605.28983v1 Announce Type: new Abstract: In this paper, training a neural network is identified, exactly, as a search through Hamilton--Jacobi initial-value problems: each gradient step selects the initial data of a viscous Hamilton--Jacobi equation whose Hopf--Cole propagator best fits the o...
25. Learning Robust and Task-Invariant Functional Representation from fMRI through Siamese Self-Supervised Learning
Author: Jiyao Wang, Peiyu Duan, Nicha C. Dvornek, Lawrence H. Staib, Denis Sukhodolsky, Pamela Ventola, James S. Duncan
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.28990v1 Announce Type: new Abstract: Functional magnetic resonance imaging (fMRI) is a powerful tool for investigating human brain function. However, the high cost of data acquisition and the inherent subjectivity of psychiatric rating scales often lead to datasets with small sample sizes...
26. FormInv: A Measurement Protocol for Semantic Invariance in Mathematical Reasoning Benchmarks
Author: Nishal Thomas, Noel Thomas
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.29001v1 Announce Type: new Abstract: A paraphrase-quality audit of MathCheck (ICLR 2025) detected 4 semantically incorrect paraphrases in 129 groups (3.1%); removing them drops GPT-4o from rank 2 to rank 4 and elevates Claude Haiku and DeepSeek V3 above it; these ranking changes are invis...
27. FedQHD: Closed-Form Function-Space Federated Reinforcement Learning
Author: Yuchen Hou, Yongshan Chen, Zhuowen Zou, Calvin Yeung, Mohsen Imani, Tian Lan, Mahdi Imani
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.DC
arXiv:2605.29002v1 Announce Type: new Abstract: Federated reinforcement learning enables decentralized agents to collaboratively improve policies or value estimates without exchanging raw trajectories. However, FedAvg-style parameter averaging is not function-space consistent: when clients use heter...
28. LoRe: Adaptive Interaction-Evaluation Routing with Per-Step Interaction Budgets for Iterative Graph Solvers
Author: Jintao Li, Yong-Yi Wang, Zheng-An Wang, Heng Fan
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.29005v1 Announce Type: new Abstract: Diffusion-based neural solvers for combinatorial optimization repeatedly re-evaluate dense edge/factor interactions, making inference expensive in wall-clock time and often memory-bound at scale. Inspired by the computational methodologies of many-body...
29. Causal Intelligence for Constraint-Aware Intervention Design to Induce State Transitions
Author: Zixuan Song, Uwe Mueller, Dimitris V. Manatakis
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29008v1 Announce Type: new Abstract: Driving a system from one state to another through targeted interventions is a fundamental challenge in science, yet most predictive models offer limited mechanistic insight and no principled framework for decision-making. Here we present COAST (Causal...
30. Label-Free Reinforcement Learning via Cross-Model Entropy
Author: Matt Gorbett, Hossein Shirazi
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.29009v1 Announce Type: new Abstract: Post-training large language models with reinforcement learning is bottlenecked by the reward signal. Existing approaches require either ground-truth verifiable rewards, restricting training to domains with automatic correctness checks (e.g., mathemati...
31. Designing Active Tether-Net Systems for Space Debris Capture with Graph-Learning-Aided Mixed-Combinatorial Optimization
Author: Feng Liu, Achira Boonrath, Gishnu Madhu, Eleonora M. Botta, Souma Chowdhury
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29021v1 Announce Type: new Abstract: Active tether-net systems are a promising solution for capturing large non-cooperative targets, such as space debris, by deploying a flexible net manipulated by maneuverable units (MUs). However, concurrent systematic explorations of design and control...
32. Return-to-Go Is More Than a Number: Q-Guided Alignment for Return-Conditioned Supervised Learning
Author: Yuxiao Yang, Weitong Zhang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.29028v1 Announce Type: new Abstract: Conditioned Sequence Models (CSMs) learn policies by treating return-to-go (RTG) as a control signal. However, existing CSMs often treat the RTGs as simple numerical inputs rather than aligning them with the performance of their policies. In this paper...
33. Theoretical Foundations and Effective Algorithms for Policy-Aware Simulator Learning
Author: Christoph Dann, Yishay Mansour, Mehryar Mohri
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2605.29032v1 Announce Type: new Abstract: Model-based reinforcement learning (MBRL) agents typically learn world models by minimizing predictive loss. However, powerful RL optimizers inevitably exploit minor model inaccuracies, leading to simulator exploitation and a reality gap where policies...
34. Moment Matching Q-Learning
Author: Yiyan (Edgar), Liang, Sifei Liu, Weitong Zhang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29033v1 Announce Type: new Abstract: Score-based and flow-based generative models exhibit remarkable expressive capacity in capturing complex distributions, and have been extensively deployed in tasks ranging from image generation to reinforcement learning. Nevertheless, these models suff...
35. Parallel Adaptive Multi-Objective Evolutionary Learning of Discretized Bayesian Network Classifiers for Clinical Data
Author: Damy M. F. Ha, Tanja Alderliesten, Peter A. N. Bosman
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29058v1 Announce Type: new Abstract: Bayesian Networks (BNs) are of interest from an explainable AI viewpoint, offering transparent probabilistic models for decision support. Baymex is a recently introduced multi-objective evolutionary algorithm for learning discretized BNs, enabling expe...
36. Ensemble Score Filtering for Real-Data Energy Consumption Forecast Correction
Author: Ruoyu Hu, Dahai Yu, Feng Bao, Guang Wang, Guannan Zhang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.NA, math.NA
arXiv:2605.29072v1 Announce Type: new Abstract: Accurate estimation and forecasting of energy consumption are important for power-system operation, planning, and demand-side management. In practice, however, complete and timely measurements may not always be available, and the observed data can be p...
37. Knowledge Offloading: Decomposing LLMs into Sparse Backbones and Memory Modules
Author: Karim Galliamov, Rochelle Choenni, Ivan Titov
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29075v1 Announce Type: new Abstract: LLMs encode both general capabilities and domain-specific knowledge in a single set of parameters. We ask whether this capacity can be reorganized: keeping broadly useful computation in a shared backbone, while moving specialized knowledge into externa...
38. OISD: On-Policy Internal Self-Distillation of Language Models
Author: Xinyu Liu, Darryl Cherian Jacob, Yang Zhou, Jindong Wang, Pan He
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CV
arXiv:2605.29089v1 Announce Type: new Abstract: Recent reinforcement learning (RL) post-training approaches primarily optimize the final output policy using sparse outcome-level rewards, while largely overlooking predictive signals encoded in intermediate representations. In this paper, we introduce...
39. Model Merging by Output-Space Projection
Author: Bethan Evans, Benjamin Etheridge, Stephen Roberts, Jared Tanner
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.IT, math.IT
arXiv:2605.29101v1 Announce Type: new Abstract: Model merging combines fine-tuned checkpoints into a single multi-task model without retraining. Existing methods - such as task arithmetic, model soups, TIES, and DARE - are computationally efficient and empirically successful, but rely on heuristic d...
40. Bridging Chemists and AI: An Expert-Augmented Framework for Interpretable Route Evaluation
Author: Yujia Guo, Mikhail Kabeshov, Tat Hong Duong Le, Samuel Genheden, Marco V. Mijangos, Varvara Voinarvoska, Giulia Bergonzini, Ola Engkvist, Samuel Kaski
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29108v1 Announce Type: new Abstract: Selecting efficient multi-step synthetic routes is a central challenge in organic synthesis, particularly in medicinal and process chemistry, where route choice directly impacts feasibility, cost, and development efficiency. Data-driven assessment syst...
41. When and How Long? The Readout-Mediator Angle in Temporal Reasoning
Author: Shreyas Fadnavis, Praitayini Kanakaraj, Felix Wyss
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.29126v1 Announce Type: new Abstract: A linear probe can decode a representation almost perfectly and yet be completely irrelevant to how the model uses it. On calendar-date duration reasoning in language models, a $\sin$/$\cos$ probe recovers day-of-year from a layer's activations, yet ab...
42. Apertus LLM Family Expansion via Distillation and Quantization
Author: Andrei Panferov, Davit Melikidze, Martin Jaggi, Dan Alistarh
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29128v1 Announce Type: new Abstract: The wide adoption of LLMs has led to their use in great variety of applications and scenarios, such as chatbot assistants and data annotation, creating the need for the models to satisfy certain budget and hardware constraints. This has led to the tren...
43. Optimal Gap-Dependent Regret for Private Stochastic Decision-Theoretic Online Learning
Author: Tommaso Cesari, Roberto Colomboni
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2605.29148v1 Announce Type: new Abstract: We study stochastic decision-theoretic online learning with full information and event-level pure differential privacy. A COLT open problem of Hu and Mehta asks to determine the optimal gap-dependent regret rate for stochastic decision-theoretic online...
44. Do Deep Networks Forget Initialization? A Forgetting-Time View of Practical Inductive Bias
Author: Mohua Das, Pierfrancesco Beneventano, Shibshankar Dey, Gareth H. McKinkey, Tomaso Poggio
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, math.OC, stat.ML
arXiv:2605.29152v1 Announce Type: new Abstract: Randomly initialized neural networks induce a prior over functions, but the predictor used in practice is produced only after training. We ask how much of this initial bias survives the training pipeline. To make the question measurable, we introduce i...
45. Unveiling Multi-regime Patterns in SciML: Distinct Failure Modes and Regime-specific Optimization
Author: Yuxin Wang, Yuanzhe Hu, Xiaokun Zhong, Xiaopeng Wang, Haiquan Lu, Tianyu Pang, Michael W. Mahoney, Yujun Yan, Pu Ren, Yaoqing Yang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, physics.comp-ph
arXiv:2605.29153v1 Announce Type: new Abstract: Neural networks trained under different hyperparameter settings can fall into distinct training "regimes," with consistent behavior within regimes and qualitative differences across regimes. In this paper, we study such multi-regime behavior in scienti...
46. RUBRIC-ARROW: Alternating Pointwise Rubric Reward Modeling for LLM Post-training in Non-verifiable Domains
Author: Haoxiang Jiang, Zihan Dong, Tianci Liu, Wanying Wang, Ran Xu, Tony Yu, Linjun Zhang, Haoyu Wang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.CL
arXiv:2605.29156v1 Announce Type: new Abstract: Pointwise reward modeling offers critical signals for LLM post-training, yet struggles with absolute scoring in subjective, non-verifiable settings. Rubric-based methods address this by decomposing evaluation into explicit criteria, but existing approa...
47. Parallax: Parameterized Local Linear Attention for Language Modeling
Author: Yifei Zuo, Dhruv Pai, Zhichen Zeng, Alec Dewulf, Shuming Hu, Zhaoran Wang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL
arXiv:2605.29157v1 Announce Type: new Abstract: Large Language Models (LLMs) have become the central paradigm in artificial intelligence, yet the core computational primitive of attention has remained structurally unchanged. Local Linear Attention (LLA) is an attention mechanism derived from nonpara...
48. PROTOCOL: Late Interaction Retrieval for Protein Homolog Search
Author: Gabrielle Cohn, Rohan Gumaste, Minh Hoang, Vihan Lakshman
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.IR, q-bio.BM
arXiv:2605.29158v1 Announce Type: new Abstract: Protein homology search underlies function annotation, structure prediction, and evolutionary analysis, but remains challenging in the "twilight zone," where global sequence similarity is weak and classical alignment methods lose sensitivity. Protein l...
49. Evolutionary Refinement of Generative Graph Topologies: A Hybrid WGAN-GA Approach
Author: James Sargant, Seyedeh Ava Razi Razavi, Renata Dividino, Sheridan Houghten
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.29161v1 Announce Type: new Abstract: Generating realistic graph-structured data is challenging due to discrete connectivity, varying graph sizes, and class-specific structural patterns. Recent Generative Adversarial Networks (GAN)-based graph generation methods improve edge modelling by l...
50. Probabilistic bias adjustment of seasonal forecasts using generative machine learning: A case study of Arctic sea ice predictions
Author: Parsa Gooya, Reinel Sospedra-Alfonso
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, physics.ao-ph
arXiv:2605.29172v1 Announce Type: new Abstract: Seasonal climate predictions support planning and risk management by offering early information of the most likely-to-occur climate conditions in the coming months, and associated uncertainties. Ensemble forecasts enable this by simulating many plausib...
51. TIMEGATE: Sustainable Time-Boxed Promotion Gates for Continual ML Adaptation Under Resource Constraints
Author: Abhijit Chakrabroty, Suddhasvatta Das, Kevin A. Gary, Yash Shah
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.29183v1 Announce Type: new Abstract: As machine learning(ML) systems evolve to continual adaptation, each re-training cycle uses compute, annotation, and energy. We introduce TIMEGATE, a policy layer managing adaptation by budgeting time, labeling, training, and evaluation. TIMEGATE emits...
52. Influence-Guided Symbolic Regression: Scientific Discovery via LLM-Driven Equation Search with Granular Feedback
Author: Evgeny S. Saveliev, Samuel Holt, Nabeel Seedat, David L. Bentley, Jim Weatherall, Mihaela van der Schaar
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.29184v1 Announce Type: new Abstract: Large Language Models (LLMs) offer a promising avenue for scientific discovery, yet their application to symbolic regression is often constrained by inefficient search strategies and coarse feedback signals. Current methods typically guide LLMs using s...
53. When RL Suppresses Its Own Vocabulary: Recovering Reasoning Diversity in Puzzle-to-Math Transfer
Author: Mayug Maniparambil, Arjun Karuvally, Terrence Sejnowski, Fergal Reid
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.CL
arXiv:2605.29190v1 Announce Type: new Abstract: Reinforcement learning using verifiable rewards (RLVR) improves LLM reasoning, but the conditions under which it transfers across domains -- and why it does so -- remain under-explored. We study cross-domain transfer in a 7B model whose SFT and RL post...
54. Stochastic Lifting for Generating Trajectories of Stochastic Physical Systems
Author: Jules Berman, Tobias Blickhan, Benjamin Peherstorfer
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.NA, math.NA
arXiv:2605.29194v1 Announce Type: new Abstract: Many stochastic physical systems evolve smoothly over time in the sense that the distribution of states changes regularly across time steps. The transition from current state to the next state can often be modeled as the combination of a smooth map and...
55. Auditing Training Data in Generative Music Models via Black-Box Membership Inference
Author: Yi Chen Liu, Jiawei Yu, Kexin Cao, Syed Irfan Ali Meerza, Trishika Movva, Jian Liu
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29202v1 Announce Type: new Abstract: Recent advances in text-to-music generation enable high-fidelity synthesis of structured musical audio, raising growing concerns about data provenance, consent, and training transparency. These models are typically trained on large-scale corpora with l...
56. Inferring the Size of Large Language Models From Popular Text Memorization
Author: Ivica Nikolic
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29223v1 Announce Type: new Abstract: The parameter counts of the most widely used large language models (LLMs) are often withheld by their developers, leaving model size -- a primary reference point for interpreting capabilities and costs -- largely undisclosed. We propose a black-box met...
57. Traditional machine learning vs. deep learning from dynamic graph representations of proteins' 3D folds in the task of protein structure classification
Author: Aydin Wells, Francis A. Gatsi, Aaron Striegel, Tijana Milenkovi'c
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, q-bio.MN
arXiv:2605.29228v1 Announce Type: new Abstract: Protein structure classification (PSC) uses supervised learning to predict a protein's CATH/SCOP(e) class from the protein's sequence or 3D structural feature(s). We already modeled 3D structures as (static) protein structure networks (PSNs), demonstra...
58. BlockBatch: Multi-Scale Consensus Decoding for Efficient Diffusion Language Model Inference
Author: Xiaoyou Wu (Celine), Cheng-Jhih Shih (Celine), Binfei Ji (Celine), Yong Liu (Celine), Yingyan (Celine), Lin
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.29233v1 Announce Type: new Abstract: Diffusion language models (dLLMs) generate text by iteratively denoising multiple token positions in parallel, offering an attractive alternative to strictly autoregressive decoding. In practice, however, block-wise dLLM inference exposes a difficult g...
59. SigmaMedStat: Temporal Signal Modeling for ICU False Alarm Reduction
Author: Arunkumar Ramachandran
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29236v1 Announce Type: new Abstract: Alarm fatigue in intensive care units (ICUs) is a well documented patient safety crisis. Clinical monitors generate 350 or more alarms per patient per day, out of which 72-99% are clinically irrelevant. Staff desensitization to non-actionable alarms in...
60. KLAS: Using Similarity to Stitch Neural Networks for Improved Accuracy-Efficiency Tradeoffs
Author: Debopam Sanyal, Anantharaman Iyer, Alind Khare, Trisha Jain, Akshay Jajoo, Myungjin Lee, Clayton Kerce, Alexey Tumanov
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.29259v1 Announce Type: new Abstract: Given the wide range of deployment targets, flexible model selection is essential for optimizing performance within a given compute budget. Recent work demonstrates that stitching pretrained models within a model family enables cost-effective interpola...
61. Robust Frequency-Calibrated Virtual EEG Channel Generation from Four Frontal Electrodes for Wearable EEG Augmentation
Author: Minghao Xiao
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29263v1 Announce Type: new Abstract: Low-channel wearable electroencephalography (EEG) is attractive for long-term monitoring, but four frontal electrodes provide only a sparse and spatially biased view of distributed scalp activity. We present FAVC-Net, a compact frequency-calibrated vir...
62. Causal Label Recovery in Payment Networks
Author: Gaurav Dhama
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, stat.ML
arXiv:2605.29272v1 Announce Type: new Abstract: Fraud detection models in payment networks train on chargeback labels that are systematically biased. Every label must survive three sequential gates: authorization (declined transactions generate no labels), issuer reporting (unreported fraud is invis...
63. A Theoretical and Experimental Study of a Novel Adaptive Learning Algorithm
Author: Sakshi Kumari, Shyam Kumar M, Sushmitha P
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, math.OC
arXiv:2605.29273v1 Announce Type: new Abstract: A crucial component of machine learning algorithms is minimizing loss functions with less computational cost and less oscillations. While adaptive learning rate-based optimizers have been widely used for real-world tasks, they do not guarantee converge...
64. LoopFM: Learning frOm HistOrical RePresentations of Foundation Model for Recommendation
Author: Shali Jiang, Hua Zheng, Boyang Liu, Laming Chen, Kenny Lov, Chuanqi Xu, Lisang Ding, Qinghai Zhou, Can Cui, Xiaolong Liu, Xiaoyi Liu, Yasmine Badr, Xin Xu, Jiyan Yang, Ellie Dingqiao Wen, Gerard Jonathan Mugisha Akkerhuis, Chenxiao Guan, Rong Jin, Ruichao Qiu, Xian Chen, Shifu Xu, Zhehui Zhou, Ping Chen, Rui Yang, Haicheng Chen, Xiangge Meng, Song Zhou, Dharak Kharod, Shuyu Xu, Qiang Jin, Qiao Yang, Wankun Zhu, Qin Huang, Yuzhen Huang, Darren Liu, Parish Aggarwal, Hui Zhou, Erzhuo Wang, Shuo Chang, Xiaorui Gan, Wenlin Chen, Santanu Kolay, Huayu Li
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.IR
arXiv:2605.29280v1 Announce Type: new Abstract: Knowledge distillation (KD) transfers a single scalar prediction from a large foundation model (FM) to compact vertical models (VMs), suffering from diminishing transfer ratio -- the fraction of FM improvement captured by the VM -- as a single scalar c...
65. Do Physics Foundation Models Learn Generalizable Physics? A Bias-Aware Benchmark Across Physical Regimes and Distribution Shifts
Author: Mengdi Chu, Yang Liu, Ayan Biswas, Han-Wei Shen
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.29283v1 Announce Type: new Abstract: Recent physics foundation models claim general spatiotemporal forecasting ability, yet their evaluations often collapse performance into a single average score under a fixed training distribution. This makes it difficult to determine whether a model ha...
66. NeuroEdge: Real-Time Hand Gesture Recognition with High-Density EMG Using Deep Learning at the Edge
Author: Peter Chudinov, Zhenyu Lin, Jay Motamarry, Srihita Panati, Xiaorong Zhang, Zhuwei Qin
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29326v1 Announce Type: new Abstract: High-density electromyography (HD-EMG) has emerged as a powerful modality for decoding fine-grained neuromuscular activity, enabling real-time neural-machine interfaces (NMIs) for applications such as prosthetic control, rehabilitation, and augmented i...
67. Attention as In-Context Empirical Bayes: A Two-Stage View via Particle Dynamics
Author: Matthew Smart, Soumya Ganguly, Nilava Metya, Alexandre V. Morozov, Anirvan M. Sengupta
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, math.DS, stat.ML
arXiv:2605.29351v1 Announce Type: new Abstract: We study minimal attention-only transformers under all-token corruption and show they admit a two-stage empirical Bayes interpretation. A single attention step computes a kernel-weighted posterior mean with respect to the empirical distribution defined...
68. Neural-Behavioral Representation of Natural Whole-body Movement in Monkeys
Author: Jieshi He, Puzhe Li, Yanan Sui, Mu-ming Poo
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, q-bio.NC
arXiv:2605.29355v1 Announce Type: new Abstract: Understanding how cortical activity represents natural whole-body behaviors in primates remains challenging. Limited by the diversity of movements and inaccessibility of large-scale neural representation of whole-body kinematics, previous motor decodin...
69. Solving Integer Linear Programming with Parallel Tempering
Author: Kyuil Sim, Sanghyeok Choi, Jinkyoo Park
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29366v1 Announce Type: new Abstract: Integer Linear Programming (ILP) serves as a versatile framework for modeling a wide range of combinatorial optimization problems, typically addressed by sophisticated exact solvers or heuristics. While learning-based approaches have recently shown the...
70. Deep Adaptive Dimension Reduction for Bayesian Inference in Inverse Problems
Author: Yueyang Wang, Xili Wang, Kejun Tang, Xiaoliang Wan, Tao Zhou, Chao Yang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.NA, math.NA
arXiv:2605.29373v1 Announce Type: new Abstract: Solving high-dimensional PDE-governed inverse problems is often challenging due to complex non-Gaussian posterior distributions, expensive forward model evaluations, and misspecified prior information. To address these issues, we propose a deep adaptiv...
71. TRACER: Persistent Regularization for Robust Multimodal Finetuning
Author: Hesam Asadollahzadeh, Feng Liu, Christopher Leckie, Sarah M. Erfani
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CV
arXiv:2605.29380v1 Announce Type: new Abstract: Mainstream strategies for finetuning pretrained multimodal models often degrade out-of-distribution (OOD) robustness, a phenomenon known as catastrophic forgetting. In this paper, we develop a theoretical framework for multimodal contrastive finetuning...
72. On the Optimizer Dependence of Neural Scaling Laws
Author: Vansh Ramani, Shourya Vir Jain
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, stat.ML
arXiv:2605.29387v1 Announce Type: new Abstract: The scaling exponent $\alpha$ in neural scaling laws $L(N) \propto N^{-\alpha}$ is commonly treated as a fixed constant set by architecture and data. We present evidence that $\alpha$ depends systematically on the optimizer. In controlled random-featur...
73. GDSD: Reinforcement Learning as Guided Denoiser Self-Distillation for Diffusion Language Models
Author: Xiaohang Tang, Keyue Jiang, Che Liu, Qifang Zhao, Xiaoxiao Xu, Sangwoong Yoon, Ilija Bogunovic
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.29398v1 Announce Type: new Abstract: Reinforcement learning (RL) can be used to improve the policy (denoiser) of diffusion large language models (dLLMs), while being hindered by the intractability of the policy likelihood. A dominant and efficient family of methods replaces the likelihood...
74. Rethinking Post-Training Recipes for Multimodal Time-Series Forecasting
Author: Haoxin Liu, Yichen Zhou, Rajat Sen, B. Aditya Prakash, Abhimanyu Das
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29401v1 Announce Type: new Abstract: Time-Series Foundation Models (TSFMs) excel at zero-shot unimodal forecasting using numerical data, but unlike LLMs they cannot consume multimodal, non-numerical context that often shape real-world trajectories. In this work, we bridge this gap and arg...
75. Information-Directed Offline-to-Online Reinforcement Learning
Author: Keru Chen
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29405v1 Announce Type: new Abstract: Decision-making from offline datasets typically warm-starts a policy or score model from fixed offline data and then refines it with limited online interaction. Offline data reduces uncertainty, but it does not remove the need for exploration; it chang...
76. The Good, the Bad, and the Ugly of Markov Boundary for Tabular Prediction
Author: Shu Wan, Abhinav Gorantla, Huan Liu, K. Sel\c{c}uk Candan
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, stat.ME, stat.ML
arXiv:2605.29411v1 Announce Type: new Abstract: Under standard graphical assumptions, the Markov boundary of a target variable is the smallest set of features that renders every other feature redundant. Once the boundary is observed, the target is conditionally independent of the rest of the table. ...
77. How Much Is a Dataset Worth? Scaling Laws, the Vendi Score, and Matrix Spectral Functions
Author: Jeff A. Bilmes, Gantavya Bhatt, Arnav M. Das
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CV, cs.IT, math.IT
arXiv:2605.29448v1 Announce Type: new Abstract: Neural scaling laws appraise data through dataset size, while the Vendi Score uses quantum entropy to measure dataset value. We show both that common neural-scaling-law objectives and the Vendi Score are submodular. We further show that the Vendi Score...
78. Forget Less, Generalize More: Unifying Temporal and Structural Adaptation for Dynamic Graphs
Author: Qian Chang, Ciprian Doru Giurcaneanu, Runsong Jia, Xia Li, Guoping Hu, Xiufeng Cheng, Jinqing Yang, Mengjia Wu, Yi Zhang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.29453v1 Announce Type: new Abstract: Representation learning on dynamic graphs requires capturing complex dependencies that evolve across both time and structure. Existing approaches typically adopt fixed temporal decay schemes or predetermined structural propagation depths, limiting thei...
79. A Full-Pipeline Framework for Evaluating Membership Inference Attacks in Machine Learning
Author: Ding Chen, Xinwen Cheng, Xuyang Zhong, Xinping Chen, Xiaolin Huang, Chen Liu
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29454v1 Announce Type: new Abstract: While Membership Inference Attacks (MIAs) are the prevailing method for identifying training data, their application has expanded into privacy auditing and machine unlearning. Nevertheless, the field lacks a systematic framework for evaluating how diff...
80. Honest Lying: Understanding Memory Confabulation in Reflexive Agents
Author: Prakhar Dixit, Sadia Kamal, Tim Oates
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.29463v1 Announce Type: new Abstract: Reflexion-style agents rely on self-generated reflections as memory, implicitly assuming that agents can accurately diagnose their own failures.We show that this assumption can fail systematically: across ALFWorld and HumanEval, agents store confident ...
81. Composing Non-Conjugate Factor Graphs with Closed-Form Variational Inference
Author: Mykola Lukashchuk, Kyrylo Yemets, Wouter M. Kouw, Dmitry Bagaev, .Ismail \c{S}en"oz, Jeff Beck, Bert de Vries
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.29467v1 Announce Type: new Abstract: Stacking probabilistic building blocks into deeper architectures typically breaks closed-form inference. We show that closed-form inference can be preserved. We identify five factor-graph primitives: a bilinear factor, an exponential link, a Gamma prio...
82. Access Sets Matter: Budgeting Expert Reads for Scalable Weight-Space Model Merging
Author: Yuanyi Wang, Yanggan Gu, Su Lu, Yifan Yang, Zhaoyi Yan, Congkai Xie, Jianmin Wu, Hongxia Yang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.SY, eess.SY
arXiv:2605.29489v1 Announce Type: new Abstract: Weight-space model merging is usually formulated as an algebraic operation on checkpoints, yet at LLM scale the limiting resource is often the set of expert weights that must be read. We introduce MergePipe, a budget-aware execution layer that casts LL...
83. Gradient Perturbation: Learning to Perturb Gradients for Adaptive Training
Author: Hua Li
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29494v1 Announce Type: new Abstract: Deep neural network training involves both forward propagation (from features through logits to loss) and backward propagation (from loss through gradients to parameter updates). While perturbations along the forward chain, including feature perturbati...
84. On-Policy Replay for Continual Supervised Fine-Tuning
Author: Yan Chen, Taojie Zhu, Meng Zhang, Xin Chen, Jiaqi Huang, Dongyang Xu, Yizhi Wang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29495v1 Announce Type: new Abstract: Continual supervised fine-tuning (SFT) is the de facto recipe for adapting large language models (LLMs) to a stream of downstream tasks, but it suffers from catastrophic forgetting of earlier capabilities. Recent work shows that on-policy signals -- tr...
85. Convex Basins in Single-Index Model Loss Landscapes: Applications to Robust Recovery under Strong Adversarial Corruption
Author: Santanu Das, Sagnik Chatterjee, Jatin Batra
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29497v1 Announce Type: new Abstract: We study the problem of robustly learning Gaussian Single Index Models (SIMs) in the presence of heavy-tailed noise and a constant fraction of adversarially corrupted covariates and responses. Prior work on robust recovery has considered settings such ...
86. Quotient DAGs for Off-Policy Evaluation:Forward-Flow Importance Sampling and Exact Slate Propensities
Author: Ziwen Xie, Shaowen Xiang, Hongyu He, Dianbo Liu
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.29500v1 Announce Type: new Abstract: Off-policy evaluation estimates how a target policy would perform using data collected by a different behavior policy, which is crucial when online testing is costly or risky, such as in recommendation or healthcare. Standard importance sampling reweig...
87. K-FinHallu: A Hallucination Detection Benchmark for Multi-Turn RAG in Korean Finance
Author: Eunbyeol Cho, Yunseung Lee, Mirae Kim, Jeewon Yang, Youngjun Kwak, Edward Choi
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29523v1 Announce Type: new Abstract: Large Language Models (LLMs) have advanced financial automation through Retrieval-Augmented Generation (RAG), yet hallucinations remain a critical barrier to deployment in high-stakes environments. Existing benchmarks focus on single-turn, English-cent...
88. Learning to Perturb Hidden Representations for Generalizable Deep Learning
Author: Hua Li
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29525v1 Announce Type: new Abstract: Deep neural networks process data through a cascade of representations: input features, hidden activations, logits, and loss. While perturbations at the input, logit, and label levels have been systematically studied, the intermediate hidden activation...
89. AsymVLM: Asymmetric Token Pruning for Efficient Vision-Language Model Inference
Author: Yilin Feng, Ahmed Burak Gulhan, Mahmut Taylan Kandemir
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29535v1 Announce Type: new Abstract: Vision-Language Models (VLMs) process thousands of visual tokens per image alongside comparatively few text tokens, yet existing compression methods treat both modalities uniformly. We observe that the two modalities have fundamentally different proper...
90. SCOPE: A Lightweight-training LLM Framework for Air Traffic Control Readback Monitoring
Author: Qihan Deng, Minghua Zhang, Yang Yang, Zhenyu Gao
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL, cs.HC, cs.IR
arXiv:2605.29543v1 Announce Type: new Abstract: Pilot readback of Air Traffic Control (ATC) voice instructions is a primary safeguard against miscommunication in air transportation. However, readback anomalies remain implicated in approximately 80% of aviation incidents. This vulnerability is furthe...
91. Singularity-aware Optimization via Randomized Geometric Probing: Towards Stable Non-smooth Optimization
Author: Ruoran Xu, Borong She, Xiaobo Jin, Qiufeng Wang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, math.OC
arXiv:2605.29547v1 Announce Type: new Abstract: Deep learning optimization relies heavily on the assumption of smooth loss landscapes, a condition systematically violated by modern architectures due to non-smooth components such as ReLU activations and quantization operators. In such non-smooth regi...
92. Why Larger Models Learn More: Effects of Capacity, Interference, and Rare-Task Retention
Author: Jing Huang, Daniel Wurgaft, Rachit Bansal, Laura Ruis, Naomi Saphra, David Alvarez-Melis, Andrew Kyle Lampinen, Christopher Potts, Ekdeep Singh Lubana
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29548v1 Announce Type: new Abstract: Larger models learn tasks smaller models do not. What drives this phenomenon? We develop a simple phenomenological argument that power-law scaling already suggests that a larger model will be able to learn a part of the data distribution that a smaller...
93. On the Construction and Implications of Low-Loss Valleys in LoRA-based Bayesian Inference
Author: Daniel Dold, Emanuel Sommer, Julius Kobialka, Oliver D"urr, David R"ugamer
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2605.29580v1 Announce Type: new Abstract: While parameter-efficient fine-tuning methods like low-rank adaptation (LoRA) are standard for large language models, principled estimation of epistemic uncertainty remains challenging. Recent results in the LoRA regime suggest that discrete multi-mode...
94. PEARL: Training Socratic Tutors with Pedagogically Aligned Reinforcement Learning
Author: Qikai Chang, Zhenrong Zhang, Linbo Chen, Pengfei Hu, Jianshu Zhang, Youhui Guo, Jun Du
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.CL
arXiv:2605.29582v1 Announce Type: new Abstract: Large Language Models (LLMs) have shown promise as educational tutors, yet effective tutoring requires more than solving problems: it must provide progressive Socratic guidance and balance multiple pedagogical objectives across multi-turn interactions....
95. Cluster-Level Attention-Guided Parallel Decoding for Masked Diffusion Language Models
Author: Heqiang Qi, Wei Huang, Mingyuan Bai, Xiangming Meng
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29607v1 Announce Type: new Abstract: Masked diffusion language models (MDLMs) enable parallel decoding by predicting all masked positions at each denoising step, yet existing training-free samplers usually decide which positions to commit at token-level granularity. We revisit this granul...
96. M\=oLe-{\Lambda}: Learning the Coupled-Cluster Response State for Energies, Gradients, and Properties
Author: Andreas Burger, Luca Thiede, Abdulrahman Aldossary, Jorge A. Campos-Gonzalez-Angulo, Alex Zook, J'er^ome Florian Gonthier, Al'an Aspuru-Guzik
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, physics.chem-ph
arXiv:2605.29622v1 Announce Type: new Abstract: Coupled-cluster (CC) theory is often considered the gold standard of quantum chemistry, but its high computational cost limits routine access to accurate energies, forces and response properties. While the right-hand $T$-amplitudes determine the correl...
97. Relational Rank Geometry in Transformers: Detecting and Steering Hidden-State Relation Frames
Author: Mazen Kobrosly
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29634v1 Announce Type: new Abstract: Transformer hidden states are often interpreted through local or low-order objects: neurons, sparse features, attention heads, residual-stream directions, or activation patches. This paper studies a complementary object: the rank-indexed geometry of re...
98. The Sample Complexity of Multiclass and Sparse Contextual Bandits
Author: Liad Erez, Fan Chen, Alon Cohen, Tomer Koren, Yishay Mansour, Shay Moran, Alexander Rakhlin
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, stat.ML
arXiv:2605.29645v1 Announce Type: new Abstract: We study contextual bandits in the stochastic i.i.d.\ setting, where a learner observes contexts drawn from an unknown distribution, selects actions from a finite set $A$, and aims to identify an approximately optimal policy from a given class based on...
99. Opir: Efficient Multi-Task Safety Classification for Toxicity, Jailbreaks, Hate Speech, and Harmful Content
Author: Ihor Stepanov, Aleksandr Smechov
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL
arXiv:2605.29659v1 Announce Type: new Abstract: Real-time safety filtering for large language model (LLM) applications requires classifiers that can detect unsafe prompts, toxic language, jailbreak attempts, and unsafe responses without the cost profile of large guardrail models, and that can distin...
100. A Geometric View of SRC: Learning Representations for Stable Residual Inference
Author: Vangelis P. Oikonomou
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.CV
arXiv:2605.29673v1 Announce Type: new Abstract: Reconstruction-based inference assigns a class by comparing class-wise reconstruction residuals; Sparse Representation Classification (SRC) is a canonical instance whose reliability depends on the geometry of the learned representation. We adopt a stri...
101. Kernel Renormalization in Bayesian Deep Neural Networks: the Equivalent Wishart Ansatz in the Proportional Regime
Author: Paolo Baglioni, Christian Keup, Vincenzo Zimbardo, Rosalba Pacelli, Alessandro Vezzani, Raffaella Burioni, Pietro Rotondo
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cond-mat.dis-nn, stat.ML
arXiv:2605.29684v1 Announce Type: new Abstract: The scaling limit where both the size of the training set $P$ and the width $N$ of a deep neural network grow at the same rate, the so-called proportional-width regime, has been intensely studied for shallow, single-hidden-layer networks. However, exte...
102. A Novel Tensor Product-Based Neural Network for Solving Partial Differential Equations
Author: Qihong Yang, Yangtao Deng, Qiaolin He, Shiquan Zhang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29688v1 Announce Type: new Abstract: This paper presents the Tensor Product Network (TPNet), a novel neural architecture for efficient and accurate function approximation and PDE solving. The core of the proposal involves constructing the solution explicitly as a linear combination of bas...
103. Momentum Based Reward Design for Low Emission Traffic Signal Control
Author: Chinmay Mundane, Amith Manoharan, Arun Singh
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.RO
arXiv:2605.29693v1 Announce Type: new Abstract: Urban traffic congestion is a growing global issue contributing significantly to long commute times and environmental pollution. Traditional traffic signal control systems often fail to adapt to dynamic traffic conditions. Adaptive traffic signal contr...
104. A Systematic Evaluation of Molecular Mixture Behavior Prediction
Author: Roel J. Leenhouts, Nathan K. Morgan, William Green, Jan G. Rittig, Florence H. Vermeire
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, physics.chem-ph
arXiv:2605.29698v1 Announce Type: new Abstract: Machine learning for molecular property prediction has focused largely on pure compounds, even though many practical applications depend on mixtures with intermolecular interactions. Recent work has expanded the availability of mixture datasets, but ev...
105. The Little Book of Generative AI Foundations: An Intuitive Mathematical Primer
Author: Tianhua Chen
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.29713v1 Announce Type: new Abstract: This book provides a compact, derivation-oriented introduction to the mathematical foundations of modern generative artificial intelligence. Rather than surveying every recent architecture or implementation detail, it develops a coherent route through ...
106. Bastion: Budget-Aware Speculative Decoding with Tree-structured Block Diffusion Drafting
Author: Soowon Oh, Nam Cao, Yujin Kim, Hojung Jung, Huzama Ahmad, Sangmin Bae, Se-Young Yun
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29727v1 Announce Type: new Abstract: Block-diffusion drafters have recently emerged as a powerful alternative for speculative decoding by predicting multiple future-token distributions in a single parallel step. However, since these parallel predictions are sampled from position-wise marg...
107. Realistic honeypot evaluations for scheming propensity
Author: Victoria Krakovna, David Lindner, Lewis Ho, Sebastian Farquhar, Rohin Shah
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29729v1 Announce Type: new Abstract: We introduce scheming honeypot evaluations, a framework for testing whether models will pursue instrumental goals if given the opportunity. Our scheming honeypot evaluations take the form of coding tasks in Google's alignment research codebases. In a r...
108. EMAG: Differentiable 4D Gaussian Mixture Splatting for EEG Spatial Super-Resolution
Author: Alex Lazarovich, Ofir Itzhak Shahar, Gur Elkin, Ohad Ben-Shahar
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29731v1 Announce Type: new Abstract: High-density electroencephalography (HD-EEG) enables fine-grained measurement of cortical activity but requires expensive hardware and lengthy setup times, limiting its clinical and research accessibility. We propose EMAG (EEG Mixture of Anisotropic Ga...
109. MMTM: Tri-Modal Topic Modeling for Long-Form Video via Similarity-Gated Fusion
Author: Ali Abusaleh, Bhuvanesh Verma, Alexander Mehler
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29765v1 Announce Type: new Abstract: We introduce MMTM, a modular pipeline for topic discovery in long-form video that integrates speech recognition, audio and visual embeddings, and BERTopic clustering through a deterministic similarity-gated fusion. Evaluated cross-lingually on German (...
110. Hista and Numca: Estimate State Value Effectively for LLM Reinforcement Learning
Author: Zizhe Chen, Jiqian Dong, Yizhou Tian, Garry Yang, Yongqiang Chen, Zhitang Chen, James Cheng
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL
arXiv:2605.29782v1 Announce Type: new Abstract: Reinforcement learning (RL) refines large language models (LLMs) by directly optimizing model behavior through reward signals. While accurate state value estimation is critical for stable training in classical RL, it remains an underexplored challenge ...
111. Gated Graph Attention Networks with Learnable Temperature
Author: Zhongtian Ma, Hao Wu, Yexin Zhang, Qiaosheng Zhang, Zhen Wang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29803v1 Announce Type: new Abstract: Graph attention networks learn neighbor importance through data-dependent coefficients, but standard layers lack explicit control over unreliable feature dimensions and use fixed sharpness of attention coefficient distributions. This paper proposes gat...
112. The Interplay Between Interpolation and Aggregation in Regression: Optimal Sample Complexity
Author: Mikael M{\o}ller H{\o}gsgaard, Kasper Green Larsen, Liang-Yu Zou
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29819v1 Announce Type: new Abstract: This work investigates theoretically the interplay between interpolation and aggregation in regression. We establish that the $\gamma$-graph dimension characterizes learnability for a broad class of natural aggregation procedures. Furthermore, we prove...
113. When Do Graph Foundation Models Transfer? A Data-Centric Theory
Author: Jiajun Zhu, Ying Chen, Peihao Wang, Yixuan He, Pan Li, Aditya Akella, Zhangyang Wang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29828v1 Announce Type: new Abstract: Graph foundation models (GFMs) aim to reuse a single backbone across diverse graph domains, yet their transfer is often uneven and can exhibit negative transfer. While most prior work improves transfer through architectural or adaptation choices, we as...
114. Open World Autoencoding Drift Detection with Novel Class Recognition in Tabular Non-stationary Data Streams
Author: Joanna Komorniczak
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29834v1 Announce Type: new Abstract: Data stream processing has become a landmark in modern machine learning applications, with concept drifts and novel class appearances posing the primary challenges faced by sophisticated recognition methods. This work proposes an unsupervised concept d...
115. CB-SLICE: Concept-Based Interpretable Error Slice Discovery
Author: Yael Konforti, Mateo Espinosa Zarlenga, Elaf Almahmoud, Mateja Jamnik
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, stat.ML
arXiv:2605.29836v1 Announce Type: new Abstract: Despite strong average-case performance, deep learning models often exhibit systematic errors on specific population groups, known as error slices. Identifying these groups and the root causes of their failures is critical for model debugging and bias ...
116. HARP: Hadamard-Preconditioned Adaptive Rotation Processor for Extreme LLM Quantization
Author: Artur Zagitov, Gleb Molodtsov, Aleksandr Beznosikov
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.29843v1 Announce Type: new Abstract: Post-training quantization (PTQ) is essential for deploying LLMs under memory and bandwidth constraints. However, extreme low-bit quantization remains highly sensitive to activation outliers and anisotropic weight curvature. Existing incoherence-based ...
117. MIRAGE: Adaptive Multimodal Gating for Whole-Brain fMRI Encoding
Author: Abdulkadir Gokce, Badr AlKhamissi, Martin Schrimpf
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29850v1 Announce Type: new Abstract: Recent progress in task-optimized neural networks has established encoding models as a powerful tool for predicting brain responses to naturalistic stimuli, yet most existing approaches rely on unimodal representations. The emergence of omni-modal foun...
118. Feedback-to-Rubrics: Can We Learn Expert Criteria from Inline Comments?
Author: Kotaro Yoshida, So Kuroki, Yuki Imajuku, Taishi Nakamura, Ryunosuke Iwai, Haruki Goda, Takuya Akiba
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29857v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used for writing and review support, but their usefulness depends on context-dependent criteria, such as expert preferences or organization-specific conventions, that are often tacit, undocumented, and diff...
119. ESPO: Early-Stopping Proximal Policy Optimization
Author: Zihang Li, Rui Zhou, Yingcheng Shi, Wenhan Yu, Zhewen Tan, Zixiang Liu, Zeming Li, Binhua Li, Yongbin Li, Tong Yang, Jieping Ye
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.29860v1 Announce Type: new Abstract: When a large language model under reinforcement learning commits a wrong reasoning step early in a trajectory, standard algorithms force it to keep generating until the maximum horizon, spending compute on tokens that never receive positive reward and ...
120. STAP: A Shuffle-Tokenized App Predictor with Ultra Long Context for Vocabulary-Free Mobile App Prediction
Author: Chengyu Fan, Hang Liu
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29863v1 Announce Type: new Abstract: Predicting the next mobile application a user will launch is essential for intelligent device resource management and proactive assistance. Existing models rely on fixed app vocabularies, which prevents them from generalizing across different app ecosy...
121. Open Problem: Separating Geometric and Algorithmic Compression via Cayley-Table Completion
Author: Dongsung Huh
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cond-mat.dis-nn, math.OC, math.RT, stat.ML
arXiv:2605.29885v1 Announce Type: new Abstract: Modern statistical learning theory and deep learning characterize generalization primarily in terms of continuous capacity control (e.g., norm-based regularization, margin maximization, low-rank bias). While highly successful in continuous domains, dee...
122. LaRA: Layer-wise Representation Analysis for Detecting Data Contamination in RL Post-Training
Author: Minju Gwak, Minseo Kwak, Dongseok Lee, Guijin Son, Alan Ritter, Jaehyung Kim
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.29888v1 Announce Type: new Abstract: Reinforcement learning (RL) post-training has shown to improve reasoning in large language models (LLMs). However, there has been little exploration on the problem of data contamination in RL post-training, potentially undermining generalization and ev...
123. OVA-IB: One vs All Information Bottleneck for Multi-Modal Alignment
Author: Tianchao Li, Shujian Yu, Xinrui Zu, Zhaolong Wei, Jeremy Gummeson, Jack C. P. Cheng, Robert Jenssen
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.IT, math.IT
arXiv:2605.29900v1 Announce Type: new Abstract: Contrastive learning is effective for aligning paired views or modalities, but alignment beyond two modalities remains non-trivial and comparatively underexplored. Pairwise CLIP-style losses decompose multi-modal alignment into independent two-way comp...
124. Plan, Don't Pose: Long Composite Motion Generation with Text-Aligned BFM
Author: Nikolay Shvetsov, Maksim Bobrin, Nazar Buzun, Dmitry V. Dylov
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29906v1 Announce Type: new Abstract: Text-to-motion (T2M) generation has broad applications in character animation, virtual avatars, and human-robot interaction. Existing methods typically generate pose trajectories or motion tokens directly from language, forcing a single model to handle...
125. Reducing Experimental Testing in Space Propulsion Film Cooling Analyses by Pixelwise Generative Image Interpolation
Author: Adam T. M"uller, Philipp J. Teuffel, Konstantin Manassis, Nicolaj C. Stache
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.CV
arXiv:2605.29911v1 Announce Type: new Abstract: We propose a machine learning approach for image regression from sparse experimental measurements. We show the application of the proposed method on film cooling studies in propulsion system development, aiming to reduce the need for extensive physical...
126. Midpoint Generative Models
Author: Daniil Shlenskii, Nikita Gushchin, Lev Novitskiy, Dmitry V. Dylov, Alexander Korotin
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29920v1 Announce Type: new Abstract: We introduce Midpoint Generative Models (MGM), a principled framework for training one-step generative models. MGM is based on a simple symmetry of Flow Matching with linear interpolation: when the two endpoint distributions coincide, the corresponding...
127. A Triple-Modal Contrastive Learning Framework with Sequence, Graph, and 3D Features for Drug-Target Interaction Prediction
Author: Le Xu, Xi Zhang, Dan Luo, Ting Wang, Xuan Lin
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29926v1 Announce Type: new Abstract: Accurate prediction of drug-target interactions (DTI) is critical for drug discovery. Existing methods often rely on single-modal representations (e.g., sequences or graphs) or combine only two modalities, overlooking 3D structural features. To address...
128. Treatment-Conditioned Diffusion for Forecasting Neurodegenerative Disease Progression
Author: Danylo Boiko, Viktoriia Mishkurova
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.CV
arXiv:2605.29932v1 Announce Type: new Abstract: Forecasting the progression of neurodegenerative diseases, such as Parkinson's disease, is essential for effective long-term planning and personalized therapeutic intervention. Existing systems typically produce scalar clinical scores that ignore the r...
129. CLUBench: A Clustering Benchmark
Author: Feng Xiao, Dazhi Fu, Chris Ding, Jicong Fan
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29933v1 Announce Type: new Abstract: Clustering is a fundamental problem in data science with a long-standing research history, yielding numerous insightful algorithms. Despite this progress, a systematic and large-scale empirical evaluation that jointly considers conventional algorithms,...
130. From Short Histories to Long Futures: Horizon-Aware Graph Neural Networks for Long Horizon Forecasting
Author: Zesheng Liu, Maryam Rahnemoonfar
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29952v1 Announce Type: new Abstract: Accurate long-range prediction of geophysical systems is difficult due to strongly nonlinear dynamics, the high computational cost of full-physics simulations, and the error accumulation that arise when one-step autoregressive surrogates are rolled out...
131. A Fully Convolutional Approach to Denoising Structural Dynamics Data from X-Ray Photon Correlation Spectroscopy
Author: Nisar Nellikunnummel, Andi Barbour, Lutz Wiegart, Tatiana Konstantinova, Anthony DeGennaro
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, eess.SP
arXiv:2605.29975v1 Announce Type: new Abstract: We present a fully convolutional denoising autoencoder (FC-DAE) for denoising two-time intensity-intensity correlation functions ($C_2$) in X-ray photon correlation spectroscopy (XPCS). Unlike conventional denoising autoencoders that are typically rest...
132. Improving Adversarial Robustness of Attribution via Implicit Regularization
Author: Amir Mehrpanah, Matteo Gamba, Hossein Azizpour
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.CV
arXiv:2605.29983v1 Announce Type: new Abstract: The adversarial robustness of attributions is a fundamental requirement for reliable explainability in deep learning, yet existing approaches typically rely on computationally expensive explicit regularization. In this work, we show that attribution ro...
133. MIC: Maximizing Informational Capacity in Adaptive Representations via Isotropic Subspace Alignment
Author: Dang Hong Nguyen, Nhi Ngoc-Yen Nguyen, Huy-Hieu Pham
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.CL
arXiv:2605.29987v1 Announce Type: new Abstract: Although multi-scales representation learning enables elastic-dimension embeddings, nested subspaces often suffer from dimensional redundancy and spectral collapse. To address this, we introduce MIC, a framework that optimizes the geometric landscape o...
134. Test Time Training for Supervised Causal Learning
Author: Zizhen Deng, Jiaru Zhang, Rui Ding, Huang Bojun, Jinzhuo Wang, Qiang Fu, Shi Han, Dongmei Zhang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.30015v1 Announce Type: new Abstract: Supervised Causal Learning (SCL) has shown promise in causal discovery by framing it as a supervised learning problem. However, it suffers from significant out-of-distribution generalization challenges. We reveal three limitations of previous SCL pract...
135. Alignment-Guided Score Matching for Text-to-Image Alignment in Diffusion Models
Author: Jaa-Yeon Lee, Yeobin Hong, Taesung Kwon, Jong Chul Ye
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CV
arXiv:2605.30038v1 Announce Type: new Abstract: Diffusion models generate highly realistic images but often struggle with precise text-image alignment. While recent post-training methods improve alignment using external rewards or human preference signals, their performance heavily depends on reward...
136. Masked Diffusion Modeling for Anomaly Detection
Author: Lixing Zhang, Yuchen Liang, Liyan Xie
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.30046v1 Announce Type: new Abstract: Anomaly detection aims to identify samples that deviate from the nominal data distribution and is central to many safety-critical applications. However, developing effective anomaly detection methods for categorical, mixed-type, and discrete sequence d...
137. Ridge Regression from Poisson Resetting: A Renewal Perspective on Spectral Regularization
Author: Petar Jolakoski
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cond-mat.stat-mech, stat.ML
arXiv:2605.30059v1 Announce Type: new Abstract: We connect stochastic resetting from non-equilibrium statistical physics with ridge regularization in statistical learning. For linear gradient flow, resetting to the origin at rate $r$ produces stationary mean $(X^\top X+rI)^{-1}X^\top y$, exactly the...
138. A Predictive Law for On-Policy Self-Distillation From World Feedback
Author: Tommy He, Jerome Sieber, Matteo Saponati
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.30070v1 Announce Type: new Abstract: Moving beyond simple scalar rewards toward richer world feedback is a natural path to more scalable RL post-training. On-policy self-distillation (OPSD) is a promising recent approach that uses arbitrary feedback as learning signal, yet its reliability...
139. Q-ANCHOR: Federated Quantum Learning with ZNE-guided Correction
Author: Hoang M. Ngo, Quan Nguyen, Wanli Xing, My T. Thai
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.DC
arXiv:2605.30075v1 Announce Type: new Abstract: Quantum Federated Learning (QFL) offers a promising framework to train quantum models across distributed clients while keeping data strictly local. Due to its simplicity and low communication overhead, Federated Averaging (FedAvg) is the standard aggre...
140. Distributionally Robust Set Representation Learning Under Inference-Time Element Corruption
Author: Yankai Chen (Steve), Hanrong Zhang (Steve), Bowei He (Steve), Philip S. Yu (Steve), Xue (Steve), Liu
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30089v1 Announce Type: new Abstract: Standard Set Representation Learning methods typically excel on curated data but often overlook the challenge of inference-time element corruption. This refers to scenarios where deployed models encounter element-level degradations, such as outliers or...
141. Chess-World-Model: A 10M-Game Benchmark for Exact State Tracking from Chess Move Sequences
Author: Benjamin Walker, Terry Lyons
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30100v1 Announce Type: new Abstract: World models require state tracking, which is the ability to maintain a correct latent state across action sequences. Existing benchmarks are often synthetic or language-based, limiting their value as tests of structured state updates in realistic doma...
142. Convergence Theory for Iterative LLM-Based Neural Architecture Search: A Parametric Cross-Entropy Framework with Closed-Form Proxy Reliability
Author: Santosh Premi Adhikari, Radu Timofte, Dmitry Ignatov
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30103v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used as generators in iterative neural architecture search (NAS), yet no formal convergence theory exists for this class of algorithms. We model iterative LLM-NAS as a parametric Cross-Entropy (CE) method o...
143. Striding Across Reynolds Numbers: Representation Geometry in Neural PDE Generalisation
Author: Jianing Shi
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30112v1 Announce Type: new Abstract: Cross-Reynolds generalisation in neural PDE solvers remains poorly characterised. On the canonical forced 2D Navier-Stokes benchmark, a trained Fourier Neural Operator reaches 46.68% relative L2 error under a 10x Reynolds-number shift, yet zero-forward...
144. Evolving Features vs Evolving Entire Trees with GP for Interpretable Survival Analysis
Author: Thalea Schlender, Peter A. N. Bosman, Tanja Alderliesten
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.NE
arXiv:2605.30119v1 Announce Type: new Abstract: Survival analysis concerns the task of predicting the time until an event occurs. Often used in the medical field, survival analysis deals with incomplete (i.e., censored) data, for instance, from patients who did not experience the event during the du...
145. Beyond MSE: Improving Precipitation Nowcasting with Multi-Quantile Regression
Author: Gijs van Nieuwkoop, Siamak Mehrkanoon
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.30122v1 Announce Type: new Abstract: Deep-learning precipitation nowcasting models are often optimized using pointwise losses such as mean squared error or mean absolute error, which can lead to overly smooth forecasts and poor representation of heavy rainfall. This study investigates whe...
146. Learning to Extrapolate to New Tasks: A Relational Approach to Task Extrapolation
Author: Adam Ousherovitch, Yixin Wang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2605.30132v1 Announce Type: new Abstract: Modern learning systems excel at interpolation but struggle to generalize to unseen tasks outside the training distribution's support. This failure occurs even in simple settings, such as handling task parameters beyond the training range, and persists...
147. DAMEL: Dual-Axis Multi-Expert Learning for Class-Imbalanced Learning
Author: Hyuck Lee, Taemin Park, Heeyoung Kim
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.30135v1 Announce Type: new Abstract: Various algorithms have been proposed to address the challenges posed by class-imbalanced learning from real-world data with long-tailed distributions. While these algorithms reduce prediction bias through rebalancing techniques, they often introduce i...
148. Overcoming Forgetting in LLM Fine-Tuning with Evolution Strategies
Author: Kajetan Schweighofer, Conor F. Hayes, Roberto Dailey, Risto Miikkulainen, Xin Qiu
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.30148v1 Announce Type: new Abstract: Evolution Strategies (ES) has recently emerged as a competitive alternative to reinforcement learning (RL) for large language model (LLM) fine-tuning, offering advantages through simplicity, scalability, and inference-only training. However, recent wor...
149. RL2ML: Finite-Rollout Surrogate Objectives from Reinforcement Learning to Maximum Likelihood
Author: Yifu Zheng
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30154v1 Announce Type: new Abstract: Correctness-based Reinforcement Learning with Verifiable Rewards (RLVR) trains language models from binary feedback on sampled outputs, but the objective optimized in expectation and the stochastic update geometry induced by finite rollout groups are o...
150. On Distributional Reinforcement Learning in Chaotic Dynamical Systems
Author: James Rudd-Jones, Mirco Musolesi, Mar'ia P'erez-Ortiz
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.30160v1 Announce Type: new Abstract: Chaotic dynamical systems pose a fundamental challenge for Reinforcement Learning (RL): exponential sensitivity to initial conditions induces high-variance bootstrap targets and poorly conditioned gradient updates. Chaotic dynamics arise across scienti...
151. iLoRA: Bayesian Low-Rank Adaptation with Latent Interaction Graphs for Microbiome Diagnosis
Author: Yang Song, Yixuan Zhang, Lingfa Meng, Tongyuan Hu, Haizhou Shi, Hao Wang, Samir Bhatt, Hengguan Huang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.30179v1 Announce Type: new Abstract: Parameter-efficient adaptation has made LLMs practical for domain prediction, but standard LoRA still relies on a static low-rank update and does not expose the latent interactions that often drive scientific labels. We introduce iLoRA. To our knowledg...
152. Can AI Weather Models Predict Beyond Two Weeks? A Quantitative Benchmark and Analysis of Long Rollouts
Author: Fanny Lehmann, Firat Ozdemir, Yun Cheng, Torsten Hoefler, Sebastian Schemm, Benedikt Soja, Siddhartha Mishra
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, physics.ao-ph
arXiv:2605.30184v1 Announce Type: new Abstract: While AI weather models excel at short-to-medium range forecasts (up to 15 days), they frequently suffer from ill-defined "instabilities" when rolled out over longer horizons. This work addresses the lack of a formal taxonomy by categorizing these fail...
153. CalArena: A Large-Scale Post-Hoc Calibration Benchmark
Author: Eug`ene Berta, David Holzm"uller, Francis Bach, Michael I. Jordan
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, stat.ML
arXiv:2605.30188v1 Announce Type: new Abstract: Reliable probability estimates are critical in many machine learning applications, yet modern classifiers are often poorly calibrated. Post-hoc calibration provides a simple and widely used solution, but the large number of proposed methods, combined w...
154. Mean-Field Diffuser: Scaling Offline MARL to Thousands of Agents
Author: Wenhao Li, Xiangfeng Wang, Bo Jin
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30190v1 Announce Type: new Abstract: Diffusion-based planning has achieved strong results in single-agent offline reinforcement learning, yet scaling to many-agent systems remains intractable due to the curse of dimensionality in the joint trajectory space. We introduce MF-Diffuser, a fra...
155. Active Continual Learning with Metaplastic Binary Bayesian Neural Networks
Author: Kellian Cottart, Th'eo Ballet, Djohan Bonnet, Damien Querlioz
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30198v1 Announce Type: new Abstract: Always-on edge systems must keep learning as conditions change under tight compute budgets and must detect unreliable predictions. Bayesian binary neural networks are attractive in this setting, but mean-field Bernoulli posteriors can saturate on long ...
156. HPO: Hysteretic Policy Optimization for Stable and Efficient Training under Sparse-Reward Regime
Author: Mohamed Sana, Nicola Piovesan, Antonio De Domenico, Fadhel Ayed, Haozhe Zhang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.30201v1 Announce Type: new Abstract: We investigate a narrow but common failure mode of GRPO-style reinforcement learning in the context of sparse verifiable rewards: early updates contain more responses with negative advantages than those with positive advantages, while response-level le...
157. Faithful Embeddings of Irregular and Asynchronous Data for Online Log-NCDEs
Author: Benjamin Walker, Alexandre Bloch, Lingyi Yang, Sam Morley, Terry Lyons
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30213v1 Announce Type: new Abstract: Continuous-time models are a natural choice for irregular and asynchronous data. A central design choice is how to embed discrete observations into continuous time. Interpolation- and imputation-based embeddings reconstruct a continuous observation pat...
158. MarginGate: Sparse Margin-Triggered Verification for Batch-Invariant LLM Inference
Author: Kexin Chu, Yang Zhou, Wei Zhang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.PF
arXiv:2605.30218v1 Announce Type: new Abstract: Temperature-zero BF16 LLM inference is often treated as reproducible, yet the same request can emit different tokens when decoded alone or inside a larger batch. Existing fixes use batch-invariant operators or LLM-42's per-token verification, incurring...
159. TriSearch: Learning to Optimize Triangulations via Bistellar Flips
Author: Yiran Wang, Guido Mont'ufar
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30220v1 Announce Type: new Abstract: We introduce TriSearch, a reinforcement learning framework for optimizing objectives over triangulations of a polytope via bistellar flips. The key idea is a circuit-supported subtriangulation action representation: feasible flips are encoded by their ...
160. ExDBSCAN: Explaining DBSCAN with Counterfactual Reasoning -- Additional Material
Author: Pernille Matthews, Lena Krieger, Tommaso Amico, Artur Zimek, Thomas Seidl, Ira Assent
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30225v1 Announce Type: new Abstract: Clustering is an unsupervised technique for grouping data points by similarity. While explainability methods exist for supervised machine learning, they are not directly applicable to clustering, making it challenging to understand cluster assignments....
161. Anti Mode-Collapse in Mean-Field Transformer via Auxiliary Variables
Author: Masaaki Imaizumi, Masanori Koyama, Noboru Isobe, Kohei Hayashi
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30229v1 Announce Type: new Abstract: We use a mean-field-based transformer model to theoretically investigate how auxiliary variables, such as positional encoding, prevent mode collapse of self-attention mechanisms. The use of mean-field transformers to analyze the properties of self-atte...
162. How's it going? Reinforcement learning in language models recruits a functional welfare axis
Author: Andy Q Han, David J. Chalmers, Pavel Izmailov
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.CL
arXiv:2605.30232v1 Announce Type: new Abstract: How does reinforcement learning shape a language model's internal representations? We present evidence that RL recruits a pre-existing representation of functional welfare: an estimate of how well or badly the system is doing, relative to its goals. We...
163. OOD-GraphLLM: Graph Large Language Model for Out-of-Distribution Generalized Drug Synergy Prediction
Author: Xin Wang, Linxin Xiao, Yang Yao, Wenwu Zhu
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.MM
arXiv:2605.30247v1 Announce Type: new Abstract: Drug synergy prediction (DSP) aims to identify efficacious drug combinations under various cellular contexts with different targets. However, the continual emergence of novel compounds results in variations in molecular scaffolds and sizes, causing dru...
164. Digitally enriching a screening population for pancreatic cancer using routine blood-based measures and clinical histories
Author: Chris Varghese, Leo Y. Li-Han, Richa Bisht, Ellen Larson, Frank Lee, Ryan M. Carr, Tanios S. Bekaii-Saab, Shounak Majumder, John D. Halamka, Mark Truty, Ajit H. Goenka, Hojjat Salehinejad, Cornelius A. Thiels
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, q-bio.QM
arXiv:2605.30275v1 Announce Type: new Abstract: Earlier detection of pancreatic cancer is key to enabling wider access to curative treatment and reducing cancer deaths; however, screening is presently not viable. Latent indicators of pathology are evident in an individual's disease and blood test tr...
165. Neural Operator-Based Surrogate Model for CFD:Helical Coil Steam Generator in Small Modular Reactor
Author: Minseo Lee, Seongmin Oh, Chaehyeon Song, Bumjin Cho, Shilaj Baral, Sangam Khanal, Minseop Song, Joongoo Jeon
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, physics.flu-dyn
arXiv:2605.30277v1 Announce Type: new Abstract: Real-time thermal-hydraulic simulation is essential for digital twin (DT) technology that supports the safe and efficient operation of small modular reactors (SMRs). Computational fluid dynamics (CFD) provides high-fidelity flow analysis, but its compu...
166. Statistical Embeddings for Similarity, Retrieval, and Interpretable Alignment of Numeric Tabular Datasets
Author: M. Ross Kunz, John Merickel, Keith Wilson
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, stat.AP, stat.ML
arXiv:2605.30289v1 Announce Type: new Abstract: Numeric tabular datasets are the dominant data format in scientific practice, yet large language models lack native mechanisms for representing numeric datasets in a meaningful way across heterogeneous feature spaces. Existing approaches either target ...
167. Self-Trained Verification for Training- and Test-Time Self-Improvement
Author: Chen Henry Wu, Aditi Raghunathan
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL
arXiv:2605.30290v1 Announce Type: new Abstract: Self-improvement at scale has been a longstanding goal for reasoning models, and there are two natural places to do it: at test time, through verification-refinement (V-R) loops; and at training time, through self-training methods. Both are gated by th...
168. Gram: Assessing sabotage propensities via automated alignment auditing
Author: David Lindner, Victoria Krakovna, Sebastian Farquhar
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.30322v1 Announce Type: new Abstract: We introduce Gram, an automated alignment auditing framework to assess the propensity of AI agents to engage in sabotage. We evaluate Gemini models across 17 simulated agentic deployment scenarios that incentivize sabotage. We find Gemini models misbeh...
169. In-Context Reward Adaptation for Robust Preference Modeling
Author: Zhenyu Sun, Zheng Xu, Ermin Wei
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.30323v1 Announce Type: new Abstract: Reinforcement Learning from Human Feedback (RLHF) typically relies on static reward models to align Large Language Models with human preferences. However, human values are inherently diverse and heterogeneous, and a single reward model often lacks the ...
170. Reasoning with Sampling: Cutting at Decision Points
Author: Felix Zhou, Anay Mehrotra, Quanquan C. Liu
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL, math.ST, stat.ML, stat.TH
arXiv:2605.30327v1 Announce Type: new Abstract: Frontier reasoning models are produced by posttraining base language models with reinforcement learning. Recent work has challenged this by showing that sampling from a sharpened version of the base model's distribution, a so-called power distribution,...
171. SoundnessBench: Can Your AI Scientist Really Tell Good Research Ideas from Bad Ones?
Author: Sy-Tuyen Ho, Minghui Liu, Huy Nghiem, Furong Huang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30329v1 Announce Type: new Abstract: Autonomous AI research agents aim to accelerate scientific discovery by automating the research pipeline, from hypothesis generation to peer review. However, existing benchmarks rarely test a fundamental bottleneck: whether Large Language Models can ju...
172. When, why, and how do diffusion posterior samplers fail? A finite-sample lens
Author: Benjamin A. Burns, Sara Fridovich-Keil
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30330v1 Announce Type: new Abstract: Diffusion models have excellent capacity to model complex distributions of natural data, which has made them a popular and effective choice for posterior sampling in imaging inverse problems. Existing methods can incorporate any measurement model at in...
173. Fairness-Aware Federated Learning with Trajectory Shapley Value
Author: Daniel Kuznetsov, Ziqi Wang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30336v1 Announce Type: new Abstract: Federated learning is an emerging distributed paradigm that addresses the challenges posed by heterogeneous, privacy-sensitive data. It enables multiple clients to train a model collaboratively by aggregating their local updates at a server. However, c...
174. Efficient Test-Time Finetuning of LLMs via Convex Reconstruction and Gradient Caching
Author: Alaa Khamis, Alaa Maalouf
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30337v1 Announce Type: new Abstract: Test-time finetuning (TTFT) is a rapidly evolving paradigm that adapts a language model to each prompt by retrieving related sequences, updating the model on them, and then evaluating the prompt. However, TTFT is only practical if it is fast: selection...
175. Adapting Automotive Aerodynamics Surrogates to New Vehicle Families via Transfer Learning
Author: Seunghwan Keum, Alok Warey
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CE, cs.LG, physics.comp-ph
arXiv:2605.27968v1 Announce Type: cross Abstract: Deploying Scientific Machine Learning surrogates in industrial CFD workflows requires adapting pretrained models to new vehicle families without large datasets; yet whether geometric representations learned by a geometry encoder transfer to topologic...
176. RightNow-Arabic-0.5B-Turbo: An Open Sub-1B Arabic Language Model via Vocabulary Injection and Edge-First Deployment
Author: Jaber Jaber, Osama Jaber
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CL, cs.LG
arXiv:2605.28827v1 Announce Type: cross Abstract: Open Arabic large language models split into two classes: sub-1B multilingual models that treat Arabic as an afterthought (Qwen2.5-0.5B, Falcon-H1-0.5B), and 7B-70B Arabic-specialized models that require a server to run (Jais, AceGPT, ALLaM, SILMA). ...
177. The Biosecurity Blind Spot: Systematic Dual-use Detection in Open Science Infrastructure
Author: Vasudha Sharma, Chakresh Kumar Singh, Jayesh Choudhari, Dharmit Nakrani
Published: 5/29/2026, 4:00:00 AM
Categories: cs.DL, cs.CY, cs.LG
arXiv:2605.28843v1 Announce Type: cross Abstract: AI is transforming life sciences research at unprecedented speed, accelerating discovery across protein structure prediction, genome modeling, and drug development (Jumper et al., 2021; Mak et al., 2024). Yet this rapid advancement, coupled with the ...
178. WASHH: An Anchor-Aware Whale-Guided Selection Hyper-Heuristic for Continuous Optimization and SVC Configuration
Author: Yifu Zhao, Xiaofan Zou, Junhao Wei, Yanxiao Li, Baili Lu, Zhenhong Peng, Dexing Yao, Haochen Li, Qinbin He, Sio-Kei Im, Xu Yang, Yapeng Wang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.NE, cs.LG
arXiv:2605.28844v1 Announce Type: cross Abstract: Learning-assisted algorithm design often has to make reliable search decisions under small evaluation budgets, where committing to a single metaheuristic can be unreliable. We propose WASHH, a Whale-guided Adaptive Selection Hyper-Heuristic for conti...
179. Towards a Foundation Model for the Martian Atmosphere
Author: Sujit Roy, Udayshankar Nair, Yuling Wu, Georgios Priftis, Liping Wang, Anastasia Georgiou, Anne Jones, Bj"orn L"utjens, Johannes Schmude, Campbell Watson, Rachel A. Slank, Ankur Kumar, Anirbit Mukherjee, Procheta Sen, Ramin Lolachi, Haonan Chen, Manil Maskey, Juan Bernab'e-Moreno, Rahul Ramachandran
Published: 5/29/2026, 4:00:00 AM
Categories: astro-ph.EP, astro-ph.IM, cs.LG, physics.ao-ph
arXiv:2605.28851v1 Announce Type: cross Abstract: The martian atmosphere hosts dynamical phenomena ranging from planet-encircling dust storms to mesoscale orographic clouds and nocturnal low-level jets. General circulation model show capability to simulate these phenomena, but is computationally exp...
180. Financially Guided Deep Portfolio Optimization
Author: Rahul Fernandes, Travis Desell
Published: 5/29/2026, 4:00:00 AM
Categories: q-fin.PM, cs.LG
arXiv:2605.28853v1 Announce Type: cross Abstract: Portfolio optimization in real-world financial markets is notoriously difficult due to non-stationarity, noisy data, and high transaction costs. Standard predict-then-optimize methods first forecast returns and then solve for weights, compounding pre...
181. Large language models reorganize representational geometry during in-context learning
Author: Hua-Dong Xiong, Li Ji-An, Robert C. Wilson, Kwonjoon Lee, Xue-Xin Wei
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CL, cs.LG, q-bio.NC
arXiv:2605.28854v1 Announce Type: cross Abstract: Large language models (LLMs) exhibit remarkable flexibility: they can adapt to novel tasks from in-context examples without any parameter updates, a capability known as in-context learning (ICL). Prior work on synthetic tasks has shown that ICL can i...
182. An End-to-End PyTorch Interface for Differentiable PDE Solvers: A RANS Model-Correction Study
Author: Luca Saverio (MONHADE), Michele Alessandro Bucci (MONHADE), Gianmarco Farro (MONHADE), C'edric Content (MONHADE), Denis Sipp (MONHADE)
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CE, cs.LG, math-ph, math.MP
arXiv:2605.28858v1 Announce Type: cross Abstract: This work presents an end-to-end strategy for solving inverse problems constrained by Partial Differential Equations within a fully differentiable Machine Learning framework. The proposed formulation provides a unified and user-friendly methodology a...
183. Comment on "Spin-1/2 Kagome Heisenberg Antiferromagnet: Machine Learning Discovery of the Spinon Pair-Density-Wave Ground State"
Author: Helia Kamal, Dominik Kufel, DinhDuy Vu, Chris R. Laumann, Norman Y. Yao
Published: 5/29/2026, 4:00:00 AM
Categories: cond-mat.str-el, cond-mat.dis-nn, cs.LG
arXiv:2605.28861v1 Announce Type: cross Abstract: A recent article [Phys. Rev. X 15, 011047 (2025)] utilizes group-equivariant convolutional neural networks to study the ground state of the kagome Heisenberg antiferromagnet. On the largest finite-size cluster studied to date ($N=108$), the authors r...
184. Computational Modeling of Antibody-Antigen Complexes: PLM-Based and MSA-Based Approaches
Author: Xiao Luo
Published: 5/29/2026, 4:00:00 AM
Categories: q-bio.QM, cs.LG
arXiv:2605.28886v1 Announce Type: cross Abstract: Antibodies play a central role in the immune response by specifically recognizing and neutralizing antigens, and therapeutic antibodies have become major drugs for cancer and autoimmune diseases. However, their discovery still relies on extensive in ...
185. Generative Spatiotemporal Intent Sequence Recommendation via Implicit Reasoning in Amap
Author: Sicong Wang, Ruiting Dong, Yue Liu, Bowen Zheng, Jun Meng, Jie Li, Shuaijun Guo, Yu Gu, Fanyi Di, Xin Li
Published: 5/29/2026, 4:00:00 AM
Categories: cs.IR, cs.LG
arXiv:2605.28888v1 Announce Type: cross Abstract: Real-world user behavior rarely consists of isolated actions; instead, it often forms intent flows governed by spatiotemporal dependencies. To provide integrated service recommendations, we focus on the task of Generative Spatiotemporal Intent Sequen...
186. Echoes within the Reasoning: Stealthy and Effective Watermarking via Chain of Thought
Author: Jiacheng Lu, Yiming Li, Tao Song, Weijian Wang, Wenjie Qu, Haibing Guan, Jiaheng Zhang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CR, cs.LG
arXiv:2605.28890v1 Announce Type: cross Abstract: Large Language Models with Chain-of-Thought reasoning capabilities represent valuable intellectual property, yet existing black-box watermarking methods often trade robustness for reasoning fidelity by perturbing final answers or relying on fragile t...
187. Neural Scaling Laws for Jet Generation
Author: Oz Amram, Darius A. Faroughy, Tjarko Gerdes, Anna Hallin, Gregor Kasieczka, Michael Kr"amer, Humberto Reyes-Gonzalez, David Shih
Published: 5/29/2026, 4:00:00 AM
Categories: hep-ph, cs.LG, hep-ex, physics.data-an
arXiv:2605.28940v1 Announce Type: cross Abstract: Recently observed empirical scaling laws describe the performance of foundation-type models as three independent key quantities -- dataset size, compute, and model parameters -- are modified. Extracting these scaling laws informs the training of larg...
188. Optimal Rates for Differentially Private Hypothesis Testing with E-values
Author: Ben Jacobsen, Tomas Gonzales, Gavin Brown, Kassem Fawaz, Aaditya Ramdas
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CR, cs.DS, cs.IT, cs.LG, math.IT
arXiv:2605.28952v1 Announce Type: cross Abstract: E-values have attracted considerable interest in recent years as flexible tools for enabling anytime-valid and adaptive data analysis. Hypothesis testing is at the core of many of these applications, which can often involve private or sensitive data....
189. Dynamics of Stochastic Momentum with Sparse Updates in High Dimensions
Author: Katie Everett, Elliot Paquette
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.LG, math.OC
arXiv:2605.28961v1 Announce Type: cross Abstract: Existing theory of momentum assumes that gradients arrive at every parameter at a roughly constant rate, an assumption violated in practice by heavy-tailed data distributions and modern architectures. We theoretically analyze the dynamics of two trac...
190. Manifold-based Algorithms for the Hadamard Decomposition
Author: Nicolas Gillis, Subhayan Saha, Stefano Sicilia, Arnaud Vandaele
Published: 5/29/2026, 4:00:00 AM
Categories: math.OC, cs.LG, cs.NA, eess.SP, math.NA
arXiv:2605.28980v1 Announce Type: cross Abstract: Given a matrix $X$, and two ranks $r_1$ and $r_2$, the Hadamard decomposition (HD) looks for two low-rank matrices, $X_1$ of rank $r_1$ and $X_2$ of rank $r_2$, both of the same size as $X$, such that $X\approx X_1\circ X_2$, where $\circ$ is the Had...
191. Measuring Real-World Prompt Injection Attacks in LLM-based Resume Screening
Author: Mohan Zhang, Yuqi Jia, Zhen Tan, Steven Jiang, Neil Zhenqiang Gong, Tianlong Chen, Dawn Song
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CR, cs.AI, cs.CL, cs.LG
arXiv:2605.28999v1 Announce Type: cross Abstract: LLMs are vulnerable to prompt injection attacks. However, this vulnerability has been primarily demonstrated conceptually in academic studies or through a few anecdotal case studies. Its prevalence and impact in real-world LLM-based applications are ...
192. Three-dimensional Conditional Diffusion Models for Cosmological 21 cm Lightcone Emulation
Author: Bin Xia, John H. Wise
Published: 5/29/2026, 4:00:00 AM
Categories: astro-ph.IM, astro-ph.CO, cs.LG
arXiv:2605.29016v1 Announce Type: cross Abstract: We investigate conditional diffusion modeling for three-dimensional 21 cm lightcone emulation, focusing on cubes with a sky-plane size of $64\times64$ and a line-of-sight depth up to 1024 cells. Relative to earlier 2D studies, the 3D setting is subst...
193. Differentiable Belief-based Opponent Shaping
Author: Aarav G Sane, Karthik Sivachandran, Rohan Paleja
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.LG
arXiv:2605.29042v1 Announce Type: cross Abstract: Human coordination often relies on the ability to influence the beliefs of others through strategic action. In multi-agent reinforcement learning, opponent shaping attempts to replicate this influence, though existing methods typically operate within...
194. Robust and Efficient Guardrails with Latent Reasoning
Author: Siddharth Sai, Xiaofei Wen, Muhao Chen
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.CL, cs.CR, cs.LG
arXiv:2605.29068v1 Announce Type: cross Abstract: Maintaining the safety of large language models (LLMs) is crucial as they are increasingly deployed in real-world applications. Existing safety guardrails typically rely on single-pass classification or, more recently, distilled reasoning. Reasoning-...
195. Structured Prompt Optimization Meets Reinforcement Learning for Global and Local Interpretability over Complex Text
Author: Tianyang Zhou, Wenbo Chen, Pierre Jinghong Liang, Leman Akoglu
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG
arXiv:2605.29076v1 Announce Type: cross Abstract: LLMs have advanced text classification, yet existing paradigms face a trade-off: supervised (label only) fine-tuning is scalable but offers limited reasoning on complex text and lacks broader model transparency, while discrete prompt optimization off...
196. Bridging the Sim-to-Real Gap in Reinforcement Learning-Based Industrial Dispatching through Execution Semantics
Author: Jonathan Hoss, Noah Klarmann
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.LG
arXiv:2605.29078v1 Announce Type: cross Abstract: Event-driven scheduling policies are increasingly deployed in industrial environments, where decisions are made under asynchronous and partially observed system states. As a result, decision states are not temporally consistent, action admissibility ...
197. Lightweight Complementary-Cue Fusion for Robust Video Face Forgery Detection
Author: Sunghwan Baek, Tariq Anwaar, Karanveer Singh, Rita Singh
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CV, cs.LG, cs.MM
arXiv:2605.29092v1 Announce Type: cross Abstract: Current face video forgery detectors use wide or dual-stream backbones. We show that a single, lightweight fusion of two handcrafted cues can achieve higher accuracy with a much smaller model. Based on the Xception baseline model (21.9 million parame...
198. ReasonBreak: Probing Vulnerabilities in Reasoning-Enabled Vision-Language-Action Models for Autonomous Driving
Author: Mohammadreza Teymoorianfard, Jean-Philippe Monteuuis, Jonathan Petit, Amir Houmansadr
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CR, cs.LG, cs.RO
arXiv:2605.29114v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models with integrated reasoning have been proposed for end-to-end autonomous driving, assuming a tight coupling between reasoning and trajectory generation. However, the robustness of such systems under realistic input p...
199. A Minimal Bifurcation Model of Load Imbalance in a Softmax Mixture-of-Experts Router
Author: O. M. Kiselev (Innopolis University, Innopolis, Russia)
Published: 5/29/2026, 4:00:00 AM
Categories: math.DS, cs.AI, cs.LG
arXiv:2605.29121v1 Announce Type: cross Abstract: We propose a minimal dynamical model of adaptive softmax routing for a two-expert Mixture-of-Experts (MoE) layer. The model is obtained as a mean-field limit of a discrete reinforcement rule: the selected expert receives a small score increment, whil...
200. Eulerian Gaussian Splatting using Hashed Probability Pyramids
Author: Mia Gaia Polansky, George Kopanas, Stephan Garbin, Todd Zickler, Dor Verbin
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2605.29136v1 Announce Type: cross Abstract: We introduce a probabilistic splat-based radiance field framework that retains the fast rasterization and test-time efficiency of 3D Gaussian Splatting (3DGS) while replacing heuristic primitive manipulation with gradient-based optimization of a volu...
201. Multi-Resolution End-to-End Deep Neural Network for Optimizing Latency-Accuracy Tradeoff in Autonomous Driving
Author: Qitao Weng, Heechul Yun
Published: 5/29/2026, 4:00:00 AM
Categories: cs.RO, cs.AI, cs.LG, cs.SY, eess.SY
arXiv:2605.29138v1 Announce Type: cross Abstract: Latency-accuracy tradeoffs are fundamental in real-time applications of deep neural networks (DNNs) for cyber-physical systems. In autonomous driving, in particular, safety depends on both prediction quality and the end-to-end delay from sensing to a...
202. Anytime-Valid Federated Conformal RAG for LLM Swarms
Author: Prasanjit Dubey, Xiaoming Huo
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:2605.29139v1 Announce Type: cross Abstract: Federated Conformal RAG (FC-RAG) provides distribution-free coverage for a bandwidth-limited swarm of weak language models, but only at a fixed horizon. We extend it to anytime-valid sequential coverage: validity at every stopping time, preserved und...
203. Better Later Than Sooner: Neuro-Symbolic Knowledge Graph Construction via Ontology-grounded Post-extraction Correction
Author: Lorenzo Loconte, Timothy Hospedales, Cristina Cornelio
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.LG
arXiv:2605.29168v1 Announce Type: cross Abstract: Question answering (QA) is a core challenge in AI, particularly for complex queries requiring multi-hop reasoning across documents, or symbolic operations like aggregation or exhaustive listing. Retrieval-augmented generation has become the dominant ...
204. libhmm: A Modern C++20 Library for Hidden Markov Models with Correct MLE Emission M-Steps
Author: Gary Wolfman
Published: 5/29/2026, 4:00:00 AM
Categories: cs.MS, cs.LG
arXiv:2605.29208v1 Announce Type: cross Abstract: We describe libhmm, a C++20 library for Hidden Markov Model parameter estimation, sequence decoding, and model selection. libhmm addresses two gaps in existing software: the absence of a well-maintained, zero-dependency C++ HMM library suitable for e...
205. Implicit Identity Technologies for LLMs: Fingerprinting and Watermarking across Datasets, Models, and Generated Content
Author: Bing Liu, Shunping Wang, Yufan Zhu, Xinyi Yu, Jing Huang, Linkang Du, Hongbin Pei, Wei Luo
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CR, cs.CL, cs.LG
arXiv:2605.29245v1 Announce Type: cross Abstract: This paper presents a survey and taxonomy of LLM fingerprinting and watermarking for identity, ownership verification, provenance, and generated-content attribution. Large language models (LLMs) require substantial investments in data, computation, a...
206. DenseSteer: Steering Small Language Models towards Dense Math Reasoning
Author: Yang Ouyang, Shuhang Lin, Jung-Eun Kim
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.CL, cs.LG
arXiv:2605.29247v1 Announce Type: cross Abstract: Large language models (LLMs) demonstrate strong chain-of-thought (CoT) reasoning abilities, while smaller models (<= 3B parameters) significantly underperform on multi-step reasoning tasks. Based on empirical analyses of the Qwen-2.5 model family on ...
207. Prediction-Powered Inference Across Many Tasks for AI Evaluation & Social Science Research
Author: Nicolas Emmenegger, Ellery Stahler, Chara Podimata
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:2605.29249v1 Announce Type: cross Abstract: Many applications require statistically valid inference across many related tasks, while using only a handful of high-quality labels per hypothesis. In AI evaluation, these tasks may correspond to model behaviors across prompts, subgroups, or hypothe...
208. OmniRetrieval: Unified Retrieval across Heterogeneous Knowledge Sources
Author: Jinheon Baek, Soyeong Jeong, Sangwoo Park, Woongyeong Yeo, Minki Kang, Patara Trirat, Heejun Lee, Sung Ju Hwang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.IR, cs.LG
arXiv:2605.29250v1 Announce Type: cross Abstract: Real-world information needs require access to structurally diverse knowledge sources, from unstructured text and relational tables to knowledge graphs and property graphs. Existing retrievers, however, operate over one source at a time under a fixed...
209. When and How Human Curation Backfires: Preference Alignment under Multi-Model Self-Consuming Loop
Author: Yang Zhang, Xiukun Wei, Xueru Zhang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.LG
arXiv:2605.29267v1 Announce Type: cross Abstract: Foundation models are increasingly trained on synthetic data generated by prior model iterations rather than exclusively on real data. This self-consuming training paradigm can lead to model collapse, divergence, or bias amplification. Recent work (F...
210. Compute Allocation in Evolutionary Search: From Depth-Breadth to Multi-Armed Bandits
Author: Sixue Xing, Haoyu He, Kerui Wu, Zhuo Yang, Haozheng Luo, Tianfan Fu, Aarthy Nagarajan
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG, cs.NE
arXiv:2605.29268v1 Announce Type: cross Abstract: LLM-guided evolutionary search (Evolve systems) has reached state-of-the-art results on mathematical and combinatorial tasks, yet most existing systems report only the best of many runs and leave the run-to-run distribution undocumented. We ask how a...
211. CoHyDE: Iterative Co-Training of LLM Rewriter & Dense Encoder for Tool Retrieval
Author: Vaishali Senthil, Ashutosh Hathidara, Sebastian Schreiber
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.IR, cs.LG
arXiv:2605.29271v1 Announce Type: cross Abstract: Tool retrieval over large API catalogs is a core bottleneck for LLM agents: user queries arrive in colloquial, often underspecified language, while the catalog uses technical API vocabulary that no fixed encoder can bridge on its own. The two dominan...
212. GrepSeek: Training Search Agents for Direct Corpus Interaction
Author: Alireza Salemi, Chang Zeng, Atharva Nijasure, Jui-Hui Chung, Razieh Rahimi, Fernando Diaz, Hamed Zamani
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.IR, cs.LG
arXiv:2605.29307v1 Announce Type: cross Abstract: Large Language Model (LLM) search agents have shown strong promise for knowledge-intensive language tasks through multiple rounds of reasoning and information retrieval. Most existing systems access information using a retriever that takes a keyword ...
213. Reasoning-preserved Efficient Distillation of Large Language Models via Activation-aware Initialization
Author: Junlin He, Yihong Tang, Tong Nie, Guilong Li, Binyu Yang, Jinxiao Du, Lijun Sun, Wei Ma
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CL, cs.LG
arXiv:2605.29327v1 Announce Type: cross Abstract: Efficient Distillation (EDistill) compresses large language models (LLMs) by structured pruning parameters and tuning lightweight modules with high training efficiency. Although these EDistilled LLMs achieve state-of-the-art (SOTA) performance on gen...
214. Mixing Vector Model for Copolymer Inference via Mixed Integer Linear Programming
Author: Jianshen Zhu, Raveena Rai, Taiyo Sohkawa, Naveed Ahmed Azam, Kazuya Haraguchi, Liang Zhao, Tatsuya Akutsu
Published: 5/29/2026, 4:00:00 AM
Categories: q-bio.QM, cs.LG
arXiv:2605.29329v1 Announce Type: cross Abstract: A novel two-phase molecule inference framework, mol-infer, has recently been developed to infer chemical graphs with prescribed abstract structures and desired property values through mixed integer linear programming (MILP) under the two-layered mode...
215. Harmless Yet Harmful: Neutral Prompting Attacks for Stealthy Hallucination Steering in Agent Skills
Author: Chia-Yi Hsu, Chia-Mu Yu, Chun-Ying Huang, Jun Sakuma
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CR, cs.LG
arXiv:2605.29354v1 Announce Type: cross Abstract: LLM-powered coding agents increasingly participate in software development workflows by generating code, selecting dependencies, and producing package installation commands. This creates a new software supply chain risk: when an agent hallucinates a ...
216. PassNet: Scaling Large Language Models for Graph Compiler Pass Generation
Author: Yiqun Liu, Yingsheng Wu, Ruqi Yang, Enrong Zheng, Honglei Qiu, Sijun He, Tai Liang, Jingjing Wu, Yuhan Zhou, Yiwei Zhang, Dongyan Chen, Weihan Yi, Xinqi Li, Siqi Bao
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.LG, cs.PL
arXiv:2605.29357v1 Announce Type: cross Abstract: Modern tensor compilers such as TorchInductor deliver substantial speedups on mainstream models, yet face a systematic performance ceiling on long-tail workloads -- our profiling shows that 43% of real-world subgraphs experience end-to-end slowdowns ...
217. Kernel-based potential mean-field games with unbiased random Fourier $U$-statistics
Author: Yumiharu Nakano
Published: 5/29/2026, 4:00:00 AM
Categories: math.OC, cs.LG, cs.NA, math.NA, stat.ML
arXiv:2605.29371v1 Announce Type: cross Abstract: We study the subclass of potential mean-field games in which the running interaction cost and the terminal target cost are both expressed through reproducing-kernel maximum mean discrepancy (MMD) penalties, and develop a computational framework that ...
218. BrahmicTokenizer-131K: An Indic-Capable Drop-In Replacement for o200k_base
Author: Rohan Shravan
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CL, cs.LG
arXiv:2605.29379v1 Announce Type: cross Abstract: We present BrahmicTokenizer-131K, a 131,072-vocabulary byte-level BPE tokenizer that closes the Brahmic compression gap at the 131K-vocabulary class while preserving the English, EU-language, and code compression of OpenAI's o200k_base. We construct ...
219. Real-Time Retargeting Using Controllability Boundary for Chandrayaan-3 Lunar Landing
Author: Suraj Kumar, Debjyoti Chakrabarti, Aditya Rallapalli, Bharat Kumar GVP, Ashok Kumar Kakula
Published: 5/29/2026, 4:00:00 AM
Categories: eess.SY, cs.LG, cs.SY
arXiv:2605.29412v1 Announce Type: cross Abstract: This paper presents the real-time retargeting guidance policy developed for the Chandrayaan-3 lunar landing mission. The baseline guidance generates approximate fuel-optimal descent trajectories, while a high-level policy enables safe retargeting to ...
220. Constructing efficient channels for ideal observers using the conjugate gradient method
Author: Weimin Zhou
Published: 5/29/2026, 4:00:00 AM
Categories: eess.IV, cs.CV, cs.LG, eess.SP, stat.ML
arXiv:2605.29415v1 Announce Type: cross Abstract: Task-based assessment of image quality (IQ) is critically important for the design and optimization of medical imaging systems. Ideal observers, including the Bayesian Ideal Observer (IO) and the ideal linear observer, i.e., the Hotelling observer (H...
221. When Does Persona Prompting Actually Help? A Retrieval and Metric Analysis of Expert Role Injection in LLMs
Author: Shuai Xiao, Su Liu, Weikai Zhou, Jialun Wu, Xinjie He, Zhiyuan Lin, Qiyang Xie
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.LG
arXiv:2605.29420v1 Announce Type: cross Abstract: Persona prompting is widely used to steer large language models, yet its practical value remains unclear. Prior work often evaluates persona prompting using aggregate scores, making it difficult to determine whether expert-role prompting consistently...
222. AliMark: Enhancing Robustness of Sentence-Level Watermarking Against Text Paraphrasing
Author: Yuexin Li, Wenjie Qu, Linyu Wu, Yulin Chen, Yufei He, Tri Cao, Bryan Hooi, Jiaheng Zhang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CR, cs.AI, cs.CL, cs.LG
arXiv:2605.29434v1 Announce Type: cross Abstract: Existing sentence-level watermarking methods enhance robustness to paraphrasing by anchoring watermarks in sentence semantics. However, their prefix-based designs remain vulnerable to structural perturbations, such as sentence splitting and merging, ...
223. Kronecker Embeddings: Byte-Level Structured Token Representations for Parameter-Efficient Language Models
Author: Rohan Shravan
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CL, cs.LG
arXiv:2605.29459v1 Announce Type: cross Abstract: Large language models route every input through a learned embedding table of shape |V| x d_model, consuming hundreds of millions to billions of trainable parameters at frontier scale. We introduce Kronecker Embeddings, a deterministic byte-level char...
224. Deep Optimal Individualized Treatment Rules for Bivariate Survival Outcomes via Adaptive Prediction-Powered Learning
Author: Kun Ren, Yifan Cui, Wen Su
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:2605.29464v1 Announce Type: cross Abstract: In randomized trials involving multiple treatments, bivariate survival outcomes present significant analytical challenges for making decisions. This paper addresses the problem of deriving optimal individualized treatment rules to maximize the joint ...
225. PhoneWorld: Scaling Phone-Use Agent Environments
Author: Zhengyang Tang, Yuxuan Liu, Xin Lai, Junyi Li, Pengyuan Lyu, Jason, Yiduo Guo, Zhengyao Fang, Yang Ding, Yi Zhang, Weinong Wang, Huawen Shen, Xingran Zhou, Liang Wu, Fei Tang, Sunqi Fan, Shangpin Peng, Zheng Ruan, Anran Zhang, Benyou Wang, Rui Yan, Ji-Rong Wen, Chengquan Zhang, Han Hu
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG
arXiv:2605.29486v1 Announce Type: cross Abstract: A central bottleneck for phone-use agents is that controllable, reproducible environments covering real mobile behavior are hard to build at scale. Existing mobile-agent benchmarks have made important progress on evaluation, but they do not by themse...
226. DynaGraph: Lightweight Multi-Model Interaction Framework via Dynamic Topological Reconfiguration
Author: Yanxing Guo, Zihao Zheng, Fangzhou Wu, Ling Liang, Lin Bao, Zongwei Wang, Yimao Cai
Published: 5/29/2026, 4:00:00 AM
Categories: cs.MA, cs.CL, cs.LG
arXiv:2605.29511v1 Announce Type: cross Abstract: Tackling complex reasoning tasks typically relies on massive monolithic LLMs, which suffer from severe computational redundancy. While task decomposition through structured pipelines or multi-agent collaborations offers an alternative, these approach...
227. Temporal Motif-aware Graph Test-time Adaptation for OOD Blockchain Anomaly Detection
Author: Runang He, Tongya Zheng, Huiling Peng, Yuanyu Wan, Bingde Hu, Jiawei Chen, Canghong Jin, Mingli Song, Can Wang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CR, cs.AI, cs.LG
arXiv:2605.29526v1 Announce Type: cross Abstract: Ever-evolving transaction patterns have significantly hindered anomaly detection on emerging cryptocurrency blockchains due to the vast number of addresses and diverse anomalous behaviors. Recently, advanced Graph Anomaly Detection (GAD) approaches a...
228. Audio Deepfake Detection with Half-Truth Localisation Using Cross-Attentive Feature Fusion
Author: S. Sutharya, Remya K. Sasi
Published: 5/29/2026, 4:00:00 AM
Categories: cs.SD, cs.CV, cs.LG
arXiv:2605.29531v1 Announce Type: cross Abstract: Audio deepfake detection is well-studied as a binary problem, but partially manipulated speech, where a short synthesised segment is spliced into an otherwise genuine utterance, poses a harder and more realistic threat. Detecting such half-truth audi...
229. The Complexity of Verifying Feedforward Neural Networks in Quantised Settings
Author: Eric Alsmann, Martin Lange, Marco S"alzer
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CC, cs.LG, cs.LO
arXiv:2605.29537v1 Announce Type: cross Abstract: We investigate the computational complexity of neural network verification in quantised settings. We distinguish three classes of Feedforward Neural Networks (FNNs): rational FNNs with exact rational weights, quantised FNNs whose weights come from a ...
230. FPLIER: Federated Pathway-Level Information Extractor
Author: Daniele Malpetti, Christian Berchtold, Francesco Gualdi, Marco Scutari, Laura Azzimonti, Francesca Mangili
Published: 5/29/2026, 4:00:00 AM
Categories: q-bio.QM, cs.LG
arXiv:2605.29587v1 Announce Type: cross Abstract: In transcriptomics, gene-set-aware factorization methods such as the Pathway Level Information Extractor (PLIER) are most effective when trained on large, heterogeneous expression compendia. Yet, many clinically relevant cohorts cannot be pooled into...
231. Training Deliberative Monitors for Black-Box Scheming Detection
Author: Aditya Sinha, Akshat Naik, Victor Gillioz, Simon Storf, Kilian Merkelbach, Rich Barton-Cooper, Axel H{\o}jmark, Marius Hobbhahn
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG
arXiv:2605.29601v1 Announce Type: cross Abstract: As autonomous agents become more capable of performing real-world tasks, distinguishing scheming behavior from benign task pursuit may become a central AI control problem. Existing monitors often rely on chain-of-thought access or internal activation...
232. Learning Context-Conditioned Predicate Semantics via Prototype Feedback
Author: NamGyu Jung, Chang Choi
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CV, cs.AI, cs.LG
arXiv:2605.29610v1 Announce Type: cross Abstract: In scene graph generation, a central challenge is modeling polysemous predicates whose meanings shift across contexts. Prior approaches address this issue by decomposing predicates into multiple static prototypes or retrieving semantically similar ex...
233. COMET: Concept Space Dissection of the Modality Gap in Audio-Text Multimodal Contrastive Embeddings
Author: Yonggang Zhu, Liting Gao, Aidong Men, Wenwu Wang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.SD, cs.AI, cs.CL, cs.LG, eess.AS
arXiv:2605.29628v1 Announce Type: cross Abstract: Contrastive Language-Audio Pretraining (CLAP) models are widely used for audio understanding and support modality-agnostic condition swapping in many zero-shot applications. However, their performance is heavily affected by the modality gap between a...
234. MoSSP: A Momentum-Based Single-Loop Stochastic Penalty Method for Nonconvex Constrained DC-Regularized Optimization
Author: Luxuan Li, Chunfeng Cui, Xiao Wang
Published: 5/29/2026, 4:00:00 AM
Categories: math.OC, cs.LG
arXiv:2605.29635v1 Announce Type: cross Abstract: In this paper, we study a structured class of nonconvex constrained stochastic problems with difference-of-convex (DC) regularization, where the feasible set is possibly nonconvex and the concave part of the DC regularizer is allowed to be nonsmooth....
235. Matching Rates and Optimal Allocation for Federated Probe-Logit Distillation under Heterogeneous Bandwidth Budgets
Author: Prasanjit Dubey, Xiaoming Huo
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.IT, cs.LG, math.IT
arXiv:2605.29642v1 Announce Type: cross Abstract: In federated language modeling, $K$ nodes each hold $n$ samples but cannot pool data or exchange full-precision gradients or weights. We study the minimax rate at which a conditional distribution over $V$ tokens can be estimated when each node may up...
236. AMDP: Asynchronous Multi-Directional Pipeline Parallelism for Large-Scale Models Training
Author: Ling Chen, Houming Wu, Wenjie Yu
Published: 5/29/2026, 4:00:00 AM
Categories: cs.DC, cs.LG
arXiv:2605.29664v1 Announce Type: cross Abstract: Pipeline parallelism is essential for large-scale model training, but existing asynchronous approaches often degrade convergence due to parameter mismatch between forward and backward passes. We propose Asynchronous Multi-Directional Pipeline paralle...
237. Eigen-Spike Emergence and Quadratic Equivalents for Conjugate Kernels on Nonlinearly Separable Data
Author: Collin Cranston, Zhichao Wang, Todd Kemp, Michael W. Mahoney
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.LG, math.PR, math.ST, stat.TH
arXiv:2605.29669v1 Announce Type: cross Abstract: Recent work in random matrix theory (RMT) has developed the notion of deterministic equivalents: typically linear surrogate models that approximate the spectral behavior of large nonlinear random matrices, such as nonlinear feature maps in neural net...
238. FHRFormer: A Self-Supervised Masked Transformer Framework for Fetal Heart Rate Time-Series Inpainting and Forecasting
Author: Kjersti Engan, Neel Kanwal, Anita Yeconia, Ladislaus Blacy, Yuda Munyaw, Estomih Mduma, Hege Ersdal
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.CE, cs.LG, math.PR
arXiv:2605.29695v1 Announce Type: cross Abstract: Approximately 10% of newborns require assistance to initiate breathing at birth, and around 5% need ventilation support. Fetal heart rate (FHR) monitoring plays a crucial role in assessing fetal well-being during prenatal care, enabling the detection...
239. Efficient, Validation-Free Intrinsic Quality Estimation for Large-Scale Face Recognition Datasets
Author: Zhichao Chen, Yongle Zhao, Kaicheng Yang, Meng Yang, Yin Xie, Ziyong Feng
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2605.29720v1 Announce Type: cross Abstract: We propose Intrinsic Quality (IQ), a validation-free metric designed to estimate the inherent potential of face recognition (FR) datasets to produce high-performance models without the need for full-scale training. IQ integrates two components: (i) a...
240. Why Specialist Models Still Matter: A Heterogeneous Multi-Agent Paradigm for Medical Artificial Intelligence
Author: Yanan Wang, Shuaicong Hu, Jian Liu, Guohui Zhou, Aiguo Wang, Cuiwei Yang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.CL, cs.LG, cs.MA
arXiv:2605.29744v1 Announce Type: cross Abstract: The impressive performance of generalist large language models (LLMs) such as GPT and Claude in healthcare raises a critical question: will domain-specific medical specialist models become obsolete? We argue that the future of medical artificial inte...
241. Instance-dependent Stochastic Lipschitz bandit
Author: Marius Potfer, Vianney Perchet
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:2605.29748v1 Announce Type: cross Abstract: We study the Lipschitz bandit problem, where a learner sequentially maximizes an unknown Lipschitz function $f$ over a domain $\mathcal{X} \subset [0,1]^d$ using noisy pointwise evaluations. Existing regret bounds are either worst-case, scaling as $...
242. Certified Policy Optimisation for Nested Causal Bandits via PAC-Bayes Risk
Author: Tim Woydt, Paul-David Zuercher
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.LG
arXiv:2605.29788v1 Announce Type: cross Abstract: Critical sequential decisions are rarely single-timescale: a strategic decision causally shapes the context in which every subsequent tactical choice is made; standard bandit and reinforcement-learning theory does not capture this causal coupling bet...
243. SAAS: Self-Aware Reinforcement Learning for Over-Search Mitigation in Agentic Search
Author: Yunbo Tang, Chengyi Yang, Shiyu Liu, Zhishang Xiang, Zerui Chen, Qinggang Zhang, Jinsong Su
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.CL, cs.LG
arXiv:2605.29796v1 Announce Type: cross Abstract: Agentic search enables LLMs to solve complex multi-hop questions through iterative reasoning and external search. Despite the effectiveness, these systems often suffer from a critical limitation in practice: agents fail to recognize their own knowled...
244. AgentDoG 1.5: A Lightweight and Scalable Alignment Framework for AI Agent Safety and Security
Author: Dongrui Liu, Yu Li, Zhonghao Yang, Peng Wang, Guanxu Chen, Yuejin Xie, Qinghua Mao, Wanying Qu, Yanxu Zhu, Tianyi Zhou, Leitao Yuan, Zhijie Zheng, Qihao Lin, Yimin Wang, Haoyu Luo, Shuai Shao, Chen Qian, Qingyu Liu, Ling Tang, Ruiyang Qin, Qihan Ren, Junxiao Yang, Kun Wang, Zhiheng Xi, Linfeng Zhang, Ranjie Duan, Bo Zhang, Wenjie Wang, Wen Shen, Qiaosheng Zhang, Yan Teng, Chaochao Lu, Rui Mei, Man Li, Jialing Tao, Xi Lin, Tianhang Zheng, Yong Liu, Quanshi Zhang, Lei Zhu, Xingjun Ma, Junhua Liu, Hui Xue, Xiaoxiang Zuo, Xiangnan He, Chao Shen, Xianglong Liu, Minlie Huang, Jing Shao, Xia Hu
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.CL, cs.CR, cs.CV, cs.LG
arXiv:2605.29801v1 Announce Type: cross Abstract: Modern open-world agents such as OpenClaw exhibit powerful cross-environment execution capabilities yet introduce broad new safety risk sources. Meanwhile, advanced frontier AI models drastically lower attack barriers, rendering current agent alignme...
245. Data filtering methods for training language models
Author: Egor Shevchenko, Elena Bruches
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG
arXiv:2605.29807v1 Announce Type: cross Abstract: Data quality is a critical factor in the effectiveness of machine learning models. Label errors, present even in widely used benchmarks, introduce noise into training data and reduce model generalization. In this work, we conduct a comparative analys...
246. Cert-LAS: Toward Certified Model Ownership Verification for Text-to-Image Diffusion Models via Layer-Adaptive Smoothing
Author: Leyi Qi, Yiming Li, Siyuan Liang, Zhengzhong Tu, Dacheng Tao
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CR, cs.CV, cs.GR, cs.LG, cs.MM
arXiv:2605.29809v1 Announce Type: cross Abstract: Large-scale text-to-image (T2I) diffusion models have enabled unprecedented creative applications, but their unauthorized use has raised serious intellectual property concerns, making model ownership verification (MOV) increasingly critical. We find ...
247. OptSkills: Learning Generalizable Optimization Skills from Problem Archetypes via Cluster-Based Distillation
Author: Haochen Yang, Ke Zhao, Mengyuan Ma, Xingyu Lu, Xiangfeng Wang, Hong Qian
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.LG
arXiv:2605.29829v1 Announce Type: cross Abstract: Leveraging Large Language Models (LLMs) to automatically formulate and solve optimization problems from natural language has emerged as an efficient paradigm for automated optimization. However, existing methods still exhibit limited generalization: ...
248. BuilDyn: Excitation-Driven Data Generation for Building Thermal Dynamics Modeling and Control
Author: Felix Koch, Thomas Krug, Fabian Raisch, Benjamin Sch"afer, Benjamin Tischler
Published: 5/29/2026, 4:00:00 AM
Categories: eess.SY, cs.LG, cs.SY
arXiv:2605.29849v1 Announce Type: cross Abstract: Machine learning (ML) is increasingly used for data-driven modeling of buildings to enable downstream tasks such as fault detection and diagnosis, and energy-efficient control. While recent work improves generalization across building characteristics...
249. Parameter-Efficient Subspace Decoupling ViT for Mitigating Multi-Task Negative Transfer in Histological Scoring
Author: Youhan Huang, Jiajun Li, Yilin Fang, Shuai Wang, Chuheng Li
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CV, cs.LG, cs.MM
arXiv:2605.29852v1 Announce Type: cross Abstract: Histological scoring is essential for diagnosing Non-Alcoholic Fatty Liver Disease (NAFLD), yet its automation remains challenging due to the high annotation cost and negative transfer among the strongly correlated NAFLD Activity Score (NAS) indicato...
250. Dissecting the Black Box: Circuit-Level Analysis of LLM Vulnerability Detection
Author: Syafiq Al Atiiq, Chun Zhou, Christian Gehrmann
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CR, cs.LG
arXiv:2605.29901v1 Announce Type: cross Abstract: Large language models (LLMs) can detect software vulnerabilities, but how do they actually identify vulnerable code? We address this question using mechanistic interpretability; analyzing the internal computations of a neural network to understand it...
251. Joint Model and Data Sparsification via the Marginal Likelihood
Author: Alexander Timans, Thomas M"ollenhoff, Christian A. Naesseth, Mohammad Emtiyaz Khan, Eric Nalisnick
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:2605.29908v1 Announce Type: cross Abstract: Sparse recovery in linear systems underpins applications from signal processing to high-dimensional regression. Sparse Bayesian Learning, grounded in the principle of automatic relevance determination (ARD), offers a practical Bayesian mechanism for ...
252. Gesture-Aware Indoor THz ISAC Systems for Adaptive Resource Allocation
Author: Zhonghao Liu, Yinchao Yang, Yahao Ding, Yixuan Wang, Mohammad Shikh-Bahaei
Published: 5/29/2026, 4:00:00 AM
Categories: cs.IT, cs.LG, math.IT
arXiv:2605.29913v1 Announce Type: cross Abstract: This paper investigates a multi-user indoor integrated sensing and communication (ISAC) system operating in the terahertz (THz) band, designed for adaptive communication based on gesture recognition. Leveraging gesture tracking through an extended Ka...
253. Does The Way You Plan Matter? An Empirical Study of Planning Representations for LLM Web Agents
Author: Alejandra Zambrano, Sara Vera Marjanovic, Imene Kerboua, Xing Han L`u, Leila Kosseim
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG
arXiv:2605.29927v1 Announce Type: cross Abstract: Despite recent advances, LLM-based web agents still struggle with limited exploration, omission of critical steps, and sensitivity to task constraints. Prior work suggests that many of these failures stem from weaknesses in planning, yet the impact o...
254. Fisher-Preserving Guidance: Training-Free Manifold Constraints for Safe Diffusion Control
Author: Hao Ren, Zetong Bi, Yiming Zeng, Le Zheng, Zhi Li, Zhaoliang Wan, Lu Qi, Hui Cheng
Published: 5/29/2026, 4:00:00 AM
Categories: cs.RO, cs.LG
arXiv:2605.29937v1 Announce Type: cross Abstract: Diffusion models are effective for waypoint prediction in visual navigation, but standard sampling and test time guidance can produce unreliable or inefficient trajectories when updates drift off the training manifold. We propose Fisher Preserving Gu...
255. CRB-Guided Framework Design and Resource Allocation for Indoor mmWave ISCC Systems
Author: Zhonghao Liu, Yahao Ding, Yinchao Yang, Mohammad Shikh-Bahaei
Published: 5/29/2026, 4:00:00 AM
Categories: cs.IT, cs.LG, math.IT
arXiv:2605.29939v1 Announce Type: cross Abstract: Integrated sensing, communication, and computation (ISCC) provides a promising framework for indoor human-centric applications. In these applications, short-term human pose prediction facilitates continuous human tracking and resource allocation in a...
256. TraceCodec: A Compiler-Backed Neural Codec for Stateful Multi-Flow Network Traffic Traces
Author: Junhui Ding, Xinchen Zhang, Xiaohui Xie, Shinan Liu
Published: 5/29/2026, 4:00:00 AM
Categories: cs.NI, cs.LG
arXiv:2605.29941v1 Announce Type: cross Abstract: Critical networking workflows require high-fidelity packet captures (PCAPs) for testing, security analysis, and protocol validation, not just statistical flow-level summaries. Recent packet generators have demonstrated protocol-constrained PCAP synth...
257. A Domain-Informed Multi-Objective Framework for EEG Channel Selection in Motor Imagery BCIs
Author: Dekka Muni Kumar, Dhruba Jyoti Kalita, Yogesh Kumar Meena
Published: 5/29/2026, 4:00:00 AM
Categories: cs.HC, cs.ET, cs.LG
arXiv:2605.29943v1 Announce Type: cross Abstract: Motor imagery (MI) classification using electroencephalography (EEG) signals is essential for advancing brain-computer interfaces (BCIs). Traditional EEG channel selection methods often face limitations, such as dependency on single-objective criteri...
258. MuPHI: Learning Implicit Multimodal Harm Reasoning via Semantically Grounded Reward Optimization
Author: Anisha Saha, Varsha Suresh, Teodora Kamova, Sophia Wiedmann, Timothy Hospedales, Vera Demberg
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.CL, cs.LG, cs.MM
arXiv:2605.29951v1 Announce Type: cross Abstract: Understanding how harm emerges from interaction between otherwise benign image-text pairs requires intent-aware cross-modal reasoning beyond surface-level features. Existing vision-language models (VLMs) excel at literal reasoning over perceptual cue...
259. Honeyval: A Comprehensive Evaluation Framework for LLM-powered HTTP Honeypots
Author: Mark Vero, Fabian Kaczmarczyck, Ivan Petrov, Ilia Shumailov, Jamie Hayes, Niels Heinen, Tianqi Fan, Luca Invernizzi, Martin Vechev
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CR, cs.AI, cs.LG
arXiv:2605.29963v1 Announce Type: cross Abstract: Honeypots are decoy systems mimicking real system components designed to defend against cyber attacks. Recently, LLMs increasingly serve as simulation backbones for honeypots. They enable defenders to construct high-interaction honeypots with low sys...
260. EVL-ECG: Efficient ECG Interpretation With Multi-Aspect Heterogeneous Knowledge Distillation
Author: Dang Hong Nguyen, Nhi Ngoc-Yen Nguyen, Huy-Hieu Pham
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2605.29977v1 Announce Type: cross Abstract: High-fidelity ECG interpretation is increasingly reliant on massive foundation models, yet their deployment in clinical edge-care remains hindered by extreme computational demands. While knowledge distillation (KD) is a promising solution, traditiona...
261. Fingerprinting Inference Systems of Large Language Models
Author: Anna Wimbauer, Jonas M"oller, Erik Imgrund, Konrad Rieck
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CR, cs.LG
arXiv:2605.29979v1 Announce Type: cross Abstract: The behavior of LLMs does not depend solely on the model itself. Components of the inference system, such as the inference engine, attention backend, and hardware platform, subtly influence how inputs are processed. These components differ in their i...
262. Genetically Aligned Patient Representations Improve Hematological Diagnosis
Author: Muhammed Furkan Dasdelen, Fatih Ozlugedik, Ilaria Looser, Rao Muhammad Umer, Christian Pohlkamp, Carsten Marr
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CV, cs.AI, cs.LG
arXiv:2605.29980v1 Announce Type: cross Abstract: Multimodal alignment of histopathology encoders with transcriptomic and genomic data has been shown to significantly improve performance in downstream diagnostic tasks. Hematological cytology is unique in that visual single-cell evaluation is often p...
263. Discovering Cooperative Pipelines: Autoresearch for Sequential Social Dilemmas
Author: V'ictor Gallego
Published: 5/29/2026, 4:00:00 AM
Categories: cs.MA, cs.AI, cs.LG
arXiv:2605.30003v1 Announce Type: cross Abstract: We study two-level autoresearch for cooperation: an outer-loop AI agent autonomously redesigns the inner-loop pipeline of an LLM policy-synthesis system for multi-agent Sequential Social Dilemmas (SSDs). A researcher agent $\mathcal{R}$ (run as a cod...
264. Latent Performance Profiling of Large Language Models
Author: Tanmoy Chakraborty, Ayan Sengupta, Suparna Bhattacharya, Partha Pratim Chakrabarti, Amlan Chakrabarti, Supratik Chakraborty, Partha Pratim Das, Lipika Dey, Richa Singh, Mayank Vatsa
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CL, cs.LG
arXiv:2605.30018v1 Announce Type: cross Abstract: Large language models (LLMs) frequently achieve impressive scores on standardized benchmarks, yet accuracy alone offers a limited view of their capabilities. Evaluating open-source LLMs through leaderboards faces persistent issues like data contamina...
265. Sample-Efficient Diffusion-based Reinforcement Learning with Critic Guidance
Author: Shutong Ding, Zejia Zhong, Zhongyi Wang, Ke Hu, Bikang Pan, Jingya Wang, Ye Shi
Published: 5/29/2026, 4:00:00 AM
Categories: cs.RO, cs.LG
arXiv:2605.30056v1 Announce Type: cross Abstract: Recent advances in reinforcement learning (RL) have achieved great successes by leveraging the multimodality and exploration capability of diffusion policies. Among these approaches, one representative branch focuses on the sampling-based policy opti...
266. Conformal Certification of Reasoning Trace Prefixes
Author: Matt Y. Cheung, Ashok Veeraraghavan, Hanjie Chen, Guha Balakrishnan
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.CL, cs.LG, stat.ML
arXiv:2605.30085v1 Announce Type: cross Abstract: Language model reasoning traces are rarely all-or-nothing; they frequently contain valid intermediate steps before a critical error occurs. Existing uncertainty quantification methods typically certify final answers or entire responses, failing to pr...
267. SGMD: Score Gradient Matching Distillation for Few-Step Video Diffusion Distillation
Author: Zhuguanyu Wu, Ruihao Gong, Yang Yong, Yushi Huang, Xiangyu Fan, Lei Yang, Dahua Lin, Xianglong Liu
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2605.30116v1 Announce Type: cross Abstract: Distribution Matching Distillation (DMD) is a widely used paradigm for accelerating inference in few-step video diffusion models. However, DMD-style video distillation faces two coupled challenges: the fake score must track a continuously evolving ge...
268. No More K-means:Single-Stage Sparse Coding for Efficient Multi-Vector Retrieval
Author: Lixuan Guo, Yifei Wang, Tiansheng Wen, Aosong Feng, Stefanie Jegelka, Chenyu You
Published: 5/29/2026, 4:00:00 AM
Categories: cs.IR, cs.AI, cs.LG
arXiv:2605.30120v1 Announce Type: cross Abstract: Multi-vector retrieval (MVR) models, exemplified by ColBERT, have established new benchmarks in retrieval accuracy by preserving fine-grained token-level interactions. However, this granularity imposes prohibitive storage and retrieval efficiency bot...
269. Privacy-Enhanced Zero-Order Federated Learning via xMK-CKKS over Wireless Channels
Author: Anthony Ayli, Khalil Harris, Jihad Fahs, Mohamad Assaad
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CR, cs.LG
arXiv:2605.30123v1 Announce Type: cross Abstract: Homomorphic encryption (HE) enables privacy-preserving aggregation in federated learning (FL) by allowing the server to operate on encrypted data without decryption. Existing HE-over-the-air methods mainly rely on single-key HE schemes and require ch...
270. PARCEL: Pool-Anchored Resampling with Conditioned Elastic Queries for Efficient Vision-Language Understanding
Author: Selim Kuzucu, Alessio Tonioni, Vasile Lup, Bernt Schiele, Federico Tombari, Muhammad Ferjad Naeem
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CV, cs.AI, cs.CL, cs.LG
arXiv:2605.30126v1 Announce Type: cross Abstract: Large Vision-Language Models (LVLMs) map visual inputs into dense token sequences, imposing a quadratic computational bottleneck for inference. Elastic visual-token compression addresses this by training a single model that can run at multiple visual...
271. Diffusion Models Are Statistically Optimal for Learning Low-Dimensional Multi-Modal Distributions
Author: Jingda Wu, Changxiao Cai
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.IT, cs.LG, math.IT, math.ST, stat.TH
arXiv:2605.30153v1 Announce Type: cross Abstract: Score-based diffusion models have demonstrated remarkable empirical success in learning high-dimensional distributions, particularly those exhibiting low-dimensional and multi-modal structures. However, theoretical understanding of their statistical ...
272. BioRefusalAudit: Auditing Biosecurity Refusal Depth Using General and Domain-Fine-Tuned Sparse Autoencoders
Author: Caleb DeLeeuw
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.CR, cs.LG
arXiv:2605.30162v1 Announce Type: cross Abstract: Biosecurity evaluations of language models typically ask whether models produce hazardous output. This paper asks a complementary question: when a model refuses, is that refusal structurally sound, or does it disappear under modest changes to prompt ...
273. SAHG: Sector-Anisotropic Hyperbolic Graph Model for Social Bot Detection
Author: Hanning Lu, Yingguang Yang, Jinwei Su, Yang Liu, Zhaoqian Yao, Yaoming Li, Taoran Liang, Ziyi Zhang, Ran Ran, Kefu Xu, Bin Chong
Published: 5/29/2026, 4:00:00 AM
Categories: cs.SI, cs.LG
arXiv:2605.30166v1 Announce Type: cross Abstract: LLM-driven social bots can generate fluent, human-like text, reducing the discriminative advantage of content-based detection alone. However, coordinated campaigns still leave relational patterns -- interactions, behavioral similarity, shared neighbo...
274. Visual Spatial Learning: Single-Field Spatial Interpolation Using Convolutional Neural Networks
Author: Daniel Tinoco, Raquel Menezes, Carlos Baquero, Alexandra Silva
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.CV, cs.LG, stat.AP
arXiv:2605.30167v1 Announce Type: cross Abstract: Predicting a complete spatially correlated field from sparse observations is a fundamental challenge in spatial statistics and environmental modelling. Classical interpolation methods such as Kriging rely on Gaussian process assumptions and variograp...
275. Unveiling the Visual Counting Bottleneck in Vision-Language Models
Author: Xingzhou Pang, Yifan Hou, Junling Wang, Mrinmaya Sachan
Published: 5/29/2026, 4:00:00 AM
Categories: cs.MM, cs.CV, cs.LG
arXiv:2605.30170v1 Announce Type: cross Abstract: While Large Vision-Language Models (VLMs) excel at interpolation, they suffer catastrophic failures in systematic generalization, most notably in visual counting. In this work, we investigate this extrapolation bottleneck by deconstructing visual cou...
276. A new completely parameter-free clustering algorithm for unsupervised classification of BATSE gamma-ray bursts
Author: Soumita Modak
Published: 5/29/2026, 4:00:00 AM
Categories: astro-ph.HE, cs.LG, stat.ML
arXiv:2605.30175v1 Announce Type: cross Abstract: Cluster analysis is a widely applied machine learning technique to understand the existing patterns in the population of gamma-ray bursts (GRBs), in order to explore their physical sources. In the present scenario, the number of clusters correspondin...
277. Token-Level Generalization in LoRA Adapter Backdoors: Attack Characterization and Behavioral Detection
Author: Travis Lelle
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CR, cs.AI, cs.CL, cs.LG
arXiv:2605.30189v1 Announce Type: cross Abstract: We show that LoRA adapters, the dominant distribution format for fine-tuned LLMs, can be reliably backdoored through training data poisoning while preserving baseline task performance. On a Qwen 2.5 1.5B prompt-injection classifier, a small fraction ...
278. What drives performance in molecular MPNNs? An operator-level factorial benchmark
Author: Panyu Jiao, Shuizhou Chen, Yiheng Shen, Yuyang Wang, Runhai Ouyang, Wei Xie
Published: 5/29/2026, 4:00:00 AM
Categories: cond-mat.mtrl-sci, cs.AI, cs.LG
arXiv:2605.30195v1 Announce Type: cross Abstract: Message-passing neural networks (MPNNs) are widely used for molecular property prediction, but their deployment as monolithic architectures makes it difficult to identify how specific message-passing operators affect performance. We present an operat...
279. When Should Models Change Their Minds? Contextual Belief Management in Large Language Models
Author: Haoming Xu, Weihong Xu, Zongrui Li, Mengru Wang, Yunzhi Yao, Chiyu Wu, Jin Shang, Yu Gong, Shumin Deng
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.CL, cs.LG
arXiv:2605.30219v1 Announce Type: cross Abstract: Long-horizon interactions require language models to manage accumulating information: when to update their state, when to preserve their state, and what to ignore. We study this challenge as \textbf{Contextual Belief Management (CBM)}: maintaining a ...
280. GRASP: Plan-Guided Graph Retrieval with Adaptive Fusion and Reranking on Semi-Structured Knowledge Bases
Author: Yicheng Tao, Yiqun Wang, Xiangchen Song, Xin Luo, Kai Liu, Jie Liu
Published: 5/29/2026, 4:00:00 AM
Categories: cs.IR, cs.CL, cs.LG
arXiv:2605.30237v1 Announce Type: cross Abstract: Semi-structured knowledge bases (SKBs) embed textual documents in a typed graph of entities and relations, and underpin applications such as product search, academic paper search, and precision-medicine inquiries. Existing hybrid retrieval systems on...
281. Wasserstein Contraction of Coordinate Ascent Variational Inference
Author: Rocco Caprio, Adrien Corenflos, Sam Power
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.LG, math.FA, math.OC, math.PR, stat.CO
arXiv:2605.30253v1 Announce Type: cross Abstract: We study the contraction in Wasserstein distance of the coordinate ascent variational inference algorithm. This is shown to hold under a transport-information inequality at the fixed points and a functional smoothness condition. The results are gener...
282. How LoRA Remembers? A Parametric Memory Law for LLM Finetuning
Author: Ziwen Xu, Haiwen Hong, Linsong Yu, Benglei Cui, Longtao Huang, Hui Xue, Ningyu Zhang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.CV, cs.LG
arXiv:2605.30260v1 Announce Type: cross Abstract: Large Language Models (LLMs) must continuously learn and update knowledge to remain effective in dynamic real-world environments. While Low-Rank Adaptation (LoRA) is widely used for such memory updates, existing studies mainly rely on qualitative dow...
283. Leave a Window Out: Modifying the Jackknife for Predictive Inference in Time Series
Author: Hanyang Jiang, Rina Foygel Barber, Ashwin Pananjady, Yao Xie
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.LG, math.ST, stat.ME, stat.TH
arXiv:2605.30292v1 Announce Type: cross Abstract: Conformal prediction methods enjoy strong theoretical and empirical predictive inference performance, provided the data is exchangeable, and predictors are trained in a memoryless fashion. However, these assumptions and constraints are impractical in...
284. Resolution Diagnostics for Paired LLM Evaluation
Author: Anany Kotawala
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CL, cs.LG
arXiv:2605.30315v1 Announce Type: cross Abstract: Across two public LLM leaderboards, many displayed pairwise rankings do not meet a conventional paired-test resolution target under the actual paired evaluation design: 11 of 40 Open LLM Leaderboard v1 pairwise comparisons and 4 of 9 MMLU-Pro top-10 ...
285. Improved Guarantees for Heterogeneous Treatment-Effect Estimation via Matrix Completion
Author: Anay Mehrotra, Phuc Tran, Van H. Vu, Manolis Zampetakis
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.AI, cs.DS, cs.LG, math.ST, stat.TH
arXiv:2605.30319v1 Announce Type: cross Abstract: A central goal of modern causal inference is estimating heterogeneous treatment effects to answer questions like "how does an intervention affect each unit," rather than only on average. We study this problem with panel-data where we observe $n$ unit...
286. On Language Generation in the Limit with Bounded Memory
Author: Jon Kleinberg, Anay Mehrotra, Amin Saberi, Grigoris Velegkas
Published: 5/29/2026, 4:00:00 AM
Categories: cs.DS, cs.AI, cs.CL, cs.LG, stat.ML
arXiv:2605.30324v1 Announce Type: cross Abstract: We study language generation in the limit under bounded memory. In this task, a learner observes examples from an unknown target language one at a time and must eventually output only new valid examples. Prior work assumes access to the entire histor...
287. SchGen: PCB Schematic Generation with Semantic-Grounded Code Representations
Author: Qinpei Luo, Ruichun Ma, Xinyu Zhang, Lili Qiu
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.CL, cs.LG
arXiv:2605.30345v1 Announce Type: cross Abstract: Printed circuit board (PCB) schematic design defines nearly all electronic hardware, but it remains manual and expertise-intensive. While generative AI has advanced digital and analog IC design, PCB schematic generation from natural-language intent i...
288. LLMSurgeon: Diagnosing Data Mixture of Large Language Models
Author: Yaxin Luo, Jiacheng Cui, Xiaohan Zhao, Xinyi Shang, Jiacheng Liu, Xinyue Bi, Zhaoyi Li, Zhiqiang Shen
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG
arXiv:2605.30348v1 Announce Type: cross Abstract: The pretraining data mixture of Large Language Models (LLMs) constitutes their "digital DNA", shaping model behaviors, capabilities, and failure modes. Yet this composition is rarely disclosed, making post-hoc auditing of data combination or provenan...
289. DynaFLIP: Rethinking Robotics Perception via Tri-Modal-Dynamics Guided Representation
Author: Jusuk Lee, Seungjae Lee, Jonghun Shin, Hoseong Jung, Sungha Kim, Daesol Cho, H. Jin Kim, Jia-Bin Huang, Furong Huang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.RO, cs.LG
arXiv:2605.30350v1 Announce Type: cross Abstract: Robot manipulation critically depends on perception that preserves the action-relevant aspects of a scene. Yet most robot learning pipelines are built upon visual encoders pre-trained for static recognition or vision-language alignment, leaving motio...
290. MATNet: Multi-Level Fusion Transformer-Based Model for Day-Ahead PV Generation Forecasting
Author: Matteo Tortora, Francesco Conte, Gianluca Natrella, Paolo Soda
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, eess.SP
arXiv:2306.10356v3 Announce Type: replace Abstract: Accurate forecasting of renewable generation is crucial to facilitate the integration of Renewable Energy Sources into the power system. Focusing on photovoltaic (PV) units, forecasting methods can be divided into two main categories: physics-based...
291. Promoting Generalization for Exact Solvers via Adversarial Instance Augmentation
Author: Haoyang Liu, Yufei Kuang, Jie Wang, Xijun Li, Yongdong Zhang, Feng Wu
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2310.14161v2 Announce Type: replace Abstract: Machine learning has been successfully applied to improve the efficiency of Mixed-Integer Linear Programming (MILP) solvers. However, the learning-based solvers often suffer from severe performance degradation on unseen MILP instances -- especially...
292. Matrix Completion with Hypergraphs:Sharp Thresholds and Efficient Algorithms
Author: Zhongtian Ma, Qiaosheng Zhang, Zhen Wang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.IT, eess.SP, math.IT
arXiv:2401.08197v3 Announce Type: replace Abstract: This paper considers the problem of completing a rating matrix based on sub-sampled matrix entries as well as observed social graphs and hypergraphs. We show that there exists a \emph{sharp threshold} on the sample probability for the task of exact...
293. An Empirical Study of the Influence of Adversarial Fine-Tuning on Compressed Neural Networks
Author: Hallgrimur Thorsteinsson, Valdemar J Henriksen, Daniel I R Cruz, Raghavendra Selvan, Tong Chen
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2403.09441v3 Announce Type: replace Abstract: As deep learning (DL) models are increasingly being integrated into our everyday lives, ensuring their safety by making them robust against adversarial attacks has become increasingly critical. DL models have been found to be susceptible to adversa...
294. Certified Causal Defense with Generalizable Robustness
Author: Yiran Qiao, Yu Yin, Chen Chen, Jing Ma
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.CR, stat.ME
arXiv:2408.15451v3 Announce Type: replace Abstract: While machine learning models have proven effective across various scenarios, it is widely acknowledged that many models are vulnerable to adversarial attacks. Recently, there have emerged numerous efforts in adversarial defense. Among them, certif...
295. Dataset-Driven Channel Masks in Transformers for Multivariate Time Series
Author: Seunghan Lee, Taeyoung Park, Kibok Lee
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, stat.ML
arXiv:2410.23222v4 Announce Type: replace Abstract: Recent advancements in foundation models have been successfully extended to the time series (TS) domain, facilitated by the emergence of large-scale TS datasets. However, previous efforts have primarily Capturing channel dependency (CD) is essentia...
296. KAN-AD: Time Series Anomaly Detection with Kolmogorov-Arnold Networks
Author: Quan Zhou, Changhua Pei, Fei Sun, Jing Han, Zhengwei Gao, Dan Pei, Haiming Zhang, Gaogang Xie, Jianhui Li
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2411.00278v4 Announce Type: replace Abstract: Time series anomaly detection (TSAD) underpins real-time monitoring in cloud services and web systems, allowing rapid identification of anomalies to prevent costly failures. Most TSAD methods driven by forecasting models tend to overfit by emphasiz...
297. Learning Locally, Revising Globally: Global Reviser for Federated Learning with Noisy Labels
Author: Yuxin Tian, Mouxing Yang, Yuhao Zhou, Jian Wang, Qing Ye, Tongliang Liu, Gang Niu, Jiancheng Lv
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.CV
arXiv:2412.00452v3 Announce Type: replace Abstract: Conventional federated learning (FL) heavily depends on high-quality labels, which are often impractical in the real world, leading to the federated label-noise (F-LN) problem. Worse still, the F-LN problem is exacerbated by the heterogeneity of FL...
298. A Quotient Homology Theory of Representation in Neural Networks
Author: Kosio Beshkov
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, math.AT, q-bio.NC
arXiv:2502.01360v4 Announce Type: replace Abstract: Previous research has proven that the set of maps implemented by neural networks with a ReLU activation function is identical to the set of piecewise linear continuous maps. Furthermore, such networks induce a hyperplane arrangement splitting the i...
299. Looking around you: external information enhances representations for event sequences
Author: Petr Sokerin, Maria Kovaleva, Ekaterina Boyarina, Pavel Tikhomirov, Denis Vorobiyov, Alexey Zaytsev
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2502.10205v3 Announce Type: replace Abstract: Representation learning produces models in different domains, such as store purchases, client transactions, and general people's behavior. However, such models for event sequences usually process each sequence in isolation, ignoring context from th...
300. Diffusion-based learning framework for Constrained Nonconvex Optimization with Weighted Bootstrapped Refinement
Author: Shutong Ding, Yimiao Zhou, Ke Hu, Xi Yao, Junchi Yan, Xiaoying Tang, Ye Shi
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2502.10330v4 Announce Type: replace Abstract: Recent advances in diffusion models show promising potential to accelerate nonconvex problem solving by leveraging their multimodality. However, most existing diffusion-based optimization approaches rely on supervised learning and lack a mechanism ...
301. A Composable Multimodal Framework for cine CMR-Text-Driven Prediction of Heart Failure Outcomes
Author: Jianzhou Chen, Jinyang Sun, Xiumei Wang, Xi Chen, Heyu Chu, Guo Song, Yuji Luo, Xingping Zhou, Rong Gu
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CV
arXiv:2502.16548v3 Announce Type: replace Abstract: Objective. Heart failure is one of the leading causes of death worldwide, with millions of deaths each year, according to data from the World Health Organization (WHO) and other public health agencies. While significant progress has been made in th...
302. Robust and Efficient Writer-Independent IMU-Based Handwriting Recognition
Author: Jindong Li, Tim Hamann, Jens Barth, Peter K"ampf, Dario Zanca, Bj"orn Eskofier
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2502.20954v3 Announce Type: replace Abstract: Handwriting recognition (HWR) using inertial measurement unit (IMU) data remains challenging due to variations in writing styles and the limited availability of datasets. Previous approaches often struggle with handwriting from unseen writers, maki...
303. Neural Logistic Bandits
Author: Seoungbin Bae, Dabeen Lee
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2505.02069v2 Announce Type: replace Abstract: We study the problem of neural logistic bandits, where the main task is to learn an unknown reward function within a logistic link function using a neural network. Existing approaches either exhibit unfavorable dependencies on $\kappa$, where $1/\k...
304. Connecting Independently Trained Modes via Layer-Wise Connectivity
Author: Yongding Tian, Zaid Al-Ars, Maksim Kitsak, Peter Hofstee
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2505.02604v5 Announce Type: replace Abstract: Empirical studies have shown that continuous low-loss paths can be constructed between independently trained neural network models. This phenomenon, known as mode connectivity, refers to the existence of such paths between distinct modes-i.e., well...
305. Cooperative Variance Estimation and Bayesian Neural Networks for Disentangling Aleatoric and Epistemic Uncertainties
Author: Jiaxiang Yi, Miguel A. Bessa
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2505.02743v2 Announce Type: replace Abstract: Real-world data contains aleatoric uncertainty - irreducible noise arising from imperfect measurements or from incomplete knowledge about the data generation process. Mean-variance estimation networks can learn this type of uncertainty but require ...
306. Offline Multi-agent Reinforcement Learning via Sequential Score Decomposition
Author: Dan Qiao, Wenhao Li, Shanchao Yang, Hongyuan Zha, Baoxiang Wang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.MA
arXiv:2505.05968v3 Announce Type: replace Abstract: Offline cooperative multi-agent reinforcement learning (MARL) faces unique challenges due to distributional shifts, particularly stemming from the high dimensionality of joint action spaces and the presence of out-of-distribution joint action selec...
307. Explaining Concept Shift with Interpretable Feature Attribution
Author: Ruiqi Lyu, Alistair Turcan, Bryan Wilder
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2505.20634v2 Announce Type: replace Abstract: Concept shift occurs when the distribution of labels conditioned on the features changes between domains, which can make even a well-tuned ML model miscalibrated on a new domain. Identifying these shifted features provides unique insight into how f...
308. Dynamic Mixture of Progressive Parameter-Efficient Expert Library for Lifelong Robot Learning
Author: Yuheng Lei, Sitong Mao, Shunbo Zhou, Hongyuan Zhang, Xuelong Li, Ping Luo
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.RO
arXiv:2506.05985v3 Announce Type: replace Abstract: A generalist agent must continuously learn and adapt throughout its lifetime, achieving efficient forward transfer while minimizing catastrophic forgetting. Previous work within the dominant pretrain-then-finetune paradigm has explored parameter-ef...
309. Accelerating Sparse Transformer Inference on GPU
Author: Wenhao Dai, Haodong Deng, Mengfei Rong, Xinyu Yang, Hongyu Liu, Fangxin Liu, Hailong Yang, Qianwen Cao, Qingxiao Sun
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2506.06095v5 Announce Type: replace Abstract: Large language models (LLMs) are popular around the world due to their powerful understanding capabilities. As the core component of LLMs, accelerating Transformer through parallelization has gradually become a hot research topic. Mask layers intro...
310. TrojanTO: Action-Level Backdoor Attacks against Trajectory Optimization Models
Author: Yang Dai, Oubo Ma, Longfei Zhang, Xingxing Liang, Xiaochun Cao, Shouling Ji, Jiaheng Zhang, Jincai Huang, Li Shen
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2506.12815v2 Announce Type: replace Abstract: Recent advances in Trajectory Optimization (TO) models have achieved remarkable success in offline reinforcement learning. However, their vulnerabilities against backdoor attacks are poorly understood. We find that existing backdoor attacks in rein...
311. Model Fusion via Retrofitting
Author: Phoomraphee Luenam, Andreas Spanopoulos, Amit Sant, Thomas Hofmann, Sotiris Anagnostidis, Sidak Pal Singh
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2507.00037v2 Announce Type: replace Abstract: Model fusion seeks to combine independently trained neural networks into a single model without retraining, but is complicated by representational divergence arising from permutation invariance, random initialization, and heterogeneous training dat...
312. Solved in Unit Domain: JacobiNet for Differentiable Coordinate-Transformed PINNs
Author: Xi Chen, Jianchuan Yang, Junjie Zhang, Runnan Yang, Xu Liu, Hong Wang, Tinghui Zheng, Ziyu Ren, Wenqi Hu
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2508.02537v3 Announce Type: replace Abstract: Physics-Informed Neural Networks (PINNs) offer a powerful framework for solving PDEs by embedding physical laws into the learning process. However, when applied to domains with irregular boundaries, PINNs often suffer from instability and slow conv...
313. Multi-level Collaborative Distillation Meets Global Workspace Model: A Unified Framework for OCIL
Author: Shibin Su, Guoqiang Liang, De Cheng, Shizhou Zhang, Lingyan Ran
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.CV
arXiv:2508.08677v2 Announce Type: replace Abstract: Online Class-Incremental Learning (OCIL) enables models to learn continuously from non-i.i.d. data streams. Since samples of the data streams can be seen only once, it is more suitable for real-world scenarios compared to offline learning. However,...
314. Prescribe-then-Select: Adaptive Policy Selection for Contextual Stochastic Optimization
Author: Caio de Prospero Iglesias, Kimberly Villalobos Carballo, Dimitris Bertsimas
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2509.08194v2 Announce Type: replace Abstract: We address the problem of policy selection in contextual stochastic optimization (CSO), where covariates are available as contextual information and decisions must satisfy hard feasibility constraints. In many CSO settings, multiple candidate polic...
315. Active Learning for Machine Learning Driven Molecular Dynamics
Author: Kevin Bachelor, Sanya Murdeshwar, Daniel Sabo, Razvan Marinescu
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, physics.atm-clus
arXiv:2509.17208v3 Announce Type: replace Abstract: Machine-learned coarse-grained (CG) potentials are fast, but degrade over time when simulations reach under-sampled bio-molecular conformations, and generating widespread all-atom (AA) data to combat this is computationally infeasible. We propose a...
316. GRPO is Secretly a Process Reward Model
Author: Michael Sullivan, Alexander Koller
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2509.21154v4 Announce Type: replace Abstract: Process reward models (PRMs) allow for fine-grained credit assignment in reinforcement learning (RL), and seemingly contrast with outcome reward models (ORMs), which assign a single reward to an entire trajectory. However, we provide theoretical pr...
317. Towards Foundation Models for Zero-Shot Time Series Anomaly Detection: Leveraging Synthetic Data and Relative Context Discrepancy
Author: Tian Lan, Hao Duong Le, Jinbo Li, Wenjun He, Meng Wang, Chenghao Liu, Chen Zhang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2509.21190v4 Announce Type: replace Abstract: Time series anomaly detection (TSAD) is a critical task, but developing models that generalize to unseen data in a zero-shot manner remains a major challenge. Prevailing foundation models for TSAD predominantly rely on reconstruction-based objectiv...
318. Towards Understanding the Shape of Representations in Protein Language Models
Author: Kosio Beshkov, Anders Malthe-S{\o}renssen
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2509.24895v2 Announce Type: replace Abstract: While protein language models (PLMs) are one of the most promising avenues of research for future de novo protein design, the way in which they transform sequences to hidden representations, as well as the information encoded in such representation...
319. In-Place Feedback: Reliable Refinement for Multi-Turn Expert-LLM Collaboration
Author: Youngbin Choi, Minjong Lee, Saemi Moon, Seunghyuk Cho, Chaehyeon Chung, MoonJeong Park, Dongwoo Kim
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2510.00777v2 Announce Type: replace Abstract: LLM-generated drafts often contain subtle factual or logical errors, yet prior work shows that models struggle to reliably integrate multi-turn feedback aimed at fixing them. We propose in-place feedback, an interaction paradigm in which the user d...
320. Distributional Inverse Reinforcement Learning
Author: Feiyang Wu, Ye Zhao, Anqi Wu
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2510.03013v4 Announce Type: replace Abstract: We propose a distributional framework for offline Inverse Reinforcement Learning (IRL) that jointly models uncertainty over reward functions and full distributions of returns. Unlike conventional IRL approaches that recover a deterministic reward e...
321. Provable Affine Identifiability of Nonlinear CCA under Latent Distributional Priors
Author: Zhiwei Han, Stefan Matthes, Hao Shen
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2510.04758v2 Announce Type: replace Abstract: In this work, we establish the sufficient conditions under which nonlinear Canonical Correlation Analysis (CCA) recovers ground-truth latent factors up to an affine transformation. By transporting the analysis from the observation space to the sour...
322. The Impact of Semantic Pairs on Self-Supervised Representation Learning
Author: Mohammad Alkhalefi, Georgios Leontidis, Mingjun Zhong
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2510.08722v3 Announce Type: replace Abstract: Instance discrimination learns visual representations by treating different augmented views of the same image as positive pairs. While this encourages invariance to handcrafted transformations, same-image positives can preserve nuisance correlation...
323. Offline Reinforcement Learning with Generative Trajectory Policies
Author: Xinsong Feng, Leshu Tang, Chenan Wang, Haipeng Chen
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2510.11499v2 Announce Type: replace Abstract: Generative models have emerged as a powerful class of policies for offline reinforcement learning (RL) due to their ability to capture complex, multi-modal behaviors. However, existing methods face a stark trade-off: slow, iterative models like dif...
324. Beyond Accuracy: Are Time Series Foundation Models Well-Calibrated?
Author: Coen Adler, Yuxin Chang, Felix Draxler, Samar Abdi, Padhraic Smyth
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, stat.ME, stat.ML
arXiv:2510.16060v2 Announce Type: replace Abstract: The recent development of foundation models for time series data has generated considerable interest in using such models across a variety of applications. Although foundation models achieve state-of-the-art predictive performance, their calibratio...
325. Leak@$k$: Unlearning Does Not Make LLMs Forget Under Probabilistic Decoding
Author: Hadi Reisizadeh, Jiajun Ruan, Yiwei Chen, Soumyadeep Pal, Sijia Liu, Mingyi Hong
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2511.04934v3 Announce Type: replace Abstract: Unlearning in large language models (LLMs) is critical for regulatory compliance and for building ethical generative AI systems that avoid producing private, toxic, illegal, or copyrighted content. Despite rapid progress, in this work, we show that...
326. DiScoFormer: Plug-In Density and Score Estimation with Transformers
Author: Vasily Ilin, Peter Sushko, Ranjay Krishna
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2511.05924v3 Announce Type: replace Abstract: Estimating probability density and its score from samples remains a core problem in generative modeling, Bayesian inference, and kinetic theory. Existing methods are bifurcated: classical kernel density estimators (KDE) generalize across distributi...
327. FarSkip-Collective: Unhobbling Blocking Communication in Mixture of Experts Models
Author: Yonatan Dukler, Guihong Li, Deval Shah, Jiang Liu, Vikram Appia, Emad Barsoum
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2511.11505v3 Announce Type: replace Abstract: Blocking communication presents a major hurdle in running MoEs efficiently in distributed settings. To address this, we present FarSkip-Collective which modifies the architecture of modern models to enable overlapping of their computation with comm...
328. Enhancing Reinforcement Learning in 3D Environments through Semantic Segmentation: A Case Study in ViZDoom
Author: Jin Huang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.RO
arXiv:2511.11703v2 Announce Type: replace Abstract: Reinforcement learning (RL) in 3D environments with high-dimensional sensory input poses two major challenges: (1) the high memory consumption induced by memory buffers required to stabilise learning, and (2) the complexity of learning in partially...
329. MiAD: Mirage Atom Diffusion for De Novo Crystal Generation
Author: Andrey Okhotin, Maksim Nakhodnov, Nikita Kazeev, Mikhail Lazarev, Andrey E Ustyuzhanin, Dmitry Vetrov
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cond-mat.mtrl-sci, cs.AI, physics.comp-ph
arXiv:2511.14426v2 Announce Type: replace Abstract: In recent years, diffusion-based models have demonstrated exceptional performance in searching for simultaneously stable, unique, and novel (S.U.N.) crystalline materials. However, most of these models don't have the ability to change the number of...
330. ReflexGrad: Within-Episode Failure Recovery in LLM Agents via Progress-Gated Dual-Process Routing
Author: Ankush Kadu, Aswanth Krishnan
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2511.14584v4 Announce Type: replace Abstract: We present ReflexGrad, a dual-process architecture for within-episode failure recovery in LLM agents without demonstrations. When agents commit to a wrong approach early and exhaust the step budget, the post-failure trajectory contains the informat...
331. BioArc: Discovering Optimal Neural Architectures for Biological Foundation Models
Author: Yi Fang, Haoran Xu, Jiaxin Han, Sirui Ding, Yizhi Wang, Yue Wang, Xuan Wang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, q-bio.QM
arXiv:2512.00283v3 Announce Type: replace Abstract: Foundation models have revolutionized various fields such as natural language processing (NLP) and computer vision (CV). While efforts have been made to transfer the success of the foundation models in general AI domains to biology, existing works ...
332. E-valuator: Reliable Agent Verifiers with Sequential Hypothesis Testing
Author: Shuvom Sadhuka, Drew Prinster, Clara Fannjiang, Gabriele Scalia, Bonnie Berger, Aviv Regev, Hanchen Wang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, stat.AP, stat.ML
arXiv:2512.03109v2 Announce Type: replace Abstract: Agentic AI systems execute a sequence of actions, such as reasoning steps or tool calls, in response to a user prompt. To evaluate the success of their trajectories, researchers have developed verifiers, such as LLM judges and process-reward models...
333. DCFO: Density-Based Counterfactuals for Outliers -- Additional Material
Author: Tommaso Amico, Pernille Matthews, Lena Krieger, Arthur Zimek, Ira Assent
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2512.10659v3 Announce Type: replace Abstract: Outlier detection identifies data points that significantly deviate from the majority of the data distribution. Explaining outliers is crucial for understanding the underlying factors that contribute to their detection, validating their significanc...
334. Learning to Solve PDEs on Neural Shape Representations
Author: Lilian Welschinger, Yilin Liu, Zican Wang, Niloy Mitra
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2512.21311v2 Announce Type: replace Abstract: Solving partial differential equations (PDEs) on shapes underpins many shape analysis and engineering tasks; yet, prevailing PDE solvers operate on polygonal/triangle meshes while modern 3D assets increasingly live as neural representations. This m...
335. When the Same Coefficients Reach Different Places: Asymmetric Realizability in Transplanting Tokenizers across Large Language Models
Author: Xiaoze Liu, Weichen Yu, Matt Fredrikson, Xiaoqian Wang, Jing Gao
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.CL, cs.CR
arXiv:2601.00065v3 Announce Type: replace Abstract: Tokenizer transplant in cross-vocabulary model composition reconstructs donor-only embedding rows as weighted combinations over shared lexical anchors and reuses those coefficients on the base. We identify a structural geometric property of this re...
336. Bridging the Semantic Gap for Categorical Data Clustering via Large Language Models
Author: Zihua Yang, Xin Liao, Yiqun Zhang, Yiu-ming Cheung
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL
arXiv:2601.01162v3 Announce Type: replace Abstract: Qualitative data are widespread in domains such as healthcare, marketing, and bioinformatics, where clustering offers a fundamental tool for pattern discovery. A core difficulty of qualitative-data clustering lies in measuring similarity among attr...
337. FedBiCross: Personalized One-Shot Federated Learning on Medical Images
Author: Yuexuan Xia, Yinghao Zhang, Yalin Liu, Hong-Ning Dai, Yong Xia
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2601.01901v3 Announce Type: replace Abstract: Data-free knowledge distillation-based one-shot federated learning (OSFL) trains a model in a single communication round without sharing raw data, making OSFL attractive for privacy-sensitive medical applications. However, existing methods aggregat...
338. Horizon Activation Mapping for Neural Networks in Time Series Forecasting
Author: Krupakar Hans, V A Kandappan
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, math.FA
arXiv:2601.02094v4 Announce Type: replace Abstract: Neural networks for time series forecasting have relied on error metrics and architecture-specific interpretability approaches for model selection that don't apply across models of different families. To interpret forecasting models agnostic to the...
339. Bandit Algorithms for Deep Brain Stimulation
Author: Arkaprava Gupta, Nicholas Carter, William Zellers, Prateek Ganguli, Benedikt Dietrich, Vibhor Krishna, Parasara Sridhar Duggirala, Samarjit Chakraborty
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.SY, eess.SY
arXiv:2601.12699v2 Announce Type: replace Abstract: Deep Brain Stimulation (DBS) is an effective treatment for Parkinson's disease, but conventional fixed-parameter stimulation can reduce battery life and cause side effects while failing to adapt to changing neural dynamics. Recent reinforcement lea...
340. Mechanism Shift During Post-training from Autoregressive to Masked Diffusion Language Models
Author: Injin Kong, Hyoungjoon Lee, Yohan Jo
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL
arXiv:2601.14758v4 Announce Type: replace Abstract: Post-training pretrained autoregressive models (ARMs) into masked diffusion models (MDMs) has emerged as a cost-effective way to overcome the limitations of sequential generation. Yet it remains unclear whether post-trained MDMs acquire genuinely n...
341. Adaptive Exponential Integration for Stable Gaussian Mixture Black-Box Variational Inference
Author: Baojun Che, Yifan Chen, Daniel Zhengyu Huang, Xinying Mao, Weijie Wang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2601.14855v3 Announce Type: replace Abstract: Black-box variational inference (BBVI) with Gaussian mixture families offers a flexible approach for approximating complex posterior distributions without requiring gradients of the target density. However, standard numerical optimization methods o...
342. Riemannian AmbientFlow: Towards Simultaneous Manifold Learning and Generative Modeling from Corrupted Data
Author: Willem Diepeveen, Oscar Leong
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, math.DG, math.OC, math.ST, stat.TH
arXiv:2601.18728v2 Announce Type: replace Abstract: Modern generative modeling methods have demonstrated strong performance in learning complex data distributions from clean samples. In many scientific and imaging applications, however, clean samples are unavailable, and only noisy or linearly corru...
343. NCSAM Noise-Compensated Sharpness-Aware Minimization for Noisy Label Learning
Author: Jiayu Xu, Junbiao Pang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CV
arXiv:2601.19947v3 Announce Type: replace Abstract: Learning from Noisy Labels (LNL) remains a fundamental challenge in deep learning because real-world datasets often contain corrupted annotations. Most existing methods rely on label correction or sample selection mechanisms. In contrast, we study ...
344. HE-SNR: Uncovering Latent Logic via Entropy for Guiding Mid-Training on SWE-bench
Author: Yueyang Wang, Jiawei Fu, Baolong Bi, Xili Wang, Xiaoqing Liu
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.CL, cs.SE
arXiv:2601.20255v3 Announce Type: replace Abstract: SWE-bench has emerged as the premier benchmark for evaluating Large Language Models on complex software engineering tasks. While these capabilities are fundamentally acquired during the mid-training phase and subsequently elicited during Supervised...
345. Representation Unlearning: Forgetting through Information Compression
Author: Antonio Almud'evar, Alfonso Ortega
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2601.21564v2 Announce Type: replace Abstract: Machine unlearning seeks to remove the influence of specific training data from a model, a need driven by privacy regulations and robustness concerns. Existing approaches typically modify model parameters, but such updates can be unstable, computat...
346. Bridging Functional and Representational Similarity via Usable Information
Author: Antonio Almud'evar, Alfonso Ortega
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2601.21568v2 Announce Type: replace Abstract: We present a unified framework for quantifying the similarity between representations through the lens of \textit{usable} information, offering a rigorous theoretical and empirical synthesis across three key dimensions. First, addressing functional...
347. Server-Proximal Aggregation for Federated Domain-Incremental Learning under Partial Participation: Task-Uniform Convergence and Backward Transfer
Author: Longtao Xu, Jian Li
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2601.22274v2 Announce Type: replace Abstract: Real-world federated systems seldom operate on static data: input distributions drift while privacy rules forbid raw-data sharing. We study this setting as Federated Domain-Incremental Learning (FDIL), where (i) clients are heterogeneous, (ii) task...
348. Pushing the Limits of Block Rotations in Post-Training Quantization
Author: Sai Sanjeet, Ian Colbert, Pablo Monteagudo-Lago, Giuseppe Franco, Yaman Umuroglu, Nicholas J. Fraser
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2601.22347v2 Announce Type: replace Abstract: Recent post-training quantization (PTQ) methods have adopted block rotations to diffuse outliers prior to rounding. While this reduces the overhead of online full-vector rotations, the effect of block structure on outlier suppression remains poorly...
349. Learn from A Rationalist: Distilling Intermediate Interpretable Rationales
Author: Jiayi Dai, Randy Goebel
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2601.22531v2 Announce Type: replace Abstract: Because of the pervasive use of deep neural networks (DNNs), especially in high-stakes domains, the interpretability of DNNs has received increased attention. The general idea of rationale extraction (RE) is to provide an interpretable-by-design fr...
350. Unsupervised Hierarchical Skill Discovery
Author: Damion Harvey, Geraud Nangue Tasse, Benjamin Rosman, Branden Ingram, Steven James
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.FL
arXiv:2601.23156v2 Announce Type: replace Abstract: We consider the problem of unsupervised skill segmentation and hierarchical structure discovery in reinforcement learning. While recent approaches have sought to segment trajectories into reusable skills or options, most rely on action labels, rewa...
351. Good SFT Optimizes for SFT, Better SFT Prepares for Reinforcement Learning
Author: Dylan Zhang, Yufeng Xu, Haojin Wang, Qingzhi Chen, Hao Peng
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL
arXiv:2602.01058v2 Announce Type: replace Abstract: Post-training of reasoning LLMs is a holistic process that typically consists of an offline SFT stage followed by an online reinforcement learning (RL) stage. However, SFT is often optimized in isolation to maximize SFT performance alone. We show t...
352. Rectified LpJEPA: Joint-Embedding Predictive Architectures with Sparse and Maximum-Entropy Representations
Author: Yilun Kuang, Yash Dagade, Tim G. J. Rudner, Randall Balestriero, Yann LeCun
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.CV
arXiv:2602.01456v2 Announce Type: replace Abstract: Joint-Embedding Predictive Architectures (JEPA) learn view-invariant representations and admit projection-based distribution matching for collapse prevention. Existing approaches regularize representations towards isotropic Gaussian distributions, ...
353. How Far Ahead Do LLMs Plan? Uncovering the Latent Horizon in Chain-of-Thought Reasoning
Author: Liyan Xu, Mo Yu, Fandong Meng, Jie Zhou
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.CL
arXiv:2602.02103v2 Announce Type: replace Abstract: Chain-of-thought (CoT) reasoning has become a central mechanism for eliciting multi-step reasoning in Large Language Models (LLMs). Yet recent evidence presents a tension: hidden states appear to already encode future reasoning before CoT fully unf...
354. Achieving Linear Speedup for Composite Federated Learning
Author: Kun Huang, Shi Pu, Karl Henrik Johansson
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, math.OC
arXiv:2602.03357v2 Announce Type: replace Abstract: This paper proposes FedNMap, a normal map-based method for composite federated learning, where the objective consists of a smooth loss and a possibly nonsmooth regularizer. FedNMap leverages a normal map-based update scheme to handle the nonsmooth ...
355. Optimization and Generation in Aerodynamics Inverse Design
Author: Huaguan Chen, Ning Lin, Luxi Chen, Jiacheng Cen, Rui Zhang, Wenbing Huang, Chongxuan Li, Hao Sun
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2602.03582v3 Announce Type: replace Abstract: Aerodynamic inverse design can improve vehicle and aircraft efficiency, but practical design rarely seeks performance alone: vehicle refinement must reduce drag while preserving visual features linked to design language, brand recognition and user ...
356. Selecting Hyperparameters for Tree-Boosting
Author: Floris Jan Koster, Fabio Sigrist
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, stat.AP, stat.ML
arXiv:2602.05786v2 Announce Type: replace Abstract: Tree-boosting is a widely used machine learning technique for tabular data. However, its out-of-sample accuracy is critically dependent on multiple hyperparameters. In this article, we empirically compare several popular methods for hyperparameter ...
357. Discrete diffusion samplers and bridges: Off-policy algorithms and applications in latent spaces
Author: Arran Carter, Sanghyeok Choi, Kirill Tamogashev, V'ictor Elvira, Esmeralda S. Whitammer
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2602.05961v3 Announce Type: replace Abstract: Sampling from a distribution $p(x) \propto e^{-\mathcal{E}(x)}$ known up to a normalising constant is an important and challenging problem in statistics. Recent years have seen the rise of a new family of amortised sampling algorithms, commonly ref...
358. Rare Event Analysis of Large Language Models
Author: Jake McAllister Dorman, Edward Gillman, Dominic C. Rose, Jamie F. Mair, Juan P. Garrahan
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cond-mat.dis-nn, cond-mat.stat-mech
arXiv:2602.06791v2 Announce Type: replace Abstract: Being probabilistic models, during inference large language models (LLMs) display rare events: behaviour that is far from typical but highly significant. By definition all rare events are hard to see, but the enormous scale of LLM usage means that ...
359. Gradient Preconditioning for Efficient and Reliable Reward-Guided Generation
Author: Jisung Hwang, Minhyuk Sung
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2602.08646v2 Announce Type: replace Abstract: We propose a gradient preconditioning method that makes reward-guided generation with one-step generative models both efficient and reliable. Test-time noise optimization can unlock substantially better reward-guided generations from pretrained gen...
360. Computationally Efficient Replicable Learning of Parities and Applications
Author: Moshe Noivirt, Jessica Sorrell, Eliad Tsfadia
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.CR
arXiv:2602.09499v2 Announce Type: replace Abstract: We study the computational relationship between replicability (Impagliazzo et al. [STOC 22], Ghazi et al. [NeurIPS 21]) and other stability notions. Specifically, we focus on replicable PAC learning and its connections to differential privacy (Dw...
361. Prioritize the Process, Not Just the Outcome: Rewarding Latent Thought Trajectories Improves Reasoning in Looped Language Models
Author: Jonathan Williams, Esin Tureci
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2602.10520v3 Announce Type: replace Abstract: Looped Language Models (LoopLMs) perform multi-step latent reasoning prior to token generation and outperform conventional LLMs on reasoning benchmarks at smaller parameter budgets. However, attempts to further improve LoopLM reasoning with reinfor...
362. Coarse-Grained Boltzmann Generators
Author: Weilong Chen, Bojun Zhao, Jan Eckwert, Julija Zavadlav
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cond-mat.stat-mech, physics.chem-ph, stat.ML
arXiv:2602.10637v2 Announce Type: replace Abstract: Sampling equilibrium molecular configurations from the Boltzmann distribution is a longstanding challenge. Boltzmann Generators (BGs) address this by combining exact-likelihood generative models with importance sampling, but practical scalability i...
363. Collaborative Threshold Watermarking
Author: Tameem Bakr, Anish Ambreth, Nils Lukas
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2602.10765v2 Announce Type: replace Abstract: In federated learning (FL), $K$ clients jointly train a model without sharing raw data. Because each participant invests data and compute, clients need mechanisms to later prove the provenance of a jointly trained model. Model watermarking embeds a...
364. Size Transferability of Graph Transformers with Convolutional Positional Encodings
Author: Javier Porras-Valenzuela, Zhiyang Wang, Xiaotao Shang, Yusu Wang, Alejandro Ribeiro
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2602.15239v2 Announce Type: replace Abstract: Transformers have achieved remarkable success across domains, motivating the rise of Graph Transformers (GTs) as attention-based architectures for graph-structured data. A key design choice in GTs is the use of Graph Neural Network (GNN)-based posi...
365. GICDM: Mitigating Hubness for Reliable Distance-Based Generative Model Evaluation
Author: Nicolas Salvy, Hugues Talbot, Bertrand Thirion
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, stat.ML
arXiv:2602.16449v3 Announce Type: replace Abstract: Generative model evaluation commonly relies on high-dimensional embedding spaces to compute distances between samples. We show that dataset representations in these spaces are affected by the hubness phenomenon, which distorts nearest-neighbor rela...
366. RAT+: Train Dense, Infer Sparse -- Recurrence Augmented Attention for Dilated Inference
Author: Xiuying Wei, Caglar Gulcehre
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2602.18196v5 Announce Type: replace Abstract: Structured dilated attention has an appealing inference-time efficiency knob: it reduces the FLOPs of attention and the KV cache size by a factor of the dilation size D, while preserving long-range connectivity. While prior work studies it by train...
367. Is Your Diffusion Sampler Actually Correct? A Sampler-Centric Evaluation of Discrete Diffusion Language Models
Author: Luhan Tang, Longxuan Yu, Shaorong Zhang, Greg Ver Steeg
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2602.19619v2 Announce Type: replace Abstract: Discrete diffusion language models (dLLMs) provide a fast and flexible alternative to autoregressive models (ARMs) via iterative denoising with parallel updates. However, their evaluation is challenging: existing metrics conflate denoiser approxima...
368. Routing by Reaching: Composition of Pre-trained GFlowNets for Multi-Objective Generation
Author: Seokwon Yoon, Youngbin Choi, Seunghyuk Cho, Seungbeom Lee, MoonJeong Park, Dongwoo Kim
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2602.21565v2 Announce Type: replace Abstract: Generative Flow Networks (GFlowNets) learn to sample diverse candidates in proportion to a reward function, making them well-suited for scientific discovery, where exploring multiple promising solutions is crucial. Further extending GFlowNets to mu...
369. Improving Full Waveform Inversion in Large Model Era
Author: Yinan Feng, Peng Jin, Yuzhe Guo, Yinpeng Chen, Youzuo Lin
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2603.00377v2 Announce Type: replace Abstract: Full Waveform Inversion (FWI) is a highly nonlinear and ill-posed problem that aims to recover subsurface velocity maps from surface-recorded seismic waveforms data. Existing data-driven FWI typically uses small models, as available datasets have l...
370. Rooted Absorbed Prefix Trajectory Balance with Submodular Replay for GFlowNet Training
Author: Xi Wang, Wenbo Lu, Shengjie Wang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2603.00454v2 Announce Type: replace Abstract: Generative Flow Networks (GFlowNets) enable fine-tuning large language models to approximate reward-proportional posteriors, but they remain prone to mode collapse, manifesting as prefix collapse and length bias. We attribute this to two factors: (...
371. Relational In-Context Learning via Synthetic Pre-training with Structural Prior
Author: Yanbo Wang, Jiaxuan You, Chuan Shi, Muhan Zhang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.DB
arXiv:2603.03805v5 Announce Type: replace Abstract: Relational Databases (RDBs) are the backbone of modern business, yet they lack foundation models comparable to those in text or vision. A key obstacle is that high-quality RDBs are private, scarce, and structurally heterogeneous, making internet-sc...
372. Non-Euclidean Gradient Descent Operates at the Edge of Stability
Author: Rustem Islamov, Michael Crawshaw, Jeremy Cohen, Robert Gower
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, math.OC, stat.ML
arXiv:2603.05002v2 Announce Type: replace Abstract: The Edge of Stability (EoS) is a phenomenon where the sharpness (largest eigenvalue) of the Hessian approaches and then hovers near the stability threshold $2/\eta$ during gradient descent (GD) with step size $\eta$. Despite (apparently) violating ...
373. Sparse Scheduled Diffusion Guidance for Inverse Problems
Author: Abduragim Shtanchaev, Albina Ilina, Yazid Janati, Arip Asadulaev, Martin Takac, Eric Moulines
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2603.07860v3 Announce Type: replace Abstract: Pretrained diffusion models are effective priors for Bayesian inverse problems, but posterior sampling with these priors is often costly because data-consistency guidance is applied throughout the full reverse trajectory. Existing methods have show...
374. Muscle Synergy Priors Enhance Biomechanical Fidelity in Predictive Musculoskeletal Locomotion Simulation
Author: Ilseung Park (Carnegie Mellon University), Eunsik Choi (Seoul National University), Jangwhan Ahn (UNC-Chapel Hill and NC State University), Jooeun Ahn (Seoul National University)
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.NE, cs.RO
arXiv:2603.10474v2 Announce Type: replace Abstract: Human locomotion emerges from high-dimensional neuromuscular control, making predictive musculoskeletal simulation challenging. We present a physiology-informed reinforcement-learning framework that constrains control using muscle synergies. We ext...
375. Jailbreak Scaling Laws for Large Language Models: Polynomial-Exponential Crossover
Author: Indranil Halder, Annesya Banerjee, Cengiz Pehlevan
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2603.11331v3 Announce Type: replace Abstract: Adversarial attacks can reliably steer safety-aligned large language models toward unsafe behavior. Empirically, we find that adversarial prompt-injection attacks can amplify attack success rate from the slow polynomial growth observed without inje...
376. Enhancing LLM Training via Spectral Clipping
Author: Xiaowen Jiang, Andrei Semenov, Sebastian U. Stich
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, math.OC
arXiv:2603.14315v2 Announce Type: replace Abstract: While spectral-based optimizers like Muon operate directly on the spectrum of updates, standard adaptive methods such as AdamW do not account for the spectral structure of weights and gradients, leaving them vulnerable to two empirical issues in la...
377. Maximizing Mutual Information Between Prompt and Response Improves LLM Performance With No Additional Data
Author: Hyunji Nam, Haoran Li, Natasha Jaques
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL
arXiv:2603.19294v3 Announce Type: replace Abstract: While post-training has successfully improved large language models (LLMs) across a variety of domains, these gains heavily rely on human-labeled data or external verifiers. Existing data has already been exploited, and new data is expensive to col...
378. Path-Space Mirror Descent for On-Policy Reinforcement Learning under the Generalized Schr\"odinger Bridge
Author: Yuehu Gong, Zeyuan Wang, Yulin Chen, Shutong Ding, Qingyuan Zhou, Yanwei Fu
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2603.21621v2 Announce Type: replace Abstract: Classical on-policy algorithms such as PPO and mirror descent policy optimization provide stable proximal policy updates through tractable action likelihoods, but are typically instantiated with simple Gaussian policies whose expressiveness can be ...
379. Learning Safely Without Knowing the World:COMPASS-Hedge
Author: Ting Hu, Luanda Cai, Emmanouil-Vasileios Vlatakis-Gkaragkounis
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.GT
arXiv:2603.22348v4 Announce Type: replace Abstract: Online learning algorithms often face a fundamental trilemma: balancing regret guarantees between adversarial and stochastic settings and providing baseline safety against a fixed comparator. While existing methods excel in one or two of these regi...
380. Accelerating trajectory optimization with Sobolev-trained diffusion policies
Author: Th'eotime Le Hellard, Franki Nguimatsia Tiofack, Quentin Le Lidec, Justin Carpentier
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.RO
arXiv:2604.19011v2 Announce Type: replace Abstract: Trajectory Optimization (TO) solvers exploit known system dynamics to compute locally optimal trajectories through iterative improvements. A downside is that each new problem instance is solved independently; therefore, convergence speed and qualit...
381. Graph Memory Transformer (GMT)
Author: Nicola Zanarini, Niccol`o Ferrari, Evelina Lamma
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL
arXiv:2604.23862v3 Announce Type: replace Abstract: We investigate whether the Feed-Forward Network (FFN) sublayer in a decoder-only transformer can be replaced by an explicit learned memory graph while preserving the surrounding autoregressive architecture. The proposed Graph Memory Transformer (GM...
382. Negative Ontology of True Target for Machine Learning: Towards Evaluation and Learning under Democratic Supervision
Author: Yongquan Yang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2604.24824v5 Announce Type: replace Abstract: This article philosophically examines how shifts in assumptions regarding the existence and non-existence of the true target (TT) give rise to new perspectives and insights for machine learning (ML)-based predictive modeling and, correspondingly, p...
383. Advancing multi-site emission control: A physics-informed transfer learning framework with mixture of experts for carbon-pollutant synergy
Author: Yuxuan Ying, Hanqing Yang, Kaige Wang, Yu Hu, Zhiming Zheng, Yunliang Jiang, Xiaoqing Lin, Xiaodong Li, Jun Chen
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, physics.chem-ph, physics.data-an
arXiv:2604.26571v2 Announce Type: replace Abstract: Municipal solid waste incineration (MSWI) converts urban waste to energy but simultaneously emits carbon dioxide, carbon monoxide and multiple regulated air pollutants whose formation is tightly coupled within a single combustion system. Controllin...
384. CompleteRXN: Toward Completing Open Chemical Reaction Databases
Author: Gabriel Vogel, Minouk Noordsij, Evgeny Pidko, Jana M. Weber
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, physics.chem-ph
arXiv:2605.00222v2 Announce Type: replace Abstract: Chemical reaction datasets such as USPTO suffer from substantial incompleteness, frequently missing byproducts, co-reactants, and stoichiometric coefficients. This limits their applicability and reliability in downstream applications. Here, we intr...
385. Stable-GFlowNet: Toward Diverse and Robust LLM Red-Teaming via Contrastive Trajectory Balance
Author: Minchan Kwon, Sunghyun Baek, Minseo Kim, Jaemyung Yu, Dongyoon Han, Junmo Kim
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.00553v2 Announce Type: replace Abstract: Large Language Model (LLM) Red-Teaming, which proactively identifies vulnerabilities of LLMs, is an essential process for ensuring safety. Finding effective and diverse attacks in red-teaming is important, but achieving both is challenging. Generat...
386. Aitchison Embeddings for Learning Compositional Graph Representations
Author: Nikolaos Nakis, Chrysoula Kosma, Panagiotis Promponas, Michail Chatzianastasis, Giannis Nikolentzos
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.SI
arXiv:2605.00716v2 Announce Type: replace Abstract: Representation learning is central to graph machine learning, powering tasks such as link prediction and node classification. However, most graph embeddings are hard to interpret, offering limited insight into how learned features relate to graph s...
387. Towards Efficient and Expressive Offline RL via Flow-Anchored Noise-conditioned Q-Learning
Author: Sungyoung Lee, Dohyeong Kim, Eshan Balachandar, Zelal Su Mustafaoglu, Keshav Pingali
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.RO
arXiv:2605.01663v2 Announce Type: replace Abstract: We propose Flow-Anchored Noise-conditioned Q-Learning (FAN), a highly efficient and high-performing offline reinforcement learning (RL) algorithm. Recent work has shown that expressive flow policies and distributional critics improve offline RL per...
388. Statistical Consistency and Generalization of Contrastive Representation Learning
Author: Yuanfan Li, Xiyuan Wei, Tianbao Yang, Yiming Ying
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.02116v3 Announce Type: replace Abstract: Contrastive representation learning (CRL) underpins many modern foundation models. Despite recent theoretical progress, existing analyses suffer from several key limitations: (i) the statistical consistency of CRL remains poorly understood; (ii) av...
389. Transformed Latent Variable Multi-Output Gaussian Processes
Author: Xiaoyu Jiang, Xinxing Shi, Sokratia Georgaka, Magnus Rattray, Mauricio A 'Alvarez
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.05133v3 Announce Type: replace Abstract: Multi-Output Gaussian Processes (MOGPs) provide a principled probabilistic framework for modelling correlated outputs but face scalability bottlenecks when applied to datasets with high-dimensional output spaces. To maintain tractability, existing ...
390. Uncertainty Estimation via Hyperspherical Confidence Mapping
Author: Eunseo Choi, Ho-Yeon Kim, Jaewon Lee, Taeyong jo, Myungjun lee, Heejin Ahn
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.05964v2 Announce Type: replace Abstract: Quantifying uncertainty in neural network predictions is essential for high-stakes domains such as autonomous driving, healthcare, and manufacturing. While existing approaches often depend on costly sampling or restrictive distributional assumption...
391. SMolLM: Small Language Models Learn Small Molecular Grammar
Author: Akhil Jindal, Harang Ju
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.06322v2 Announce Type: replace Abstract: Language models for molecular design have scaled to hundreds of millions of parameters, yet how they learn chemical grammar is poorly understood. We train SMolLM, a 53K-parameter weight-shared transformer, to generate novel SMILES with 95% validity...
392. Order-Agnostic Autoregressive Modelling with Missing Data
Author: Ignacio Peis, Pablo M. Olmos, Jes Frellsen
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2605.06355v2 Announce Type: replace Abstract: Order-Agnostic autoregressive models have demonstrated strong performance in deep generative modeling, yet their use in settings with incomplete data remains largely unexplored. In this work, we reinterpret them through the lens of missing data. Fi...
393. Prune-OPD: Efficient and Reliable On-Policy Distillation for Long-Horizon Reasoning
Author: Zhicheng Yang, Zhijiang Guo, Yifan Song, Minrui Xu, Yongxin Wang, Yiwei Wang, Xiaodan Liang, Jing Tang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.07804v2 Announce Type: replace Abstract: On-policy distillation (OPD) leverages dense teacher rewards to enhance reasoning models. However, scaling OPD to long-horizon tasks exposes a critical flaw: as the student's generated prefix inevitably diverges from the teacher's thought process, ...
394. PRIM: Meta-Learned Bayesian Root Cause Analysis
Author: Christopher Lohse, Anish Dhir, Amadou Ba, Bradley Eck, Marco Ruffini, Jonas Wahl
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.08786v3 Announce Type: replace Abstract: Root cause analysis (RCA) in complex systems is challenging due to error propagation across multiple variables, the need for structural causal knowledge, and the computational cost of inference at test time. We introduce PRIM (Prior-fitted Root cau...
395. Inpainting physics: self-supervised learning for context-driven fluid simulation
Author: Jonas Weidner, Yeray Martin-Ruisanchez, Daniel Rueckert, Benedikt Wiestler, Julian Suk
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, physics.flu-dyn
arXiv:2605.08832v2 Announce Type: replace Abstract: Neural surrogate models for computational fluid dynamics (CFD) are typically trained as forward operators that map explicit problem specifications, such as geometry and boundary conditions, to solution fields. This ties the model to the conditionin...
396. TopoGeoScore: A Self-Supervised Source-Only Geometric Framework for OOD Checkpoint Selection
Author: Farid Hazratian, Ali Zia, Hien Duy Nguyen
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, math.AT, math.DG
arXiv:2605.08870v2 Announce Type: replace Abstract: Out-of-distribution (OOD) robustness is difficult to diagnose when target-domain labels are unavailable. We consider a more restrictive source-only variant of unsupervised accuracy estimation: selecting robust checkpoints using only source-domain r...
397. Nearly-Optimal Algorithm for Adversarial Kernelized Bandits
Author: Shogo Iwazaki
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.10299v2 Announce Type: replace Abstract: This paper studies kernelized bandits (also known as Gaussian process bandits) in an adversarial environment, where the reward functions in a known reproducing kernel Hilbert space (RKHS) may be adversarially chosen at each round. We show that the ...
398. Teacher-Guided Policy Optimization for On-Policy Reasoning Distillation under Large Policy Divergence
Author: Xinyu Liu, Kechen Jiao, Chunyang Xiao, Runsong Zhao, Junhao Ruan, Bei Li, Jiahao Liu, Qifan Wang, Xin Chen, Jingang Wang, Chenglong Wang, Tong Xiao, JingBo Zhu
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.13230v2 Announce Type: replace Abstract: On-policy distillation (OPD) has become a promising paradigm for reasoning-oriented post-training of large language models (LLMs), especially when combined with reinforcement learning from verifiable rewards (RLVR). Existing OPD methods rely on rev...
399. TabPFN-3: Technical Report
Author: L'eo Grinsztajn, Klemens Fl"oge, Oscar Key, Felix Birkel, Philipp Jund, Brendan Roof, Mihir Manium, Shi Bin Hoo, Magnus B"uhler, Anurag Garg, Dominik Safaric, Jake Robertson, Benjamin J"ager, Simone Alessi, Adrian Hayler, Vladyslav Moroshan, Lennart Purucker, Philipp Singer, Alan Arazi, Julien Siems, Jan Hendrik Metzen, Georg Grab, Nick Erickson, Siyuan Guo, Eliott Kalfon, Simon Bing, David Salinas, Clara Cornu, Lilly Charlotte Wehrhahn, Diana Kriuchkova, Kursat Kaya, Lydia Sidhoum, Marie Salmon, Jerry Chen, Madelon Hulsebos, Yann LeCun, Samuel M"uller, Bernhard Sch"olkopf, Sauraj Gambhir, Noah Hollmann, Frank Hutter
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2605.13986v2 Announce Type: replace Abstract: Tabular data underpins most high-value prediction problems in science and industry, and TabPFN has driven the foundation model revolution for this modality. Designed with feedback from our users, TabPFN-3 builds on this foundation to scale state-of...
400. Latency-Quality Routing for Functionally Equivalent Tools in LLM Agents
Author: Kexin Chu, Dawei Xiang, Wei Zhang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.14241v2 Announce Type: replace Abstract: Tool-augmented LLM agents increasingly access the same tool type through multiple functionally equivalent providers, such as web-search APIs, retrievers, or LLM backends exposed behind a shared interface. This creates a provider-routing problem und...
401. Turning Stale Gradients into Stable Gradients: Coherent Coordinate Descent with Implicit Landscape Smoothing for Lightweight Zeroth-Order Optimization
Author: Chen Liang, Xiatao Sun, Qian Wang, Daniel Rakita
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.14373v3 Announce Type: replace Abstract: Zeroth-Order (ZO) optimization is pivotal for scenarios where backpropagation is unavailable, such as memory-constrained on-device learning and black-box optimization. However, existing methods face a stark trade-off: they are either sample-ineffic...
402. DualKV: Shared-Prompt Flash Attention for Efficient RL Training with Large Rollouts and Long Contexts
Author: Jiading Gai, Shuai Zhang, Xiang Song, Bernie Wang, George Karypis
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.15422v2 Announce Type: replace Abstract: Modern RL post-training methods such as GRPO and DAPO train on $N$ response sequences of $R$ tokens sampled from a shared prompt of $P$ tokens, but standard FlashAttention replicates all $P$ prompt tokens $N$ times across both forward and backward ...
403. To MRL or not to MRL: Text Embeddings are Robust to Truncation Without Matryoshka Learning, Except In Heavy Truncation Scenarios
Author: Sotaro Takeshita, Yurina Takeshita, Simone Paolo Ponzetto, Daniel Ruffinelli
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.CL
arXiv:2605.16608v2 Announce Type: replace Abstract: Matryoshka Representation Learning (MRL) is a widely adopted approach for training text encoders so they provide useful text representations at various sizes, available by simply truncating the resulting vectors at sizes pre-determined at training ...
404. Matryoshka Concept Bottleneck Models
Author: Ziye Chen, Hongbin Lin, Jie Li, Lijie Hu
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.20612v3 Announce Type: replace Abstract: Concept Bottleneck Models (CBMs) have emerged as a prominent paradigm for interpretable deep learning, learning by grounding predictions in human-understandable concepts. However, their practical deployment is hindered by the high cost of test-time...
405. A Tutorial on Diffusion Theory: From Differential Equations to Diffusion Models
Author: Jiayi Fu, Yuxia Wang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.CL
arXiv:2605.22586v3 Announce Type: replace Abstract: Diffusion models have emerged as a dominant framework for generative modeling, but their mathematical foundations are often presented separately through diffusion probabilistic models, score-based modeling, stochastic differential equations, and nu...
406. The Distillation Game: Adaptive Attacks & Efficient Defenses
Author: Youssef Allouah, Mahdi Haghifam, Sanmi Koyejo, Reza Shokri
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.22737v2 Announce Type: replace Abstract: Distillation attacks create a deployment trade-off for model providers: the same outputs that make a model more useful can also make it easier to imitate. We study this trade-off through a minimax game between a utility-constrained teacher and an a...
407. Building a privacy-preserving Federated Recommender system for mobile devices
Author: Aasheesh Singh
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.IR
arXiv:2605.22924v2 Announce Type: replace Abstract: Serving personalized content on mobile devices has traditionally required pooling sensitive user data on centralized servers, a practice increasingly at odds with modern privacy expectations and geographical regulations. We present a two-stage fede...
408. Self-supervised Adversarial Purification for Graph Neural Networks
Author: Woohyun Lee, Hogun Park
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.23239v2 Announce Type: replace Abstract: Defending Graph Neural Networks (GNNs) against adversarial attacks requires balancing accuracy and robustness, a trade-off often mishandled by traditional methods like adversarial training that intertwine these conflicting objectives within a singl...
409. Tiny Brains, Giant Impact: Uncovering the Keystone Neurons of LLM with Just a Few Prompts
Author: Xiangtian Ji, Yuxin Chen, Zhengzhou Cai, Xiang Wang, An Zhang, Tat-Seng Chua
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.24846v2 Announce Type: replace Abstract: Large language models (LLMs) display strong comprehensive abilities, yet the internal mechanisms that support these behaviors remain insufficiently understood. In this work, we show that across a wide range of open-weight Transformers, a subset of ...
410. Theoretical Analysis of Sparse Optimization with Reparameterization, Weight Decay, and Adaptive Learning Rate
Author: Huangyu Xu, Jingqin Yang, Qianqian Xu, Jiaye Teng
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.25134v2 Announce Type: replace Abstract: Sparse optimization is a fundamental challenge in various practical applications. A popular approach to sparse optimization is $\ell_p$ regularization. However, it may encounter optimization instability due to the unbounded gradients when $0<p<1$. ...
411. Autoregression-Free Neural Operators for Time-Dependent PDEs
Author: Jiaquan Zhang, Caiyan Qin, Haoyu Bian, Libin Cai, Yi Lu, Chaoning Zhang, Wei Dong, Yuanfang Guo, Yang Yang, Hen Tao Shen
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.NA, math.NA
arXiv:2605.25413v2 Announce Type: replace Abstract: Neural operators learn mappings from function-dependent inputs to solutions, providing an effective framework for solving partial differential equations (PDEs). For time-dependent PDEs, existing methods typically perform long-horizon prediction thr...
412. GoQuant: Geometric Orthogonal Residual Projection for Multiplier-Free Power-of-Two Transformer Quantization
Author: Maoyang Xiang, Bo Wang, Tao Luo
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.26092v3 Announce Type: replace Abstract: The deployment of Large Language Models (LLMs) and Vision Transformers (ViTs) on edge devices is significantly constrained by memory limitations and the critical timing bottlenecks introduced by dense Multiply-Accumulate (MAC) arrays. In the ultra-...
413. Bridging Classification and Reconstruction: Cooperative Time Series Anomaly Detection
Author: Qideng Tang, Dai Chaofan, Wubin Ma, Yahui Wu, Haohao Zhou, Tao Zhang, Huan Li, Dalin Zhang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.26193v2 Announce Type: replace Abstract: Time series anomaly detection (TSAD) has long been a hot research topic in data mining due to its various applications. Recent studies challenge the effectiveness of popular deep learning methods for TSAD, suggesting their failure in detecting subt...
414. On the Role of Inductive Bias in Time-Series Pretraining: A Case Study in Learning Generalizable Representations for Clinical Time Series
Author: Sharmita Dey, Diego Paez-Granados
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.26194v2 Announce Type: replace Abstract: Clinical time-series learning is routinely constrained by small, heterogeneous cohorts and protocol drift, while its downstream use spans both classification (e.g., pathology diagnosis) and regression (e.g., temporal forecasting). These constraints...
415. Function-Valued Causal Influence in Nonlinear Time Series
Author: Valentina V. Kuskova, Dmitry Zaytsev, Michael Coppedge
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, stat.ME, stat.ML
arXiv:2605.26408v2 Announce Type: replace Abstract: Causal discovery in time series is increasingly performed using nonlinear machine-learning models, yet the resulting causal relationships are almost always summarized by scalar edge scores. We argue that this practice obscures the true object learn...
416. Localizing Memorized Regions in Diffusion Models via Coordinate-Wise Curvature Differences
Author: Gwangho Kim, Sungyoon Lee
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.26756v2 Announce Type: replace Abstract: Diffusion models can unintentionally memorize training samples, raising concerns about privacy and copyright. While recent methods can detect memorization, they often rely on global or model-specific signals and provide limited insight into where m...
417. Two Speeds of Learning: A Representation-Readout Decomposition of Grokking and Double Descent
Author: Chi-Ning Chou, Oscar Uzdelewicz, Neng-Chun Chiu, Yao-Yuan Yang, SueYeon Chung
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.27078v2 Announce Type: replace Abstract: Training loss and accuracy are the standard signals used to monitor generalization during deep neural network training. Two well-documented phenomena complicate this picture: in grokking, train loss falls rapidly while test performance improves abr...
418. Density-aware Sample-specific Attack
Author: Qiyuan Wang, Yao Li, Raymond K. W. Wong
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.CR
arXiv:2605.27809v2 Announce Type: replace Abstract: Despite recent progress in backdoor attacks, existing methods remain susceptible to post-training defenses that erase the backdoor through fine-tuning or pruning. We revisit the core objectives of backdoor attacks and derive principled criteria cha...
419. Continual Learning in Modern Hopfield Networks with an Application to Diffusion Models
Author: Ken Takeda, Masafumi Oizumi, Ryo Karakida
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2605.27975v2 Announce Type: replace Abstract: Generative models, including diffusion models, are increasingly used as foundation models and adapted through sequential fine-tuning, making continual learning an essential problem setting. However, continual learning in such generative models rema...
420. QuITE: Query-Based Irregular Time Series Embedding
Author: JungHoon Lim
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.28166v2 Announce Type: replace Abstract: Irregular Multivariate Time Series (IMTS) are common in practice, yet their irregular sampling complicates effective modeling. Existing approaches typically either (i) design specialized architectures that limit the reuse of proven Multivariate Tim...
421. ProRL: Effective Reinforcement Learning for Proactive Recommendation via Rectified Policy Gradient Estimation
Author: Hongru Hou, Tiehua Mei, Denghui Geng, Jinhui Huang, Ao Xu, Hengrui Chen, Jiaqing Liang, Deqing Yang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.28293v2 Announce Type: replace Abstract: Proactive Recommender Systems (PRSs) aim to guide user preference shift toward target items by generating paths of intermediate recommendations. Reinforcement learning (RL) provides a principled framework for optimizing such sequential decision tas...
422. LEIA: Learned Environment for Interactive Architected Materials
Author: Haiqian Yang, Yuan Cao, Markus J. Buehler
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG, cond-mat.mtrl-sci, physics.app-ph
arXiv:2605.28368v2 Announce Type: replace Abstract: World models have enabled interactive exploration of game environments and robotic manipulation, but physical engineering remains beyond their reach: real materials exhibit nonlinear constitutive laws, carry history-dependent internal state, underg...
423. Revisiting Metafeatures to Explain Model Differences on Tabular Data
Author: Markus Herre, Andrej Tschalzev, Sascha Marton, Christian Bartelt
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.28418v2 Announce Type: replace Abstract: With the rise of tabular foundation models alongside traditional models still performing well on many tasks, choosing the right model for a tabular dataset remains difficult. We investigate whether dataset meta-features can explain performance gaps...
424. Stage-wise Distortion-Perception Traversal in Zero-shot Inverse Problems with Diffusion Models
Author: Jiawei Zhang, Ziyuan Liu, Leon Yan, Zhenyu Xiao, Yuantao Gu
Published: 5/29/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.28711v2 Announce Type: replace Abstract: The distortion-perception (D-P) tradeoff is a fundamental phenomenon of Bayesian inverse problems, which characterizes the inherent tension between distortion performance and perceptual quality. Enabling flexible traversal of the D-P tradeoff at in...
425. CompilerDream: Learning a Compiler World Model for General Code Optimization
Author: Chaoyi Deng, Jialong Wu, Ningya Feng, Jianmin Wang, Mingsheng Long
Published: 5/29/2026, 4:00:00 AM
Categories: cs.PL, cs.LG
arXiv:2404.16077v4 Announce Type: replace-cross Abstract: Effective code optimization in compilers is crucial for computer and software engineering. The success of these optimizations primarily depends on the selection and ordering of the optimization passes applied to the code. While most compilers...
426. Early Detection of Misinformation for Infodemic Management: A Domain Adaptation Approach
Author: Minjia Mao, Xiaohang Zhao, Xiao Fang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CL, cs.LG, cs.SI
arXiv:2406.10238v2 Announce Type: replace-cross Abstract: An infodemic refers to an enormous amount of true information and misinformation disseminated during a disease outbreak. Detecting misinformation at the early stage of an infodemic is key to reduce its harm to public health. An early stage in...
427. Jailbreaking and Mitigation of Vulnerabilities in Large Language Models
Author: Benji Peng, Hanxuan Chen, Keyu Chen, Qian Niu, Ziqian Bi, Ming Liu, Pohsun Feng, Tianyang Wang, Lawrence K. Q. Yan, Yizhu Wen, Yichao Zhang, Caitlyn Heqi Yin, Xinyuan Song, Riyang Bao, Jiacheng Shi
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CR, cs.AI, cs.LG
arXiv:2410.15236v4 Announce Type: replace-cross Abstract: Large Language Models (LLMs) have transformed artificial intelligence by advancing natural language understanding and generation, enabling applications across fields beyond healthcare, software engineering, and conversational systems. Despite...
428. Optimal Query Allocation in Extractive QA with LLMs: A Learning-to-Defer Framework with Theoretical Guarantees
Author: Yannis Montreuil, Shu Heng Yeo, Axel Carlier, Lai Xing Ng, Wei Tsang Ooi
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CL, cs.LG, stat.ML
arXiv:2410.15761v5 Announce Type: replace-cross Abstract: Large Language Models excel in generative tasks but exhibit inefficiencies in structured text selection, particularly in extractive question answering. This challenge is magnified in resource-constrained environments, where deploying multiple...
429. Noise-Aware Differentially Private Variational Inference
Author: Talal Alrawajfeh, Joonas J"alk"o, Antti Honkela
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.CR, cs.LG
arXiv:2410.19371v3 Announce Type: replace-cross Abstract: Differential privacy (DP) provides robust privacy guarantees for statistical inference, but this can lead to unreliable results and biases in downstream applications. While several noise-aware approaches have been proposed which integrate DP ...
430. Neural Networks and (Virtual) Extended Formulations
Author: Christoph Hertrich, Georg Loho
Published: 5/29/2026, 4:00:00 AM
Categories: math.CO, cs.CC, cs.DM, cs.LG, math.OC
arXiv:2411.03006v4 Announce Type: replace-cross Abstract: Neural networks with piecewise linear activation functions, such as rectified linear units (ReLU) or maxout, are among the most fundamental models in modern machine learning. We make a step towards proving lower bounds on the size of such neu...
431. Weakly Supervised Detection and Temporal Localization of Whale Calls in Long-Duration Bioacoustic Data
Author: Ragib Amin Nihal, Benjamin Yen, Runwu Shi, Takeshi Ashizawa, Kazuhiro Nakadai
Published: 5/29/2026, 4:00:00 AM
Categories: cs.SD, cs.AI, cs.LG, eess.AS
arXiv:2502.20838v3 Announce Type: replace-cross Abstract: Passive acoustic monitoring (PAM) systems generate continuous recordings spanning months, yet automated bioacoustic analysis of whale calls requires two separate annotation efforts: binary presence labels for classification and precise tempor...
432. Enhancing Membership Inference Attacks on Diffusion Models from a Frequency-Domain Perspective
Author: Puwei Lian, Yujun Cai, Songze Li, Bingkun Bao
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CR, cs.LG
arXiv:2505.20955v4 Announce Type: replace-cross Abstract: Diffusion models have achieved tremendous success in image generation, but they also raise significant concerns regarding privacy and copyright issues. Membership Inference Attacks (MIAs) are designed to ascertain whether specific data was ut...
433. Is Your LLM Overcharging You? Tokenization, Transparency, and Incentives
Author: Ander Artola Velasco, Stratis Tsirtsis, Nastaran Okati, Manuel Gomez-Rodriguez
Published: 5/29/2026, 4:00:00 AM
Categories: cs.GT, cs.AI, cs.CY, cs.LG
arXiv:2505.21627v4 Announce Type: replace-cross Abstract: State-of-the-art large language models require specialized hardware and substantial energy to operate. As a consequence, cloud-based services that provide access to large language models have become very popular. In these services, the price ...
434. Position: Stop Chasing the C-index when Evaluating Survival Analysis Models
Author: Christian Marius Lillelund, Shi-ang Qi, Russell Greiner, Christian Fischer Pedersen
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ME, cs.LG
arXiv:2506.02075v2 Announce Type: replace-cross Abstract: The current state of evaluation in survival analysis is plagued by the persistent use of evaluation metrics in ways that are misaligned with the stated modeling objective. In addition, many such evaluations are based on censoring assumptions ...
435. MVP-Shapley: Feature-based Modeling for Evaluating the Most Valuable Player in Basketball
Author: Haifeng Sun, Yu Xiong, Runze Wu, Kai Wang, Lan Zhang, Changjie Fan, Shaojie Tang, Xiang-Yang Li
Published: 5/29/2026, 4:00:00 AM
Categories: cs.GT, cs.LG
arXiv:2506.04602v4 Announce Type: replace-cross Abstract: The burgeoning growth of the esports and multiplayer online gaming community has highlighted the critical importance of evaluating the Most Valuable Player (MVP). The establishment of an explainable and practical MVP evaluation method is very...
436. PersonaAgent: Bridging Memory and Action for Personalized LLM Agents
Author: Weizhi Zhang, Xinyang Zhang, Chenwei Zhang, Liangwei Yang, Jingbo Shang, Zhepei Wei, Henry Peng Zou, Zijie Huang, Zhengyang Wang, Yifan Gao, Xiaoman Pan, Lian Xiong, Jingguo Liu, Philip S. Yu, Xian Li
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.CL, cs.LG
arXiv:2506.06254v2 Announce Type: replace-cross Abstract: Large Language Model (LLM) empowered agents have recently emerged as advanced paradigms that exhibit impressive capabilities in a wide range of domains and tasks. Despite their potential, current LLM agents often adopt a one-size-fits-all app...
437. A Complete Loss Landscape Analysis of Regularized Deep Matrix Factorization
Author: Po Chen, Rujun Jiang, Peng Wang
Published: 5/29/2026, 4:00:00 AM
Categories: math.OC, cs.LG
arXiv:2506.20344v3 Announce Type: replace-cross Abstract: Despite its wide range of applications across various domains, the optimization foundations of deep matrix factorization (DMF) remain largely open. In this work, we aim to fill this gap by conducting a comprehensive study of the loss landscap...
438. Taming Data Challenges in ML-based Security Tasks Using Generative AI
Author: Shravya Kanchi, Neal Mangaokar, Aravind Cheruvu, Sifat Muhammad Abdullah, Shirin Nilizadeh, Atul Prakash, Bimal Viswanath
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CR, cs.AI, cs.LG
arXiv:2507.06092v4 Announce Type: replace-cross Abstract: Machine learning-based supervised classifiers are widely used for security tasks, and their improvement has been largely focused on algorithmic advancements. We argue that data challenges that negatively impact the performance of these classi...
439. Finding DoRI: Discovery of Retained Images in Diffusion Models
Author: Antoni Kowalczuk, Dominik Hintersdorf, Lukas Struppek, Kristian Kersting, Adam Dziedzic, Franziska Boenisch
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CV, cs.AI, cs.LG
arXiv:2507.16880v3 Announce Type: replace-cross Abstract: Text-to-image diffusion models (DMs) have achieved remarkable success in image generation. However, concerns about data privacy and intellectual property remain due to their potential to inadvertently memorize and replicate training data. Rec...
440. From Sublinear to Linear: Local Convergence in Finite-Width Networks via Locally Polyak-Lojasiewicz Regions
Author: Agnideep Aich, Ashit Baran Aich, Bruce Wade
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:2507.21429v3 Announce Type: replace-cross Abstract: We study local linear convergence of gradient descent for finite-width feedforward networks under the squared empirical loss. Prior work shows that GD can remain confined to a Locally Quasi-Convex Region (LQCR) around initialization, but only...
441. Risk-averse Fair Multi-class Classification
Author: Darinka Dentcheva, Xiangyu Tian
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.LG, math.OC
arXiv:2509.05771v2 Announce Type: replace-cross Abstract: We develop a new classification framework based on the theory of coherent risk measures and systemic risk. The proposed approach is suitable for multi-class problems when the data is noisy, scarce (relative to the dimension of the problem), a...
442. SADA: Safe and Adaptive Aggregation of Multiple Black-Box Predictions in Semi-Supervised Learning
Author: Jiawei Shan, Zhifeng Chen, Yiming Dong, Yazhen Wang, Jiwei Zhao
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.LG, stat.ME
arXiv:2509.21707v3 Announce Type: replace-cross Abstract: Semi-supervised learning (SSL) arises in practice when labeled data are scarce or expensive to obtain, while large quantities of unlabeled data are readily available. With the growing adoption of machine learning techniques, it has become inc...
443. Estimating the Empowerment of Language Model Agents
Author: Jinyeop Song, Jeff Gore, Max Kleiman-Weiner
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.LG
arXiv:2509.22504v3 Announce Type: replace-cross Abstract: As language model (LM) agents become increasingly capable and adopted in real-world applications, there is a growing need for scalable evaluation frameworks beyond costly, manually designed benchmarks. We propose information-theoretic evaluat...
444. SpeedCP: Fast Kernel-based Conditional Conformal Prediction
Author: Yating Liu, Yeo Jin Jung, Zixuan Wu, So Won Jeong, Claire Donnat
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ME, cs.LG
arXiv:2509.24100v2 Announce Type: replace-cross Abstract: Conformal prediction provides distribution-free prediction sets with finite-sample conditional guarantees. We build upon the RKHS-based framework of Gibbs et al. (2023), which leverages families of covariate shifts to provide approximate cond...
445. Contrastive Representation Regularization for Vision-Language-Action Models
Author: Taeyoung Kim, Jimin Lee, Myungkyu Koo, Dongyoung Kim, Kyungmin Lee, Changyeon Kim, Younggyo Seo, Jinwoo Shin
Published: 5/29/2026, 4:00:00 AM
Categories: cs.RO, cs.LG
arXiv:2510.01711v3 Announce Type: replace-cross Abstract: Vision-Language-Action (VLA) models have shown strong capabilities in robot manipulation by leveraging rich representations from pre-trained Vision-Language Models (VLMs). However, their representations arguably remain suboptimal, lacking sen...
446. Controlling the Risk of Corrupted Contexts for Language Models via Early-Exiting
Author: Andrea Wynn, Metod Jazbec, Charith Peris, Rinat Khaziev, Anqi Liu, Daniel Khashabi, Eric Nalisnick
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.LG
arXiv:2510.02480v3 Announce Type: replace-cross Abstract: Large language models (LLMs) can be influenced by harmful or irrelevant context, which can significantly harm model performance on downstream tasks. This motivates principled designs in which LLM systems include built-in mechanisms to guard a...
447. TelecomTS: A Multi-Modal Observability Dataset for Time Series and Language Analysis
Author: Austin Feng, Andreas Varvarigos, Ioannis Panitsas, Daniela Fernandez, Jinbiao Wei, Yuwei Guo, Jialin Chen, Ali Maatouk, Leandros Tassiulas, Rex Ying
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.IT, cs.LG, math.IT
arXiv:2510.06063v3 Announce Type: replace-cross Abstract: Modern enterprises generate vast streams of time series metrics when monitoring complex systems, known as observability data. Unlike conventional time series from domains such as climate, observability data are zero-inflated, highly stochasti...
448. Permutation-Invariant Spectral Learning via Dyson Diffusion
Author: Tassilo Schwarz, Cai Dieball, Constantin Kogler, Renaud Lambiotte, Arnaud Doucet, Alja\v{z} Godec, George Deligiannidis
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.LG, math.PR
arXiv:2510.08535v2 Announce Type: replace-cross Abstract: Diffusion models are central to generative modeling and have been adapted to graphs by diffusing adjacency matrix representations. The challenge of having up to $n!$ such representations for graphs with $n$ nodes is only partially mitigated b...
449. Calibrating Generative Models to Distributional Constraints
Author: Henry D. Smith, Nathaniel L. Diamant, Brian L. Trippe
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.LG, q-bio.BM
arXiv:2510.10020v4 Announce Type: replace-cross Abstract: Generative models frequently suffer miscalibration, wherein statistics of the sampling distribution, such as the fraction of generations in a given class, deviate from desired values. We frame calibration as a constrained optimization problem...
450. Adversarial Robustness in One-Stage Learning-to-Defer
Author: Yannis Montreuil, Letian Yu, Axel Carlier, Lai Xing Ng, Wei Tsang Ooi
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:2510.10988v3 Announce Type: replace-cross Abstract: Learning-to-Defer (L2D) enables hybrid decision-making by routing inputs either to a predictor or to external experts. While promising, L2D is highly vulnerable to adversarial perturbations, which can not only flip predictions but also manipu...
451. Follow-the-Perturbed-Leader for Decoupled Bandits: Best-of-Both-Worlds and Practicality
Author: Chaiwon Kim, Jongyeong Lee, Min-hwan Oh
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:2510.12152v2 Announce Type: replace-cross Abstract: We study the decoupled multi-armed bandit problem, where the learner separately selects one arm for exploration and one, possibly different, arm for exploitation at each round. In this setting, the loss of the explored arm is observed but not...
452. CodeEvolve: an open source evolutionary coding agent for algorithmic discovery and optimization
Author: Henrique Assump\c{c}~ao, Diego Ferreira, Leandro Campos, Fabricio Murai
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.LG, cs.NE
arXiv:2510.14150v5 Announce Type: replace-cross Abstract: We introduce CodeEvolve, an open-source framework that couples large language models with island-based evolutionary search for end-to-end algorithmic discovery. CodeEvolve integrates inspiration-based crossover, meta-prompting, and depth-base...
453. Singularity-free dynamical invariants-based quantum control
Author: Ritik Sareen, Akram Youssry, Alberto Peruzzo
Published: 5/29/2026, 4:00:00 AM
Categories: quant-ph, cs.LG, cs.SY, eess.SY
arXiv:2510.15340v2 Announce Type: replace-cross Abstract: State preparation is a cornerstone of quantum technologies, underpinning applications in computation, communication, and sensing. Its importance becomes even more pronounced in non-Markovian open quantum systems, where environmental memory an...
454. Modality Alignment across Trees on Heterogeneous Hyperbolic Manifolds
Author: Wei Wu, Xiaomeng Fan, Yuwei Wu, Zhi Gao, Pengxiang Li, Yunde Jia, Mehrtash Harandi
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2510.27391v2 Announce Type: replace-cross Abstract: Modality alignment is critical for vision-language models (VLMs) to effectively integrate information across modalities. However, existing methods extract hierarchical features from text while representing each image with a single feature, le...
455. Bayesian model selection and misspecification testing in imaging inverse problems only from noisy and partial measurements
Author: Tom Sprunck, Marcelo Pereyra, Tobias Liaudat
Published: 5/29/2026, 4:00:00 AM
Categories: eess.IV, cs.LG, stat.ME, stat.ML
arXiv:2510.27663v3 Announce Type: replace-cross Abstract: Modern imaging techniques heavily rely on Bayesian statistical models to address difficult image reconstruction and restoration tasks. This paper addresses the objective evaluation of such models in settings where ground truth is unavailable,...
456. An accuracy-aware extension to LRP-based pruning for CNNs to prevent cascading accuracy degradation in data-scarce transfer learning
Author: Daisuke Yasui, Toshitaka Matsuki, Hiroshi Sato
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CV, cs.AI, cs.LG
arXiv:2511.10861v3 Announce Type: replace-cross Abstract: Convolutional Neural Networks (CNNs) pre-trained on large-scale datasets such as ImageNet are widely used as feature extractors to construct high-accuracy classification models from scarce data for specific tasks. In such scenarios, fine-tuni...
457. A Computational Method for Solving the Stochastic Joint Replenishment Problem in High Dimensions
Author: Bar{\i}\c{s} Ata, Wouter van Eekelen, Yuan Zhong
Published: 5/29/2026, 4:00:00 AM
Categories: math.OC, cs.LG
arXiv:2511.11830v2 Announce Type: replace-cross Abstract: We consider a discrete-time formulation for a class of high-dimensional stochastic joint replenishment problems. First, we approximate the problem by a continuous-time impulse control problem. Exploiting connections among the impulse control ...
458. Diffusion differentiable resampling
Author: Jennifer Rosina Andersson, Zheng Zhao
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.LG, math.ST, stat.TH
arXiv:2512.10401v3 Announce Type: replace-cross Abstract: This paper is concerned with differentiable resampling in the context of sequential Monte Carlo (e.g., particle filtering). Drawing on reparametrisation, we propose a new resampling method that is informative and instantly differentiable, bas...
459. A Deep Learning Model of Mental Rotation Informed by Interactive VR Experiments
Author: Raymond Khazoum, Daniela Fernandes, Aleksandr Krylov, Qin Li, Stephane Deny
Published: 5/29/2026, 4:00:00 AM
Categories: q-bio.NC, cs.LG
arXiv:2512.13517v2 Announce Type: replace-cross Abstract: Mental rotation -- the ability to compare objects seen from different viewpoints -- is a fundamental example of mental simulation and spatial world modeling in humans. Here we propose a mechanistic model of human mental rotation, leveraging r...
460. Differential syntactic and semantic encoding in LLMs
Author: Santiago Acevedo, Alessandro Laio, Marco Baroni
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG, physics.comp-ph
arXiv:2601.04765v5 Announce Type: replace-cross Abstract: We study how syntactic and semantic information is encoded in inner layer representations of Large Language Models (LLMs), focusing on the very large DeepSeek-V3. We find that, by averaging hidden-representation vectors of sentences sharing s...
461. From Rubrics to Reliable Scores: Evidence-Grounded Text Evaluation with LLM Judges
Author: Yihan Hong, Huaiyuan Yao, Bolin Shen, Wanpeng Xu, Hua Wei, Yushun Dong
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG
arXiv:2601.08654v2 Announce Type: replace-cross Abstract: Rubric-based text evaluation increasingly uses large language models (LLMs) as scalable judges, but aligning frozen black-box models with human scoring standards remains challenging. We formulate this challenge as a criteria-transfer problem:...
462. Solving the Offline and Online Min-Max Problem of Non-smooth Submodular-Concave Functions: A Zeroth-Order Approach
Author: Amir Ali Farzin, Yuen-Man Pun, Philipp Braun, Tyler Summers, Iman Shames
Published: 5/29/2026, 4:00:00 AM
Categories: math.OC, cs.LG, cs.NA, math.NA
arXiv:2601.21243v2 Announce Type: replace-cross Abstract: We consider max-min and min-max problems with objective functions that are possibly non-smooth, submodular with respect to the minimiser and concave with respect to the maximiser. We investigate the performance of a zeroth-order method applie...
463. Procedural Pretraining: Warming Up Language Models with Abstract Data
Author: Liangze Jiang, Zachary Shinnick, Anton van den Hengel, Hemanth Saratchandran, Damien Teney
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CL, cs.LG
arXiv:2601.21725v2 Announce Type: replace-cross Abstract: Pretraining language models directly on web-scale corpora is the de facto paradigm. We study an alternative where the model is initially exposed to abstract structured data to ease the subsequent acquisition of rich semantic knowledge, much l...
464. Reasoning about Reasoning: BAPO Bounds on Chain-of-Thought Token Complexity in LLMs
Author: Kiran Tomlinson, Tobias Schnabel, Adith Swaminathan, Jennifer Neville
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.FL, cs.LG
arXiv:2602.02909v2 Announce Type: replace-cross Abstract: Inference-time scaling via chain-of-thought (CoT) reasoning is a major driver of state-of-the-art LLM performance, but it comes with substantial latency and compute costs. We address a fundamental theoretical question: how many reasoning toke...
465. Envy-Free Allocation of Indivisible Goods via Noisy Queries
Author: Zihan Li, Yan Hao Ling, Jonathan Scarlett, Warut Suksompong
Published: 5/29/2026, 4:00:00 AM
Categories: cs.GT, cs.IT, cs.LG, math.IT, stat.ML
arXiv:2602.06361v2 Announce Type: replace-cross Abstract: We introduce a problem of fairly allocating indivisible goods (items) in which the agents' valuations cannot be observed directly, but instead can only be accessed via noisy queries. In the two-agent setting with Gaussian noise and bounded va...
466. Aggregate Models, Not Explanations: Improving Feature Importance Estimation
Author: Joseph Paillard, Angel Reyero Lobo, Denis A. Engemann, Bertrand Thirion
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:2602.11760v2 Announce Type: replace-cross Abstract: Feature-importance methods show promise in transforming machine learning models from predictive engines into tools for scientific discovery. However, due to data sampling and algorithmic stochasticity, expressive models can be unstable, leadi...
467. Securing SIM-Assisted Wireless Networks via Quantum Reinforcement Learning
Author: Le-Hung Hoang, Quang-Trung Luu, Dinh Thai Hoang, Diep N. Nguyen, Van-Dinh Nguyen
Published: 5/29/2026, 4:00:00 AM
Categories: cs.NI, cs.LG
arXiv:2602.13238v2 Announce Type: replace-cross Abstract: Stacked intelligent metasurfaces (SIMs) have recently emerged as a powerful wave-domain technology that enables multi-stage manipulation of electromagnetic signals through multilayer programmable architectures. While SIMs offer unprecedented ...
468. Benchmarking at the Edge of Comprehension
Author: Samuele Marro, Jialin Yu, Emanuele La Malfa, Oishi Deb, Jiawei Li, Yibo Yang, Ebey Abraham, Sunando Sengupta, Eric Sommerlade, Michael Wooldridge, Philip Torr
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.LG
arXiv:2602.14307v3 Announce Type: replace-cross Abstract: As frontier Large Language Models (LLMs) increasingly saturate new benchmarks shortly after they are published, benchmarking itself is at a juncture: if frontier models keep improving, it will become increasingly hard for humans to generate d...
469. Faster Molecular Dynamics with Neural Network Potentials via Distilled Multiple Time-Stepping and Non-Conservative Forces
Author: Nicola"i Gouraud, C^ome Cattin, Thomas Pl'e, Olivier Adjoua, Louis Lagard`ere, Jean-Philip Piquemal
Published: 5/29/2026, 4:00:00 AM
Categories: physics.chem-ph, cs.LG
arXiv:2602.14975v3 Announce Type: replace-cross Abstract: Following our previous work (J. Phys. Chem. Lett., 2026, 17, 5, 1288-1295), we propose the DMTS-NC approach, a distilled multi-time-step (DMTS) strategy using non-conservative (NC) forces to further accelerate atomistic molecular dynamics sim...
470. The Vision Wormhole: Latent-Space Communication in Heterogeneous Multi-Agent Systems
Author: Xiaoze Liu, Ruowang Zhang, Weichen Yu, Siheng Xiong, Liu He, Feijie Wu, Hoin Jung, Matt Fredrikson, Xiaoqian Wang, Jing Gao
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CL, cs.CV, cs.LG
arXiv:2602.15382v2 Announce Type: replace-cross Abstract: Multi-Agent Systems (MAS) powered by Large Language Models have unlocked advanced collaborative reasoning, yet they remain bottlenecked by discrete text communication, which imposes runtime overhead and information quantization loss. While la...
471. Who can we trust? LLM-as-a-jury for Comparative Assessment
Author: Mengjie Qian, Guangzhi Sun, Mark J. F. Gales, Kate M. Knill
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG
arXiv:2602.16610v2 Announce Type: replace-cross Abstract: Large language models (LLMs) are increasingly applied as automatic evaluators for natural language generation assessment often using pairwise comparative judgements. Existing approaches typically rely on single judges or aggregate multiple ju...
472. Cross-Chirality Generalization by Axial Vectors for Hetero-Chiral Protein-Peptide Interaction Design
Author: Ziyi Yang, Zitong Tian, Yinjun Jia, Tianyi Zhang, Jiqing Zheng, Hao Wang, Yubu Su, Juncai He, Lei Liu, Yanyan Lan
Published: 5/29/2026, 4:00:00 AM
Categories: q-bio.BM, cs.LG
arXiv:2602.20176v2 Announce Type: replace-cross Abstract: D-peptide binders targeting L-proteins have promising therapeutic potential. Despite rapid advances in machine learning-based target-conditioned peptide design, generating D-peptide binders remains largely unexplored. In this work, we show th...
473. AG-REPA: Causal Layer Selection for Representation Alignment in Audio Flow Matching
Author: Pengfei Zhang, Tianxin Xie, Minghao Yang, Li Liu
Published: 5/29/2026, 4:00:00 AM
Categories: cs.SD, cs.AI, cs.LG, cs.MM
arXiv:2603.01006v2 Announce Type: replace-cross Abstract: REPresentation Alignment (REPA) improves the training of generative flow models by aligning intermediate hidden states with pretrained teacher features, but its effectiveness in token-conditioned audio Flow Matching critically depends on the ...
474. Reasoning Theater: Disentangling Model Beliefs from Chain-of-Thought
Author: Siddharth Boppana, Annabel Ma, Max Loeffler, Raphael Sarfati, Eric Bigelow, Atticus Geiger, Owen Lewis, Jack Merullo
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG
arXiv:2603.05488v4 Announce Type: replace-cross Abstract: We provide evidence of performative chain-of-thought (CoT) in reasoning models, where a model becomes strongly confident in its final answer, but continues generating tokens without revealing its internal belief. Our analysis compares activat...
475. Rel-MOSS: Towards Imbalanced Relational Deep Learning on Relational Databases
Author: Jun Yin, Peng Huo, Bangguo Zhu, Hao Yan, Senzhang Wang, Shirui Pan, Chengqi Zhang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.DB, cs.LG
arXiv:2603.07916v2 Announce Type: replace-cross Abstract: In recent advances, to enable a fully data-driven learning paradigm on relational databases (RDB), relational deep learning (RDL) is proposed to structure the RDB as a heterogeneous entity graph and adopt the graph neural network (GNN) as the...
476. Learning-to-Defer with Expert-Conditional Advice
Author: Yannis Montreuil, Le"ina Montreuil, Axel Carlier, Lai Xing Ng, Wei Tsang Ooi
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:2603.14324v4 Announce Type: replace-cross Abstract: Learning-to-Defer routes each input to the expert that minimizes expected cost, but it assumes that the information available to every expert is fixed at decision time. Many modern systems violate this assumption: after selecting an expert, o...
477. LUMINA: A Multi-Vendor Mammography Benchmark with Energy Harmonization Protocol
Author: Hongyi Pan, Gorkem Durak, Halil Ertugrul Aktas, Andrea M. Bejar, Baver Tutun, Emre Uysal, Ezgi Bulbul, Mehmet Fatih Dogan, Berrin Erok, Berna Akkus Yildirim, Sukru Mehmet Erturk, Ulas Bagci
Published: 5/29/2026, 4:00:00 AM
Categories: eess.IV, cs.CV, cs.DB, cs.LG
arXiv:2603.14644v3 Announce Type: replace-cross Abstract: Publicly available full-field digital mammography (FFDM) datasets remain limited in size, clinical annotations, and vendor diversity, hindering the development of robust models. We introduce LUMINA, a curated, multi-vendor FFDM dataset that e...
478. When Should a Robot Think? Resource-Aware Reasoning via Reinforcement Learning for Embodied Robotic Decision-Making
Author: Jun Liu, Pu Zhao, Zhenglun Kong, Xuan Shen, Peiyan Dong, Fan Yang, Lin Cui, Hao Tang, Geng Yuan, Wei Niu, Wenbin Zhang, Xue Lin, Gaowen Liu, Yanzhi Wang, Dong Huang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.RO, cs.AI, cs.LG
arXiv:2603.16673v4 Announce Type: replace-cross Abstract: Embodied robotic systems increasingly rely on large language model (LLM)-based agents to support high-level reasoning, planning, and decision-making during interactions with the environment. However, invoking LLM reasoning introduces substant...
479. RewardFlow: Topology-Aware Reward Propagation on State Graphs for Agentic RL with Large Language Models
Author: Xiao Feng, Bo Han, Zhanke Zhou, Jiaqi Fan, Jiangchao Yao, Ka Ho Li, Dahai Yu, Michael Kwok-Po Ng
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.CL, cs.LG
arXiv:2603.18859v2 Announce Type: replace-cross Abstract: Reinforcement learning (RL) shows promise for enhancing LLM agentic reasoning, yet sparse terminal rewards hinder fine-grained optimization. Process reward modeling offers an alternative but incurs high computational costs, reward hacking ris...
480. Measure flow path recovery in Bayes Hilbert spaces
Author: S. David Mis, Maarten V. de Hoop
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.LG, math.PR
arXiv:2603.20329v2 Announce Type: replace-cross Abstract: We study the ill-posed problem of recovering a probability measure flow from finitely many moving localized sensors using a Bayes Hilbert framework. Relative to a fixed reference probability measure, a probability law is represented by its ce...
481. MemCollab: Cross-Model Memory Collaboration via Contrastive Trajectory Distillation
Author: Yurui Chang, Yiran Wu, Qingyun Wu, Lu Lin
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.LG
arXiv:2603.23234v2 Announce Type: replace-cross Abstract: LLM agents increasingly rely on memory mechanisms to reuse knowledge from past problem-solving experiences. However, existing methods typically construct memory for a single agent and reuse it with the same underlying model, tightly coupling ...
482. The Price Reversal Phenomenon: When Cheaper Reasoning Models Cost More
Author: Lingjiao Chen, Chi Zhang, Yeye He, Ion Stoica, Matei Zaharia, James Zou
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.GT, cs.LG, cs.MA
arXiv:2603.23971v2 Announce Type: replace-cross Abstract: Developers and consumers increasingly choose reasoning models (RMs) based on their listed API prices. However, how accurately do these prices reflect actual inference costs? We conduct the first systematic study of this question, evaluating 8...
483. MEC: Machine-Learning-Assisted Generalized Entropy Calibration for Semi-Supervised Mean Estimation
Author: Se Yoon Lee, Jae Kwang Kim
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:2604.05446v2 Announce Type: replace-cross Abstract: Obtaining high-quality labels is costly, whereas unlabeled covariates are often abundant, motivating semi-supervised inference methods with reliable uncertainty quantification. Prediction-powered inference (PPI) leverages a machine-learning p...
484. Beyond Augmented-Action Surrogates for Multi-Expert Learning-to-Defer
Author: Yannis Montreuil, Axel Carlier, Lai Xing Ng, Wei Tsang Ooi
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:2604.09414v4 Announce Type: replace-cross Abstract: A learning-to-defer (L2D) system decides, for each input, whether to predict on its own or to hand it to one of several available experts. The very well established recipe trains classifier and router jointly by treating the $K$ classes and $...
485. Adaptive Learning via Off-Model Training and Importance Sampling for Fully Non-Markovian Optimal Stochastic Control. Complete version
Author: Dorival Le~ao, Alberto Ohashi, Simone Scotti, Adolfo M. D da Silva
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.LG, math.PR
arXiv:2604.13147v2 Announce Type: replace-cross Abstract: This paper studies continuous-time stochastic control problems whose controlled states are fully non-Markovian and depend on unknown model parameters. Such problems arise naturally in path-dependent stochastic differential equations, rough-vo...
486. Estimating Continuous Treatment Effects with Two-Stage Kernel Ridge Regression
Author: Seok-Jin Kim, Kaizheng Wang
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ME, cs.LG, stat.ML
arXiv:2604.13410v2 Announce Type: replace-cross Abstract: We study the problem of estimating the effect function for a continuous treatment, which maps each treatment value to a population-averaged outcome. A central challenge in this setting is confounding: treatment assignment often depends on cov...
487. UDM-GRPO: Stable and Efficient Group Relative Policy Optimization for Uniform Discrete Diffusion Models
Author: Jiaqi Wang, Haoge Deng, Ting Pan, Yang Liu, Chengyuan Wang, Fan Zhang, Yonggang Qi, Xinlong Wang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2604.18518v4 Announce Type: replace-cross Abstract: Uniform Discrete Diffusion Model (UDM) has recently emerged as a promising paradigm for discrete generative modeling; however, its integration with reinforcement learning remains largely unexplored. We observe that naively applying GRPO to UD...
488. DialToM: A Theory of Mind Benchmark for Forecasting State-Driven Dialogue Trajectories
Author: Neemesh Yadav, Palakorn Achananuparp, Jing Jiang, Ee-Peng Lim
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG
arXiv:2604.20443v2 Announce Type: replace-cross Abstract: We introduce DialToM, an annotated Theory of Mind (ToM) benchmark built from naturalistic human-human dialogues using a multiple-choice evaluation framework. Concurrent with recent work showing a gap between explicit mental-state inference an...
489. Architecture-Induced Recoverability Bias in Differentiable Symbolic Regression
Author: Chakshu Gupta, Theodore J. LaGrow
Published: 5/29/2026, 4:00:00 AM
Categories: cs.NE, cs.AI, cs.LG, cs.SC
arXiv:2604.23256v2 Announce Type: replace-cross Abstract: Symbolic regression aims to recover closed-form expressions from numerical data, but in differentiable symbolic regression the recovered expression depends not only on the grammar but also on the fixed architecture through which variables are...
490. Revisiting the Effectiveness of LLM Pruning for Test-Time Scaling
Author: Ocean Monjur, Shahriar Kabir Nahin, Anshuman Chhabra
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.CL, cs.LG
arXiv:2604.25098v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) now exhibit remarkable reasoning capabilities through test-time compute scaling (TTS), with impressive performance across math and coding benchmarks. In parallel, research in model compression has developed prunin...
491. SciHorizon-DataEVA: An Agentic System for AI-Readiness Evaluation of Heterogeneous Scientific Data
Author: Dianyu Liu, Chuan Qin, Xi Chen, Xiaohan Li, Wenxi Xu, Yuyang Wang, Xin Chen, Yuanchun Zhou, Hengshu Zhu
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.LG
arXiv:2604.26645v2 Announce Type: replace-cross Abstract: AI-for-Science (AI4Science) is increasingly transforming scientific discovery by embedding machine learning models into prediction, simulation, and hypothesis generation workflows across domains. However, the effectiveness of these models is ...
492. When 2D Tasks Meet 1D Serialization: On Serialization Friction in Structured Tasks
Author: Chung-Hsiang Lo, Lu Li, Diji Yang, Tianyu Zhang, Yunkai Zhang, Yoshua Bengio, Yi Zhang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG
arXiv:2604.27272v2 Announce Type: replace-cross Abstract: In the LLM era, many symbolic and structured problems are presented to models through 1D text serialization. Yet some such problems are natively two-dimensional: their relevant relations, such as row--column correspondence or spatial adjacenc...
493. A Deep Learning Model for Battery State Prediction towards Intelligent Energy Management
Author: Athanasios Koukosias, Vasileios Tzanidakis, Sotiris Athanasiou, Kostas Kolomvatsos
Published: 5/29/2026, 4:00:00 AM
Categories: eess.SP, cs.LG
arXiv:2605.00898v2 Announce Type: replace-cross Abstract: Accurate forecasting of battery health indicators, including remaining capacity and lifetime, is of paramount importance for ensuring the reliability, safety, and operational efficiency of applications such as electric vehicles and large scal...
494. A Foundation Model for Zero-Shot Logical Rule Induction
Author: Yin Jun Phua
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.LG, cs.SC
arXiv:2605.04916v2 Announce Type: replace-cross Abstract: Inductive Logic Programming (ILP) learns interpretable logical rules from data. Existing methods are transductive: their learned parameters are bound to specific predicates and require retraining for each new task. We introduce Neural Rule In...
495. A Refined Generalization Analysis for Extreme Multi-class Supervised Contrastive Representation Learning
Author: Nong Minh Hieu, Antoine Ledent
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:2605.07596v3 Announce Type: replace-cross Abstract: Contrastive Representation Learning (CRL) has achieved strong empirical success in multiple machine learning disciplines, yet its theoretical sample complexity remains poorly understood. Existing analyses usually assume that input tuples are ...
496. Self-Supervised Laplace Approximation for Bayesian Uncertainty Quantification
Author: Julian Rodemann, Alexander Marquard, Thomas Augustin, Michele Caprio
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.AI, cs.LG, stat.CO
arXiv:2605.12208v2 Announce Type: replace-cross Abstract: Approximate Bayesian inference typically revolves around computing the posterior parameter distribution. In practice, however, the main object of interest is often a model's predictions rather than its parameters. In this work, we propose to ...
497. Online Learning-to-Defer with Varying Experts
Author: Dang Hoang Duy, Yannis Montreuil, Maxime Meyer, Axel Carlier, Lai Xing Ng, Wei Tsang Ooi
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:2605.12340v3 Announce Type: replace-cross Abstract: Learning-to-Defer (L2D) methods route each query either to a predictive model or to external experts. While existing work studies this problem in batch settings, real-world deployments require handling streaming data, changing expert availabi...
498. EVA-Bench: A New End-to-end Framework for Evaluating Voice Agents
Author: Tara Bogavelli, Gabrielle Gauthier Melan\c{c}on, Katrina Stankiewicz, Oluwanifemi Bamgbose, Fanny Riols, Hoang H. Nguyen, Raghav Mehndiratta, Lindsay Devon Brin, Joseph Marinier, Hari Subramani, Anil Madamala, Sridhar Krishna Nemala, Srinivas Sunkara
Published: 5/29/2026, 4:00:00 AM
Categories: cs.SD, cs.AI, cs.CL, cs.LG
arXiv:2605.13841v2 Announce Type: replace-cross Abstract: Voice agents, artificial intelligence systems that conduct spoken conversations to complete tasks, are increasingly deployed across enterprise applications. However, no existing benchmark jointly addresses two core evaluation challenges: gene...
499. ProtoMedAgent: Multimodal Clinical Interpretability via Privacy-Aware Agentic Workflows
Author: Alvaro Lopez Pellicer, Plamen Angelov, Marwan Bukhari, Yi Li, Eduardo Soares, Jemma Kerns
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CV, cs.AI, cs.LG, cs.MA
arXiv:2605.14113v2 Announce Type: replace-cross Abstract: While interpretable prototype networks offer compelling case-based reasoning for clinical diagnostics, their raw continuous outputs lack the semantic structure required for medical documentation. Bridging this gap via standard Retrieval-Augme...
500. Diffusion Models, Denoiser Architecture and Creativity
Author: Itamar Levine, Yair Weiss
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2605.16415v2 Announce Type: replace-cross Abstract: The creativity of diffusion models refers to their ability to generate highly realistic images that are different from their training data. Creativity is somewhat surprising since it is known that if the denoiser used in the diffusion model i...
501. PACE: Geometry-Aware Bridge Transport for Single-Cell Trajectory Inference
Author: Chenglei Yu, Chuanrui Wang, Bangyan Liao, Tailin Wu
Published: 5/29/2026, 4:00:00 AM
Categories: q-bio.GN, cs.LG
arXiv:2605.18587v2 Announce Type: replace-cross Abstract: Single-cell trajectory inference from destructive time-course snapshots is fundamentally ill-posed: neither cross-time cell correspondences nor continuous trajectories are observed, so the snapshot distributions alone do not uniquely determin...
502. OpenCompass: A Universal Evaluation Platform for Large Language Models
Author: Maosong Cao, Kai Chen, Haodong Duan, Yixiao Fang, Zhiwei Fei, Tong Gao, Ge Jiaye, Mo Li, Hongwei Liu, Junnan Liu, Yuan Liu, Chengqi Lyu, Han Lyu, Ningsheng Ma, Zerun Ma, Yu Sun, Zhiyong Wu, Linchen Xiao, Jun Xu, Haochen Ye, Zhaohui Yu, Yike Yuan, Songyang Zhang, Yufeng Zhao, Fengzhe Zhou, Peiheng Zhou, Dongsheng Zhu, Lin Zhu, Jingming Zhuo
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CL, cs.LG
arXiv:2605.19276v2 Announce Type: replace-cross Abstract: In recent years, the field of artificial intelligence has undergone a paradigm shift from task-specific small-scale models to general-purpose large language models (LLMs). With the rapid iteration of LLMs, objective, quantitative, and compreh...
503. TWINGS: Thin Plate Splines Warp-aligned Initialization for Sparse-View Gaussian Splatting
Author: Hyeseong Kim, Geonhui Son, Deukhee Lee, Dosik Hwang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2605.22069v2 Announce Type: replace-cross Abstract: Novel view synthesis from sparse-view inputs poses a significant challenge in 3D computer vision, particularly for achieving high-quality scene reconstructions with limited viewpoints. We introduce TWINGS, a framework that enhances 3D Gaussia...
504. CoRMA: Contrastive RMA for Contact-Rich Meta-Adaptation
Author: Wentian Wang, Chutong Wen, Hongxu Ma, Wuhao Wang, Zhexiong Xue, Abdul Haseeb Nizamani, Dandi Zhou, Xinhai Sun, Jianqiao Zhu
Published: 5/29/2026, 4:00:00 AM
Categories: cs.RO, cs.LG
arXiv:2605.22082v2 Announce Type: replace-cross Abstract: We present CoRMA(Contrastive Robotic Motor Adaptation), a context-based meta-adaptation framework that modifies RMA for force-dominant assembly. CoRMA replaces raw simulator-parameter adaptation with a compact 6D simulator-only semantic conta...
505. Nano World Models: A Minimalist Implementation of Future Video Prediction
Author: Siqiao Huang, Partha Kaushik, Michael Chen, Hengkai Pan, Kaiwen Geng, Omar Chehab, Fernando Moreno-Pino, Max Simchowitz
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CV, cs.AI, cs.LG
arXiv:2605.23993v2 Announce Type: replace-cross Abstract: World models have become a central paradigm for learning predictive simulators that support generation, planning, and decision-making. Yet, despite rapid progress in industry-scale interactive video generation, the broader research community ...
506. HumanEgo: Zero-Shot Robot Learning from Minutes of Human Egocentric Videos
Author: Zhi Wang, Botao He, Kelin Yu, Seungjae Lee, Ruohan Gao, Furong Huang, Yiannis Aloimonos
Published: 5/29/2026, 4:00:00 AM
Categories: cs.RO, cs.AI, cs.CV, cs.LG
arXiv:2605.24934v2 Announce Type: replace-cross Abstract: Human egocentric video captures rich manipulation demonstrations without any robot hardware, yet transferring these skills to robots remains challenging due to the embodiment gap between human and robot in both visual appearance and kinematic...
507. Eureka: Intelligent Feature Engineering for Enterprise AI Cloud Resource Demand Prediction
Author: Hangxuan Li, Renjun Jia, Xuezhang Wu, Yunjie Qian, Zeqi Zheng, Xianling Zhang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG
arXiv:2605.25297v2 Announce Type: replace-cross Abstract: Effective features are crucial for predictive model performance, but creating them often requires domain expertise, limiting scalability across applications. We define feature engineering as an agentic code generation problem: features are no...
508. A Principled Self-Referenced Early Stopping Approach for Deep Image Prior
Author: Chaoyan Huang, Cheng-Han Huang, Ismail R. Alkhouri, Rongrong Wang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2605.25299v2 Announce Type: replace-cross Abstract: Recently, Deep Image Prior (DIP) has demonstrated strong capabilities for solving inverse imaging problems (IIPs) by optimizing a randomly initialized convolutional neural network in a training-data-free regime. However, DIP suffers from over...
509. Algorithms with Polynomially-Improved Approximation Factors for the $2 \rightarrow q$ Norm, and Applications
Author: Samuel B. Hopkins, Stefan Tiegel
Published: 5/29/2026, 4:00:00 AM
Categories: cs.DS, cs.LG, math.ST, stat.ML, stat.TH
arXiv:2605.25303v2 Announce Type: replace-cross Abstract: The $2 \rightarrow q$ norm of a matrix $X \in \mathbb{R}^{n \times d}$ is defined as $\lVert X \rVert_{2 \rightarrow q} = \sup_{\lVert v \rVert_2 = 1} \lVert Xv \rVert_q$. We give polynomial-time multiplicative approximation algorithms for th...
510. Capability and Robustness Cannot Both Be Free: An Information-Theoretic Bound for Vision-Language-Action Models
Author: Jianwei Tai
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CR, cs.LG
arXiv:2605.25889v3 Announce Type: replace-cross Abstract: Vision-Language-Action (VLA) models reach high success rates on clean inputs but collapse under small adversarial perturbations: a $16/255$ PGD attack drops OpenVLA-7B's LIBERO success from above $95%$ to under $5%$. Empirical defenses reco...
511. Paris 2.0: A Decentralized Diffusion Model for Video Generation
Author: Ali Rouzbayani, Bidhan Roy, Marcos Villagra, Zhiying Jiang
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2605.26064v3 Announce Type: replace-cross Abstract: We present Paris 2.0, the first video generation model pre-trained through decentralized computation. Its training recipe builds upon Paris 1.0 (arXiv:2510.03434), the first ever open-weight Decentralized Diffusion Model (DDM), which showed t...
512. Turning Bias into Bugs: Bandit-Guided Style Manipulation Attacks on LLM Judges
Author: Xianglin Yang, Bryan Hooi, Gelei Deng, Tianwei Zhang, Jin Song Dong
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CR, cs.AI, cs.LG
arXiv:2605.26156v2 Announce Type: replace-cross Abstract: The known stylistic biases in LLM judges, such as a preference for verbosity or specific sentence structures, present an underexplored security vulnerability. In this work, we introduce BITE (BIas exploraTion and Exploitation), a black-box ad...
513. Prospective evaluation of multimodal respiratory failure prediction: Do chest X-rays improve performance beyond EHR signals?
Author: Xiaolei Lu, Shamim Nemati
Published: 5/29/2026, 4:00:00 AM
Categories: eess.IV, cs.AI, cs.LG
arXiv:2605.26255v2 Announce Type: replace-cross Abstract: Early prediction of respiratory failure is critical for timely clinical intervention in intensive care units. Existing electronic health record (EHR)-based models can continuously monitor physiologic deterioration, but they may not fully capt...
514. Automatic Layer Selection for Hallucination Detection
Author: Xinpeng Wang, William Cao, Andrew Gordon Wilson, Zhe Zeng
Published: 5/29/2026, 4:00:00 AM
Categories: cs.AI, cs.LG
arXiv:2605.26366v2 Announce Type: replace-cross Abstract: Recent studies on hallucination detection have shown that hallucination-related signals are more strongly encoded in intermediate layers than in the final layer of large language models (LLMs). Although a growing body of work has sought to ex...
515. Stop Suppressing the Tail: Causal Inference for Extreme Events
Author: Eichi Uehara
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:2605.27474v2 Announce Type: replace-cross Abstract: Estimating how an outcome responds to a continuous treatment (the Average Dose-Response Function, or ADRF) is a core causal-inference primitive. However, when outcomes possess heavy tails, standard robust double machine learning (DML) deliber...
516. Triangular-Reference Schr\"odinger Bridges for Time Series Generation
Author: Gabriele Bocchi
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.LG, math.PR
arXiv:2605.27478v2 Announce Type: replace-cross Abstract: We introduce Triangular-Reference Schr"odinger Bridges for Time Series (TR-SBTS), a conservative extension of the SBTS framework in which the Brownian reference is replaced by an intervalwise frozen, possibly degenerate diffusion reference, ...
517. Structure over Pixels: Learning Variable-Length Visual Programs
Author: Piotr Wyrwi'nski, Kacper Dobek, Krzysztof Krawiec
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2605.27696v2 Announce Type: replace-cross Abstract: Discrete visual tokenizers translate images into ordered sequences of codes, providing a natural representation for structural description of scenes. Yet existing adaptive tokenizers either require post-hoc search or select among a discrete s...
518. Insurance Pricing Optimization via Off-Policy Evaluation
Author: Sascha G"unther, Dimitri Semenovich, Mario V. W"uthrich
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.LG, q-fin.RM, stat.AP
arXiv:2605.28327v2 Announce Type: replace-cross Abstract: Traditional insurance pricing relies on risk-based principles that ensure actuarial fairness and solvency but do not explicitly account for policyholders' price sensitivity. We formulate insurance pricing as a decision-making problem and stud...
519. Bridging Maximum Likelihood and Optimal Transport for Efficient Inference and Model Selection in Stochastic Block Models
Author: Simon Queric, C'edric Vincent-Cuaz, Charles Bouveyron, Marco Corneli
Published: 5/29/2026, 4:00:00 AM
Categories: stat.ML, cs.LG, math.ST, stat.TH
arXiv:2605.28488v2 Announce Type: replace-cross Abstract: We study inference in stochastic block models (SBMs) through the lens of optimal transport (OT). We first establish that maximum likelihood variational inference (MLVI) can be interpreted as a semi-relaxed Gromov-Wasserstein (srGW) projection...
520. Resolution-free neural surrogates for geometric parameterization and mapping with spatially varying fields
Author: Yanwen Huang, Lok Ming Lui, Gary P. T. Choi
Published: 5/29/2026, 4:00:00 AM
Categories: cs.CV, cs.GR, cs.LG
arXiv:2605.28551v2 Announce Type: replace-cross Abstract: Many imaging problems require computing spatial transformations induced by spatially varying intensity, feature, or density fields. Canonical examples include distortion correction, deformable image registration, atlas-based segmentation, and...