arXiv cs.LG - 2026-06-01
513 items collected.
1. QASM-Eval: A Dataset to Train and Evaluate LLMs on OpenQASM-3 Beyond Quantum Circuits
Author: Zhenxiao Fu, Lei Jiang, Fan Chen
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, quant-ph
arXiv:2605.30358v1 Announce Type: new Abstract: Quantum computing remains in the Noisy Intermediate-Scale Quantum (NISQ) era, where the performance is highly constrained to noise. Addressing the limitation often requires hardware-facing capabilities beyond gate-sequence circuit specification, includ...
2. Gait2Hip-60: A Unified Deep Learning Benchmark for Predicting Hip Muscle Forces and Joint Moments from Multi-Cadence Gait Kinematics
Author: Jiaqi Zhang, Ji Hou, Qing Sun, Xianzhi Gao, Bo Huo
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30374v1 Announce Type: new Abstract: Estimating hip muscle forces and joint moments during gait typically relies on musculoskeletal simulation, which is informative but time-consuming and difficult to apply in clinical settings. This study developed a deep learning framework to predict th...
3. Unicorn: Scaling High-Dimensional Time Series Forecasting via Universal Correlation Modeling
Author: Haochen Yuan, Yichen Song, Yunbo Wang, Xiaokang Yang
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.30376v1 Announce Type: new Abstract: Modern time series architectures face a fundamental trade-off: channel-independent models scale well with increasing data volume but ignore critical inter-channel dependencies, while channel-dependent models are expressive but remain ``dimension-bounde...
4. When LLMs Learn to Be Consistently Wrong: A Multi-Model Study of Linear Representations of Synthetic Deception
Author: Vahideh Zolfaghari
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.30381v1 Announce Type: new Abstract: Deceptive alignment, in which models maintain accurate internal representations while deliberately producing false outputs, remains a central challenge in AI safety. While strategic deception is the primary long-term concern, synthetic dishonesty - ind...
5. LLMs Without Deep Neural Networks: New Architecture, Benefits and Case Study
Author: Vincent Granville
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.30385v1 Announce Type: new Abstract: The purpose of this article is to provide validation to my deep neural network alternative in the context of LLMs. Very recently, there has been a significant interest by Chinese researchers in a model called RBF network, as a substitute to standard DN...
6. Functional MRI Time Series Generation via Wavelet-Based Image Transform and Spectral Flow Matching for Brain Disorder Identification
Author: Hwa Hui Tew, Junn Yong Loo, Fang Yu Leong, Julia K. Lau, Ding Fan, Hernando Ombao, Rapha"el C. -W. Phan, Chee Pin Tan, Chee-Ming Ting
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CV, eess.SP
arXiv:2605.30387v1 Announce Type: new Abstract: Functional Magnetic Resonance Imaging (fMRI) provides non-invasive access to dynamic brain activity by measuring blood oxygen level-dependent (BOLD) signals over time. However, the resource-intensive nature of fMRI acquisition limits the availability o...
7. A Novel Evaluation Metric for Unsupervised Learning in AIS-Based Maritime Anomaly Detection: MADQI
Author: Ismet Gocer, Zakirul Bhuiyan, Raza Hasan, Shakeel Ahmad
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30388v1 Announce Type: new Abstract: This paper introduces a new systematic framework for detecting anomalies in maritime Automatic Identification System (AIS) datasets. These anomalies include abnormal vessel behaviours related to speed, position jumps, time gaps, and turn angles. Althou...
8. NumLeak: Public Numeric Benchmarks as Latent Labels in Foundation Models
Author: Anany Kotawala
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CR
arXiv:2605.30393v1 Announce Type: new Abstract: Public numeric benchmarks appear in pretraining, so an evaluation that conditions on a date may be measuring memorized recall rather than out-of-sample skill. We introduce NumLeak, a measurement framework that combines API-boundary probes on production...
9. LongDS-Bench: On the Failure of Long-Horizon Agentic Data Analysis
Author: Kewei Xu, Xiaoben Lu, Shuofei Qiao, Zihan Ding, Haoming Xu, Lei Liang, Ningyu Zhang
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL, cs.MA
arXiv:2605.30434v1 Announce Type: new Abstract: Real-world data analysis is inherently iterative, yet existing benchmarks mostly evaluate isolated or short interactive tasks, leaving agents' ability to track evolving analytical context over long horizons untested. We introduce LongDS, a benchmark fo...
10. Calibrated Preference Learning: The Case of Label Ranking
Author: Santo M. A. R. Thies, Viktor Bengs, Timo Kaufmann, Sebastian J. Vollmer, Eyke H"ullermeier
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, stat.ML
arXiv:2605.30447v1 Announce Type: new Abstract: Calibration, the alignment of predicted probabilities with true outcome frequencies, is essential for reliable decision-making. While extensively studied for classification and regression, calibration has not been formally addressed for probabilistic l...
11. Bounded Behavioral Indistinguishability for Black-Box LLM Distillation
Author: Munawar Hasan
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.CL
arXiv:2605.30448v1 Announce Type: new Abstract: Black-box LLM distillation is usually evaluated as an output-matching problem: a student is considered successful when its responses are semantically similar to, or task-consistent with, those of a teacher. However, output similarity does not imply tha...
12. VeriGate: Verifier-Gated Step-Level Supervision for GRPO
Author: Aakriti Agrawal, Minghui Liu, Furong Huang
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30451v1 Announce Type: new Abstract: Group Relative Policy Optimization (GRPO) is an effective recipe for training reasoning models with verifier-based outcome rewards, but its supervision is sparse: when all sampled trajectories for a prompt receive the same verifier reward, the group-re...
13. A Unified Framework for Gradient Aggregation in Multi-Objective Optimization
Author: Zeou Hu, Kelvin Ho, Yaoliang Yu
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, math.OC
arXiv:2605.30452v1 Announce Type: new Abstract: Many machine learning problems involve multiple inherent trade-offs that are best addressed by gradient-based multi-objective optimization (MOO) algorithms. Existing methods are often proposed with various motivations, analyzed case by case, and differ...
14. DisjunctiveNet: Neural Symbolic Learning via Differentiable Convexified Optimization Layers
Author: Shraman Pal, Can Li
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, math.OC
arXiv:2605.30456v1 Announce Type: new Abstract: Many learning tasks in science and engineering are characterized by sparse datasets, which limits the effectiveness of purely data-driven approaches. At the same time, these problems are often accompanied by rich domain knowledge derived from physical ...
15. Scalable Constrained Multi-Agent Reinforcement Learning via State Augmentation and Consensus for Separable Dynamics
Author: Santiago Amaya-Corredor, Miguel Calvo-Fullana, Anders Jonsson
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.30461v1 Announce Type: new Abstract: We present a distributed approach for constrained Multi-Agent Reinforcement Learning (MARL) that combines state-augmented policy learning with distributed consensus over dual variables. Our method targets systems where agents have separable dynamics bu...
16. idSCD: Identifying Training Datasets through Semantic Correlation Descriptors
Author: Andrada Gobeaja, Ionut Hodoroaga, Elena Burceanu, Marius Leordeanu
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.30462v1 Announce Type: new Abstract: Can a dataset be recognized from the spurious correlations it induces during training? We argue that datasets leave dataset-specific traces in a model's learned semantic correlation structure: incidental regularities that are predictive within a datase...
17. Can Subgraph Explanations Be Weaponized to Steal Graph Neural Networks?
Author: Ojas Nimase, Jiate Li, Yue Zhao, Yushun Dong
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30470v1 Announce Type: new Abstract: Graph Machine Learning as a Service (GMLaaS) platforms increasingly implement explainability interfaces to meet regulatory transparency requirements. However, this transparency creates exploitable vulnerabilities for model extraction attacks. We presen...
18. Universal Multiclass Transductive Online Learning
Author: Steve Hanneke, Hongao Wang
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30479v1 Announce Type: new Abstract: We consider the problem of universal transductive online classification with a possibly unbounded label space. This setting considers online learning, with the sequence of instances (without labels) known to the learner in advance. We say a concept cla...
19. Discovering a Zeta Map Algorithm on Dyck Paths via Mechanistic Interpretability
Author: Xiaoyu Huang, Blake Jackson, Kyu-Hwan Lee
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30482v1 Announce Type: new Abstract: Machine learning is increasingly used in mathematical discovery, but in mathematics the desired output is often not a prediction itself, but an explicit construction that can be checked independently. We study this setting through the zeta map on Dyck ...
20. Graph-Conditioned Mixture of Graph Neural Network Experts for Traffic Forecasting
Author: Amirhossein Ghaffari, Saeid Sheikhi, Ekaterina Gilman
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.30486v1 Announce Type: new Abstract: Spatio-temporal forecasting on sensor graphs is commonly tackled with a single backbone architecture applied uniformly across all nodes, although graph regions can exhibit different dynamics. Road segments differ in functional class, structure, and tra...
21. MAAT: Multi-phase Adapter-Aware Targeted Unlearning
Author: Suryash Yagnik, Shubham Gaur, Saksham Thakur, Vinija Jain, Aman Chadha, Amitava Das
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.CL
arXiv:2605.30514v1 Announce Type: new Abstract: Machine unlearning evaluation is structurally skewed: Why-type questions, which probe causal and relational knowledge, comprise less than 0.06% of CounterFact, 0.6% of ZSRE, and less than 1.3% of TOFU, MUSE, and WMDP-Cyber. This near-zero representatio...
22. Revisiting Padded Transformer Expressivity: Which Architectural Choices Matter and Which Don't
Author: Anej Svete, William Merrill, Ryan Cotterell, Ashish Sabharwal
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CC, cs.CL, cs.FL
arXiv:2605.30523v1 Announce Type: new Abstract: Recent work describes what transformers can and cannot compute through connections to boolean circuits, but existing results lack exact characterizations and are sensitive to modeling choices. Padded transformers -- to whose input filler symbols such a...
23. Representation Collapse in Sequential Post-Training of Large Language Models
Author: Yichen Liu, Mingyu Chen, Hao Wang, Xiaoran Xu, Chenxi Lin, Rui Zhang, Yutong Zhou, Yuxin Yang, Jiarui Wu, Wei Sun
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30524v1 Announce Type: new Abstract: Large language models are now adapted through chains of post-training stages rather than through a single instruction-tuning pass. This paper studies whether such sequential post-training gradually compresses internal representations into low-rank, ani...
24. Measuring, Localizing, and Ablating Alignment Signatures in LLMs
Author: Aniket Anand, Janvijay Singh, Zhewei Sun, Dilek Hakkani-T"ur, Nick Feamster
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.CL
arXiv:2605.30526v1 Announce Type: new Abstract: Aligned language models often exhibit a recognizable AI-like style, yet its connection to post-training and internal representations remains poorly understood. In this work, we study whether post-training introduces or amplifies AI-like stylistic regul...
25. The Long-Term Effects of Data Selection in LLM Fine-Tuning
Author: Yuxin Yang, Aoxiong Zeng, Xiangquan Yang
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30537v1 Announce Type: new Abstract: Data selection is increasingly used to reduce the cost of large language model (LLM) fine-tuning, with recent methods prioritizing samples by current utility, diversity, quality, or influence. This paper studies a different question: when fine-tuning o...
26. DisasterLex: An Expert Concept-to-Schema Knowledge Graph for Geospatial Reasoning in Disaster Analytics
Author: Yiming Xiao, Ankit Basu, Kai Yin, Sahil Vartak, Christian Swords, Ali Mostafavi
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30538v1 Announce Type: new Abstract: Disasters are inevitable and increasingly costly, and effective response depends on querying structured tabular data: precise, information-dense records of hazard, exposure, vulnerability, and lifeline infrastructure that underpin disaster management. ...
27. SubsurfaceGen: Procedural Generation of Field-Scale Earth Models and Seismic Data
Author: Joseph Stitt, Pratik Rathore, Madeleine Udell, Ching-Yao Lai
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, physics.geo-ph
arXiv:2605.30541v1 Announce Type: new Abstract: Full waveform inversion (FWI) is the gold standard for subsurface imaging, with applications from carbon sequestration to energy and mineral exploration to earthquake hazard assessment. Machine learning approaches to FWI need field-scale, geologically ...
28. Early Prediction of Future Behavioral Strategy from Process Traces
Author: Robert Kasumba, Dennis Barbour, Chien-Ju Ho
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30550v1 Announce Type: new Abstract: Adaptive systems often need to make task-specific decisions about people from limited evidence: a tutor may need to anticipate how a learner will approach a new problem, a game may need to adapt when a player enters a new level, and a human-AI system m...
29. Destruction is a General Strategy to Learn Generation; Diffusion's Strength is to Take it Seriously; Exploration is the Future
Author: Pierre-Andr'e No"el
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.IT, math.IT
arXiv:2605.30553v1 Announce Type: new Abstract: I present diffusion models as part of a family of machine learning techniques that withhold information from a model's input and train it to guess the withheld information. I argue that diffusion's destroying approach to withholding is more flexible th...
30. Supervised Training Rapidly Degrades Early Visual Cortex Alignment Across Biologically Plausible Learning Rules
Author: Nils Leutenegger
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, q-bio.NC
arXiv:2605.30556v1 Announce Type: new Abstract: Random, untrained neural networks consistently match or exceed trained networks in representational similarity to early visual cortex. This puzzling finding challenges the assumption that learning improves brain alignment. We investigate it by tracking...
31. Zeroth-Order Non-Log-Concave Sampling with Variance Reduction and Applications to Inverse Problems
Author: M. Berk Sahin, Behzad Sharif, Abolfazl Hashemi
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30573v1 Announce Type: new Abstract: Sampling from high-dimensional, non-log-concave distributions with unnormalized densities remains a fundamental challenge in machine learning, particularly in black-box settings where gradient information is inaccessible or computationally prohibitive....
32. Benchmarking Machine Learning Uncertainty Quantification Methodologies for Predicting Turbine Gas Temperature Degradation
Author: Jostein Barry-Straume, Changmin Son, Adrian Sandu, Gavan Burke, Rekha Sundararajan, Andrew Rimell, James G. Steinrock
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CE
arXiv:2605.30585v1 Announce Type: new Abstract: Effective prognostics and health management of modern engines relies on accurate turbine gas temperature predictions and robust uncertainty quantification to ensure reliability and safety. This paper investigates five major approaches for constructing ...
33. Counterfactual Evaluation Reveals Hidden Capability Profiles in Clinical LLMs and Agents
Author: Matt Turk
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL
arXiv:2605.30590v1 Announce Type: new Abstract: Two clinical AI systems can score nearly identically on coverage-based rubrics yet behave radically differently when their patient inputs change: one updates its recommendations to match the new clinical signal, while the other produces the same output...
34. Learning Transferable Predictability Representations
Author: Diyali Goswami, Auroop R. Ganguly
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30592v1 Announce Type: new Abstract: We study the problem of assigning a scalar score to a short trajectory window that reflects its position on an ordered continuum of predictability regimes, spanning structured deterministic dynamics to unstructured stochastic noise. Existing methods ad...
35. Scientific Machine Learning for Engine Health Management and Remaining Useful Life Prediction
Author: Jostein Barry-Straume, Changmin Son, Adrian Sandu, Gavan Burke, Rekha Sundararajan, Andrew Rimell, James G. Steinrock
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CE
arXiv:2605.30593v1 Announce Type: new Abstract: Engine Health Management (EHM) depends on reliable forecasting of Remaining Useful Life (RUL) and on tracking thermal indicators such as turbine gas temperature (TGT). In practice, real-world fleet data are heterogeneous and non-stationary, and point p...
36. Improving Relative Representations with Learned Anchors and Whitened Inner Products
Author: Oscar Thorsted Svendsen, Nikolaj Holst Jakobsen, Fabian Mager, Hiba Nassar
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30596v1 Announce Type: new Abstract: Independently trained neural models typically converge to incompatible latent representations, creating a fundamental barrier to highly modular AI systems. While Relative Representations (RR) address this by mapping absolute coordinates to a shared spa...
37. ScaleMAP: Preserving Local Density and Neighborhood Structure in Low-Dimensional Embeddings
Author: Rajas Poorna (Georgia Institute of Technology), Marcus T. Cicerone (Georgia Institute of Technology)
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30597v1 Announce Type: new Abstract: Nonlinear dimensionality-reduction methods such as UMAP and PaCMAP adaptively normalize local distances during graph construction, erasing neighborhood scale from the data. This distorts more than relative cluster sizes: sparse structures like bridges ...
38. AMNESIA: A Large Scale Medical Unlearning Benchmark Suite with Disease-Informed Analysis
Author: Saeedeh Davoudi, Reihaneh Iranmanesh, Ophir Frieder, Nazli Goharian
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.CL
arXiv:2605.30599v1 Announce Type: new Abstract: Medical knowledge is continuously evolving. This creates a need to update or selectively forget information encoded in already-trained medical LLMs. Machine unlearning aims to remove the influence of specific training data from a model without full ret...
39. The Fast Mixing Mechanism for Differential Privacy
Author: Omri Lev, Moshe Shenfeld, Vishwak Srinivasan, Katrina Ligett, Ashia C. Wilson
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.IT, math.IT
arXiv:2605.30600v1 Announce Type: new Abstract: Randomized sketching is a central tool for compressing large-scale optimization problems while preserving accuracy. In particular, sketches that are based on structured matrices, such as the Hadamard matrix, can be applied efficiently and often yield s...
40. TASER: Task-Aware Stein Regularisation for Geometry-Driven Robustness
Author: Micha{\l} Kozyra, Gesine Reinert
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30601v1 Announce Type: new Abstract: Modern deep networks remain fragile under distribution shift and adversarial perturbations, often due to excessive or poorly structured input sensitivity. We introduce TASER (Task-Aware Stein Regularisation), a training-time regularisation framework de...
41. Constrained Flow Optimization via Sequential Fine Tuning for Molecular Design
Author: Sven Gutjahr, Riccardo De Santi, Luca Schaufelberger, Kjell Jorner, Andreas Krause
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30610v1 Announce Type: new Abstract: Adapting generative foundation models, in particular diffusion and flow models, to optimize given reward functions (e.g., binding affinity) while satisfying constraints (e.g., molecular synthesizability) is fundamental for their adoption in real-world ...
42. Improving Selective Classification with Pairwise Queries for Binary Classification
Author: Harsh Vardhan, Sunav Choudhary, Natwar Modani, Arya Mazumdar
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30615v1 Announce Type: new Abstract: In selective classification, a model predicts the labels of data samples where it is confident, and abstains from predicting labels for samples on which it is not confident. The rejected samples are often labeled by an expert, which is expensive. The b...
43. Active Timepoint Selection for Learning Measure-Valued Trajectories
Author: Nicolas Huynh, Mihaela van der Schaar
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, stat.ML
arXiv:2605.30625v1 Announce Type: new Abstract: Inferring continuous probability paths from sparse snapshots is a fundamental challenge in domains like single-cell biology, where high-fidelity data acquisition is often destructive and constrained by prohibitive sequencing costs. This motivates the n...
44. CellBRIDGE: Learning Cellular Trajectories via Interaction-Aware Alignment
Author: Silas Ruhrberg Est'evez, Nicolas Huynh, Tennison Liu, Roderik M. Kortlever, Gerard I. Evan, David L. Bentley, Mihaela van der Schaar
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, q-bio.GN
arXiv:2605.30635v1 Announce Type: new Abstract: Inferring dynamics from population snapshots is a fundamental challenge in machine learning and biology. In scRNA-sequencing (scRNA-seq), destructive measurements preclude direct tracking of individual cells across time, making trajectory inference und...
45. Score Broadcast and Decorrelation: A General Framework for Broadcast-Based Credit Assignment
Author: Mustafa Uzun, Mete Erdogan, Cengiz Pehlevan, Alper T. Erdogan
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.30638v1 Announce Type: new Abstract: We introduce Score Broadcast and Decorrelation (SBD), a principled framework for broadcast-based credit assignment for general families of differentiable losses. Error broadcast is a biologically plausible alternative to backpropagation that sends outp...
46. CSULoRA: Closest Safe Update Low-Rank Adaptation
Author: Oleksandr Marchenko Breneur, Adelaide Danilov, Aria Nourbakhsh, Salima Lamsiyah
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.CL
arXiv:2605.30640v1 Announce Type: new Abstract: Low-rank adaptation has become a standard method for parameter-efficient fine-tuning of large language models, but even small amounts of unsafe or adversarial fine-tuning data can substantially weaken the safety behavior of aligned models. Existing saf...
47. Diffusion Models Preferentially Memorize Prototypical Examples or: Why Does My Diffusion Model Love Slop?
Author: Marta Aparicio Rodriguez, Anastasia Borovykh, Grigorios A. Pavliotis, Daniel J. Korchinski
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30642v1 Announce Type: new Abstract: Generative models have a persistent limitation: their tendency to memorize training data can create legal liabilities and erode creative diversity. Understanding which samples are memorized in whole or in part, and under what conditions, therefore rema...
48. Convergence of Steepest Descent and Adam under Non-Uniform Smoothness
Author: Sharan Vaswani, Yifan Sun, Reza Babanezhad
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, math.OC
arXiv:2605.30648v1 Announce Type: new Abstract: Recent work has analyzed the convergence of first-order methods under non-uniform smoothness assumptions that better model the loss landscape in machine learning tasks. We generalize this assumption to objectives whose curvature is an affine function o...
49. LARK: Learnability-Grounded Trajectory Selection for Efficient Reasoning Distillation
Author: Tianrun Yu, Kaixiang Zhao, Chih-Chun Chen, Amanda Hughes, Taylor W. Killian, Fenglong Ma, Weitong Zhang, Porter Jenkins
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.30651v1 Announce Type: new Abstract: We study trajectory selection for reasoning distillation, where teacher-generated reasoning trajectories are selectively used as supervision for a student model. Existing methods rely on heuristics such as trajectory quality or model confidence, but th...
50. Bridging the Gap Between Natural Language and Market Dynamics via High-Dimensional Representation Learning
Author: Yujin Jeong (Mike), Noelle Jung (Mike), Brian Y. C. Leung (Mike)
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30652v1 Announce Type: new Abstract: Traditional multi-modal financial forecasting often relies on scalar sentiment scores, which fail to capture the nuances of financial news. To address this information loss, this paper explores high-dimensional representation learning by replacing disc...
51. Learning to Perceive the World Through Control: Empowerment-Based Representation Learning
Author: Mahsa Bastankhah, Sophie Broderick, Benjamin Eysenbach
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30656v1 Announce Type: new Abstract: In many practical reinforcement learning environments, observations are far higher-dimensional than the variables that matter for control. In this work, we ask: can we learn representations that capture only control-relevant features of the environment...
52. BOKBO (Best of K Bad Options): Calibrated Abstention for VLA Policies
Author: Anya Singh, Cabrel Happi, Jai Relan, Varun Nair, Vidyut Baradwaj
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.RO
arXiv:2605.30660v1 Announce Type: new Abstract: Test-time scaling for vision-language-action (VLA) policies, methods such as RoboMonkey, SEAL, MG-Select, and V-GPS, samples K candidate action chunks at inference and executes the verifier-best. When all K candidates are unsafe, the system executes a ...
53. Spatio-temporal stochastic graph-based learning for infectious disease forecasting
Author: Luz Stefani Sotomayor Valenzuela, Susanna Cramb, Darren Wraith
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, q-bio.PE
arXiv:2605.30662v1 Announce Type: new Abstract: Spatio-temporal graph-based models have typically been used to forecast new cases of infectious diseases such as COVID-19 and chickenpox outbreaks. However, the use of stochastic modelling into their learning process has been surprisingly under-investi...
54. Universal Decision Learners
Author: Sridhar Mahadevan
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30694v1 Announce Type: new Abstract: Many theories of decision making -- planning, reinforcement learning, causal intervention, online learning, and game-theoretic equilibrium -- turn local information into globally coherent behavior. This paper proposes a common categorical formulation: ...
55. A Context-Aware Middleware for Medical Image Based Reports: An approach based on image feature extraction and association rules
Author: Erick O. Rodrigues, Jose Viterbo, Aura Conci, Trueman Mac Henry
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.CV
arXiv:2605.30699v1 Announce Type: new Abstract: This work proposes a context-aware middleware for medical workflow organization and efficiency improvement. In hospitals, laboratories and teleradiology companies, each physician or technician is specialized in a specific kind of diagnosis or analysis....
56. Diversity Matters: Revisiting Test-Time Compute in Vision-Language Models
Author: Yijie Tong, Yifan Hou, Shaobo Cui, Antoine Bosselut, Mrinmaya Sachan
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.CV, cs.MM
arXiv:2605.30713v1 Announce Type: new Abstract: Test-time compute (TTC) strategies have emerged as a lightweight approach to boost reasoning in large language models (LLMs). However, their application and benefits for vision-language models (VLMs) remain underexplored. We present a systematic study ...
57. When are LLMs Sufficient Policy Optimizers for Sequential RL Tasks?
Author: Stephane Hatgis-Kessell, Emma Brunskill
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.30719v1 Announce Type: new Abstract: We study when large language models (LLMs) can serve as effective black-box policy optimizers for reinforcement learning (RL) tasks, i.e., when can we replace classical RL algorithms with an LLM? We explore this question by introducing Prompted Policy ...
58. Kalimati Vegetable Price Index Forecasting with a Momentum Corrected Online Stacking Ensemble
Author: Sahaj Raj Malla
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, econ.GN, q-fin.EC, stat.ML
arXiv:2605.30720v1 Announce Type: new Abstract: Forecasting agricultural commodity prices in emerging economies is difficult due to high volatility, frequent supply disruptions, and strong cultural influences on demand. This study introduces the Kalimati Vegetable Price Index (KVPI), a new inverse-v...
59. Self-Certifying Transport MCMC via Dual Spectral-Gap Certificates
Author: Jun Hu
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, stat.CO, stat.ME
arXiv:2605.30722v1 Announce Type: new Abstract: We propose CerT-MCMC, a framework that equips learned-transport Markov chain Monte Carlo with automatic, rigorous convergence certificates. A normalising flow maps a Gaussian reference to an approximation of the target posterior; the same flow then ser...
60. Reducing the GPU Memory Bottleneck with Lossless Compression for ML -- Extended
Author: Aditya K Kamath, Arvind Krishnamurthy, Marco Canini, Simon Peter
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.DC
arXiv:2605.30728v1 Announce Type: new Abstract: Machine learning (ML) training and inference often process data sets far exceeding GPU memory capacity, forcing them to rely on PCIe for on-demand tensor transfers, causing critical transfer bottlenecks. Lossy compression has been proposed to relieve b...
61. SemStruct: Contextualizing Semantic Embeddings with Structural Information for Schema Matching
Author: Inwon Kang, Kavitha Srinivas, Nandana Mihindukulasooriya, Sola Shirai, Parikshit Ram, Horst Samulowitz, Oshani Seneviratne
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.IR
arXiv:2605.30729v1 Announce Type: new Abstract: Schema matching is a fundamental step in integrating heterogeneous data sources. While Pre-trained Language Models (PLMs) have revolutionized this task by capturing linguistic semantics, they typically process tabular data as serialized text sequences ...
62. Beyond Accuracy: Evaluating Efficiency, Robustness and Explainability in Deep Learning for Malaria Diagnosis
Author: Olivier Kanamugire, Kerol Djoumessi
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.CV
arXiv:2605.30734v1 Announce Type: new Abstract: Malaria remains a leading cause of mortality in sub-Saharan Africa, where scarce diagnostic infrastructure makes timely, accurate diagnosis particularly challenging. While deep learning offers a compelling path toward automated malaria screening, clini...
63. OrcaRouter: A Production-Oriented LLM Router with Hybrid Offline-Online Learning
Author: Zhenghua Bao, Fengya Tian, Chris Zhang, Zhenjun Chen, Xile Ma, Yi Shi
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL
arXiv:2605.30736v1 Announce Type: new Abstract: The rapid development of large language models, each with distinct capabilities and inference costs, raises a practical deployment question: given an incoming request, which model should handle it? We present OrcaRouter, a production-oriented LLM route...
64. FLAG: Flow Policy MaxEnt-RL by Latent Augmented Guidance
Author: Sungha Kim, Gawon Lee, Jusuk Lee, Jonghae Park, H. Jin Kim, Daesol Cho
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.RO
arXiv:2605.30749v1 Announce Type: new Abstract: Maximum entropy reinforcement learning (MaxEnt-RL) enables robust exploration, yet practical implementations often restrict policies to simple Gaussians. While recent approaches incorporate expressive generative policies via importance-weighted supervi...
65. Chain-of-Thought and Compressed Looped Transformers: A Memory-Budget Separation
Author: Haozhou Zhang
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30757v1 Announce Type: new Abstract: Chain-of-thought prompting and looped Transformers both give a fixed model more test-time computation, but they differ in what they remember. Chain-of-thought stores intermediate state in generated tokens that remain in the context, whereas a looped Tr...
66. Efficient and Uncertainty-Aware Diffusion Framework for Offline-to-Online Reinforcement Learning
Author: Ha Manh Bui, Metod Jazbec, Eric Nalisnick, Anqi Liu
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30776v1 Announce Type: new Abstract: Offline-to-Online Reinforcement Learning (O2O-RL) leverages an offline, pre-trained policy to minimize costly online interactions. Although data-efficient, O2O-RL is susceptible to shifts between offline and online distributions. Existing work aims to ...
67. AbstainGNN: Teaching Graph Neural Networks to Abstain for Graph Classification
Author: Xixun Lin, Zhiheng Zhou, Zhengyin Zhang, Yancheng Chen, Shuai Zhang, Ge Zhang, Shichao Zhu, Lixin Zou, Chuan Zhou, Peng Zhang, Shirui Pan, Yanan Cao
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30786v1 Announce Type: new Abstract: Graph classification is a core task in graph data mining with widespread real-world applications. Recent advances in graph neural networks (GNNs) have led to substantial performance improvements for graph classification. However, existing GNNs are typi...
68. Smaller Models are Natural Explorers for Policy-Level Diversity in GRPO
Author: Yiming Ren, Yiran Xu, Zicheng Lin, Chufan Shi, Yukang Chen, Dingdong Wang, Tianhe Wu, Junjie Wang, Yujiu Yang, Yu Qiao, Ruihang Chu
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.30789v1 Announce Type: new Abstract: We identify a new dimension for enhancing rollout diversity in Group Relative Policy Optimization (GRPO) for LLMs. While GRPO relies on diverse rollouts, prevailing strategies primarily increase diversity by injecting more token-level randomness, which...
69. Conformal Reliability: A New Evaluation Metric for Conditional Generation
Author: Yachen Gao, Xinwei Sun, Yikai Wang, Ye Shi, Jingya Wang, Jianfeng Feng, Yanwei Fu
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30807v1 Announce Type: new Abstract: Conditional generative models have recently achieved remarkable success in various applications. However, a suitable metric for evaluating the reliability of these models, which takes into account their inherent uncertainty, is still lacking. Existing ...
70. IRIS: time-structured manifold projections
Author: Brian Ondov, Chia-Hsuan Chang, Weipeng Zhou, Xingjian Zhang, Xueqing Peng, Yutong Xie, Huan He, Qiaozhu Mei, Hua Xu
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30810v1 Announce Type: new Abstract: High-dimensional biomedical data, such as cell-by-gene matrices, are increasingly generated temporally. However, Manifold Learning algorithms, like t-SNE and UMAP, cannot incorporate time-ordering in their layouts, obfuscating the dynamics of cell type...
71. Non-destructive Identification of Oyster Species is possible from Hyperspectral Images with Machine Learning
Author: Ethan Kane Waters, Max Wingfield, Aiden Mellor, Paul Stewart, Iman Tahmasbian
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30811v1 Announce Type: new Abstract: Differentiating between oyster species is important for developing new commercial oyster species suited to production systems and is critical for traceability in seafood supply chains. Common methods, such as DNA profiling, are destructive and time con...
72. Learning Permutation-invariant Macroscopic Dynamics
Author: Zhichao Han, Mengyi Chen, Qianxiao Li
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, physics.comp-ph
arXiv:2605.30812v1 Announce Type: new Abstract: Accurately modeling the macroscopic dynamics of high-dimensional microscopic systems is of broad interest across the sciences. Many data-driven approaches learn a low-dimensional latent state through an autoencoder trained for pointwise input reconstru...
73. Unlearning in Diffusion Models: A Unified Framework with KL Divergence and Likelihood Constraints
Author: Shervin Khalafi, Alejandro Ribeiro, Dongsheng Ding
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, math.OC, stat.ML
arXiv:2605.30825v1 Announce Type: new Abstract: Unlearning in diffusion models aims to remove undesirable data or concepts while preserving the utility of pretrained models -- two fundamentally conflicting objectives. We propose a principled constrained optimization framework that formulates unlearn...
74. Cross-Layer Subspace Coupling for LLM Compression: A Unifying Framework and Its Empirical Limits
Author: Snigdha Chandan Khilar
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, math.DG
arXiv:2605.30836v1 Announce Type: new Abstract: Recent SVD based compression methods for large language models like SVD LLM and Basis Sharing can be unified under one optimization problem. While mathematical proofs and tests on Pythia models show this unified approach improves weight reconstruction ...
75. CoMem: Context Management with A Decoupled Long-Context Model
Author: Yuwei Zhang, Chengyu Dong, Shuowei Jin, Changlong Yu, Hejie Cui, Hongye Jin, Xinyang Zhang, Hamed Bonab, Colin Lockard, Jianshu Chen, Zhenyu Shi, Jingbo Shang, Xian Li, Bing Yin
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30842v1 Announce Type: new Abstract: Context management enables agentic models to solve long-horizon tasks through iterative summarization of previous interaction histories. However, this process typically incurs substantial decoding overhead for the extra summarization tokens, which sign...
76. A Lecture Note on Offline RL and IRL, Part II: Foundations of Inverse Reinforcement Learning and Dynamic Discrete Choice Models
Author: Enoch Hyunwook Kang
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, econ.EM
arXiv:2605.30843v1 Announce Type: new Abstract: In the forward reinforcement-learning problem, the reward is fixed and known; the learner is asked to find a good policy or value function. Here we turn the question around. Given offline data generated by an expert, can we recover the reward the exper...
77. ForecastCompass: Guiding Agentic Forecasting with Adaptive Factor Memory
Author: Yurui Chang, Yongkang Du, Yuanpu Cao, Jinghui Chen, Lu Lin
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30858v1 Announce Type: new Abstract: Agentic forecasting is important for decision-making in dynamic environments, but it remains challenging because agents must reason from incomplete, time-limited evidence and produce calibrated probabilities before outcomes are resolved. Memory provide...
78. DARTS: Distribution-Aware Active Rollout Trajectory Shaping for Accelerating LLM Reinforcement Learning
Author: Yujie Wang, Siwei Chen, Longzan Luo, Xinyi Liu, Xupeng Miao, Fangcheng Fu, Bin Cui
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.30859v1 Announce Type: new Abstract: Reinforcement Learning (RL) has become pivotal for improving model capabilities yet suffers from rollout efficiency bottlenecks due to the long-tail response length distribution. While existing works mitigate the impact of long tails via prompt-level t...
79. GlucoFM: A Dual-Stream Foundation Model for Continuous Glucose Monitoring
Author: Zechen Li, Keerthana Natarajan, Weizhi Zhang, Menglian Zhou, Simon A. Lee, Yuwei Zhang, Maxwell A. Xu, Zeinab Esmaeilpour, Flora D. Salim, Mark Malhotra, Lindsey Sunden, Shwetak Patel, Yuzhe Yang, Ahmed A. Metwally
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30865v1 Announce Type: new Abstract: Continuous glucose monitoring (CGM) provides a dense view of daily metabolic physiology, yet existing generic time-series and CGM-specific foundation models often encode glucose traces as entangled single-stream sequences, leaving the distinct temporal...
80. Federated Variational Preference Alignment with Gumbel-Softmax Prior for Personalized User Preferences
Author: Jabin Koo, Hoyoung Kim, Minwoo Jang, Jungseul Ok
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.DC
arXiv:2605.30873v1 Announce Type: new Abstract: Federated Learning (FL) offers a privacy-preserving pathway for aligning Large Language Models (LLMs); however, existing frameworks typically enforce a monolithic reward model, inevitably averaging out inherently conflicting user preferences (e.g., hel...
81. Bandwidth Allocation with Device Partitioning for Federated Learning over Industrial IoT networks
Author: Kangmin Kim, Jaeyoung Song
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30892v1 Announce Type: new Abstract: We consider a federated learning (FL) system in which Industrial Internet-of-Things (IIoT) devices collaboratively train a global model over wireless channels without sharing local data. In such systems, communication time is a primary bottleneck that ...
82. Zero Collapse: A Failure Mode of Policy Gradient Methods in Discontinuous Reward Environments
Author: Nishant Kumar, Enrique Areyan Viqueira, Amy Greenwald
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30896v1 Announce Type: new Abstract: Bidding in repeated auctions is a central challenge for reinforcement learning (RL), combining continuous control with the strategic complexities of digital advertising. While policy gradient and value-based methods seem well-suited for these settings,...
83. Density-Guided Robust Counterfactual Explanations on Tabular Data under Model Multiplicity
Author: Jun Tan, Qing Guo, Zicheng Xu, Jinglin Li, Qi Fang, Ning Gui
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30901v1 Announce Type: new Abstract: Counterfactual explanations (CEs) are essential for actionable recourse, yet their reliability is often compromised in low-density regions, where classifiers exhibit high variance. Unlike existing methods that rely on expensive ensemble intersections t...
84. Inverse Reinforcement Learning without an Optimal Demonstrator: A Feasible Reward Set Approach
Author: Kihyun Kim, Shripad Deshmukh, Nikos Vlassis, Jiawei Zhang
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.30903v1 Announce Type: new Abstract: Inverse reinforcement learning (IRL) typically assumes demonstrations from a single optimal demonstrator, but in many applications data come from multiple imperfect demonstrators with heterogeneous suboptimality levels. We study reward learning in this...
85. PINNs Failure Modes are Overfitting
Author: Nigel T. Andersen, Takashi Matsubara
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30910v1 Announce Type: new Abstract: Physics-Informed Neural Networks (PINNs) are a common class of machine learning-based partial differential equation (PDE) solvers which train a network to represent a solution by minimizing a residual loss that encodes the PDE. Despite their successes,...
86. Automating Formal Verification with Reinforcement Learning and Recursive Inference
Author: Max Tan
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.SE
arXiv:2605.30914v1 Announce Type: new Abstract: Automated formal verification remains challenging for large language models because data for proof assistants and verification-aware languages is scarce, and correctness depends on satisfying precise machine-checkable specifications rather than produci...
87. Welfare, Improvability, and Variance: A Principal-Agent Approach to Optimal Benchmark Item Aggregation
Author: Andreas Haupt, Justin Hartenstein, Anka Reuel, Mykel Kochenderfer, Sanmi Koyejo
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.GT, econ.TH
arXiv:2605.30916v1 Announce Type: new Abstract: AI benchmarks have well-documented limitations, with prior work examining contamination, saturation, and construct underspecification. Aggregation has received far less attention: benchmarks are typically summarized by uniformly averaging item-level sc...
88. De-attribute to Forget for LLM Unlearning
Author: Xinyang Lu, Jiabao Pan, Rachael Hwee Ling Sim, See-Kiong Ng, Anthony Kum Hoe Tung, Bryan Kian Hsiang Low
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.30919v1 Announce Type: new Abstract: The rapid development of large language models (LLMs) has raised concerns on the use of inappropriate data for training, which has led to a growing interest in LLM unlearning. Many existing LLM unlearning approaches rely on optimizing prediction loss(e...
89. Unsupervised Diffusion Solver for Combinatorial Optimization via Combinatorial Adjoint Matching
Author: Shengyu Feng, Tarun Suresh, Yiming Yang
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30920v1 Announce Type: new Abstract: Diffusion-based neural solvers have shown strong promise for combinatorial optimization (CO), but existing methods typically rely on supervised training with large collections of near-optimal solutions. In this work, we extend adjoint-based trajectory ...
90. Local linear convergence of gradient methods for overparameterized Gaussian mixtures
Author: Jingxing Wang, Vasileios Charisopoulos, Maryam Fazel
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, math.OC, stat.ML
arXiv:2605.30936v1 Announce Type: new Abstract: We study the problem of learning Gaussian mixture models under overparameterization. Prior work has shown that while overparameterization is essential for avoiding spurious local optima and enables global recovery of the ground-truth model using the gr...
91. Spectral Anatomy of Quantum Gaussian Process Kernels
Author: Jian Xu, Chao Li, Guang Lin, Yuning Qiu, Delu Zeng, John Paisley, Qibin Zhao
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30952v1 Announce Type: new Abstract: Two recent results have reshaped quantum Gaussian processes (QGPs). On the one hand, \citet{lowe2025assessing} rule out the exponential speedups claimed by HHL-based QGP regression in the typical, well-conditioned regime; on the other, an independent l...
92. Revisiting Zeroth-Order Hessian Approximation: A Single-Step Policy Optimization Lens
Author: Junbin Qiu, Zhaowei Hong, Renzhe Xu, Yao Shu
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30960v1 Announce Type: new Abstract: Accurate Zeroth-Order (ZO) Hessian estimation is a cornerstone of derivative-free methods, essential for tasks such as bilevel optimization, Bayesian inference, and uncertainty quantification. However, obtaining a complete suite of low-variance estimat...
93. Parallel Tempering Initial Sampling in Inference-Time Reward Alignment
Author: Myeongjun Oh, Gwangho Kim, Sungyoon Lee
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.CV
arXiv:2605.30991v1 Announce Type: new Abstract: Inference-time reward alignment steers pretrained diffusion and flow-based generative models to satisfy user-specified rewards without retraining. Recently, Sequential Monte Carlo (SMC) has emerged as a powerful framework for this task by iteratively f...
94. Eigenvectors of Experts are Training-free Non-collapsing Routers
Author: Giang Do, Hung Le, Truyen Tran
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.30992v1 Announce Type: new Abstract: Sparse Mixture of Experts (SMoE) architectures improve the training efficiency of Large Language Models (LLMs) by routing input tokens to a selected subset of specialized experts. Despite their remarkable success, both training and inference in SMoE mo...
95. Learning Multi-Agent Coordination via Sheaf-ADMM
Author: Jeffrey Seely, Bart{\l}omiej Cupia{\l}, Llion Jones
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31005v1 Announce Type: new Abstract: We present a differentiable optimization framework for multi-agent coordination. An input is decomposed into overlapping local views, each processed by an agent that solves a convex subproblem parameterized by a neural encoder. Agents coordinate throug...
96. DEM: A Distilled Explanation Model for Interpretable Anomaly Detection in Physiological Sensor Networks
Author: Jyotirmoy Singh, Anushka Roy, Shreea Bose, Chittaranjan Hota
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.31007v1 Announce Type: new Abstract: Anomaly detection in physiological sensor data from Wireless Body Area Networks (WBANs) can be caused by sensor faults, network disruptions, or missing data, leading to false alarms. Hence, it demands both high predictive accuracy and clinically interp...
97. Physics-Informed Coarsening for Multigrid Graph Neural Surrogates
Author: Amir Bazzi, David Cardinaux, Ramy Nemer, Jose Alaves, Arjun Kalkur Matpadi Raghavendra, Elie Hachem
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31013v1 Announce Type: new Abstract: Learning-based surrogates for partial differential equations have recently matched the accuracy of classical solvers while achieving orders-of-magnitude speedups, predominantly in fluid settings and structured geometries. In contrast, robust surrogates...
98. SDM-Q: Cost-Aware Staged Decision-Making for Multi-Omics Classification with Deep Q-Learning
Author: Nan Mu, Xiaoyang Fan, Chen Zhao
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31014v1 Announce Type: new Abstract: Multi-omics data provide complementary molecular characterizations of disease phenotypes and play an important role in disease diagnosis and subtype classification in precision medicine. However, acquiring complete multi-omics profiles is expensive and...
99. An Efficient and Scalable Graph Condensation with Structure-Preserving
Author: Yulin Hu, Fuyan Ou, Ye Yuan
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31016v1 Announce Type: new Abstract: Graph condensation (GC) is pivotal for enabling Graph Neural Networks (GNNs) deployment in resource-constrained scenarios by compressing large-scale graphs into compact synthetic counterparts. Existing GC methods commonly suffer from computational inef...
100. Augmented Lagrangian Predictive Coding
Author: Jeffrey Seely, Julian Gould
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31022v1 Announce Type: new Abstract: Predictive coding (PC) is a local-learning alternative to backpropagation (BP), training deep networks via local energy-minimization dynamics rather than a global backward pass. We introduce Augmented Lagrangian Predictive Coding (PC-ALM), which mainta...
101. Multi-Scale Separable Fourier Neural Networks for Solving High-Frequency PDEs
Author: Qihong Yang, Qiaolin He
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31027v1 Announce Type: new Abstract: We propose a novel neural network architecture, termed Multi-Scale Separable Fourier Neural Networks (MS-SFNN), for the accurate and efficient solution of linear and nonlinear high-frequency partial differential equations (PDEs). MS-SFNN exploits a sep...
102. Annealed Softmax Greedy in Many-Armed Bayesian Bandits
Author: William Overman, Mohsen Bayati
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.31034v1 Announce Type: new Abstract: Reinforcement learning with verifiable rewards (RLVR) and group-based policy optimization methods such as GRPO update a stochastic policy by sampling multiple completions per prompt and increasing the policy's probability on those with higher reward, r...
103. UniRTL: Unifying Code and Graph for Robust RTL Representation Learning
Author: Yi Liu, Hongji Zhang, Lei Chen, Mingxuan Yuan, Qiang Xu
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31040v1 Announce Type: new Abstract: Developing effective representations for register transfer level (RTL) designs is crucial for accelerating the hardware design workflow. Existing approaches, however, typically rely on a single data modality, either the RTL code or its associated graph...
104. The Challenges of Using Reinforcement Learning for Controlling Industrial Energy Systems
Author: Tobias Lademann, Th'eo Vincent, Jan Peters, Matthias Weigold
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31044v1 Announce Type: new Abstract: Reinforcement learning has shown promising results for optimizing the control of industrial energy systems, yet most existing studies remain limited to the application in simulation environments. We investigate the challenges of deploying reinforcement...
105. Learning to Solve and Optimize by Evolving Code
Author: Veronika Semmelrock, Benedetta Strizzolo, Francesco Zuccato, Gerhard Friedrich, Patrick Rodler, Konstantin Schekotihin
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.LO
arXiv:2605.31049v1 Announce Type: new Abstract: Combinatorial and optimization problems are fundamental to many industrial AI applications. Solving large-scale real-world instances of such problems typically requires careful problem formalization, specialized solvers, and expert-designed heuristics....
106. Best-Arm Identification-Based Trust Region Selection for Bayesian Optimization on Multimodal Functions
Author: Nobuo Namura, Sho Takemori
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31050v1 Announce Type: new Abstract: Gaussian process-based Bayesian optimization (BO) is a popular approach for expensive black-box optimization, but its performance often degrades on complex multimodal or high-dimensional problems. Trust region-based BO mitigates this issue by focusing ...
107. STEP: Learning STructured Embeddings for Progressive Time Series
Author: Lucas Thil, Jesse Read, Rim Kaddah, Guillaume Doquet
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.31061v1 Announce Type: new Abstract: We present a novel method for learning interpretable representations of progressive time series, that is, data capturing irreversible state transitions such as degradation or task completion. Our approach uses a self-supervised contrastive objective to...
108. Learning to Bid in FCR Markets: A Best-of-Both-Worlds Approach
Author: Marius Potfer, Cheng Wan, Pierre Gruet
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.GT
arXiv:2605.31070v1 Announce Type: new Abstract: Bidding in the European Frequency Containment Reserve (FCR) market is challenging for flexibility providers because competing offers are hidden and bidders observe only partial feedback form the market, such as, clearing price and awarded quantity. For...
109. Riemannian Diffusion Models on General Manifolds via Physics-Informed Neural Networks
Author: Gyeonghoon Ko, Juho Lee
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31106v1 Announce Type: new Abstract: Riemannian diffusion models generalize score-based generative modeling to manifold-supported data via stochastic diffusion equations on the manifold. However, training requires sampling from and differentiating the manifold heat kernel, which is rarely...
110. Subspace-Decomposed JEPAs: Disentangling Progression and Content in Latent World Models
Author: Lucas Thil, Jesse Read, Rim Kaddah, Guillaume Doquet
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31111v1 Announce Type: new Abstract: Joint-Embedding Predictive Architectures (JEPAs) learn compact latent world models by predicting future embeddings, but no single coordinate of the latent is designated to encode task progression. We carve the JEPA latent into two orthogonal subspaces ...
111. Scalable Bayesian Inference for Nonlinear Conservation Laws
Author: Tim Weiland, Philipp Hennig
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.NA, math.NA
arXiv:2605.31127v1 Announce Type: new Abstract: Nonlinear conservation laws are at the heart of many of the most important dynamical systems in science and engineering. In practical applications, such systems are often subject to various sources of uncertainty, e.g. due to sparse or noisy measuremen...
112. Generalizing Multi-Scale Time-Series Modeling with a Single Operator
Author: Cheonwoo Lee, Dooho Lee, Doyun Choi, Jaemin Yoo
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31129v1 Announce Type: new Abstract: Multi-scale modeling has emerged as an effective design principle for time-series forecasting by capturing temporal dynamics at multiple resolutions. As no principled foundation has been established in the literature, we unify existing scaling methods ...
113. Learning Hyperspherical Time-Frequency Representations for Time-Series Out-of-Distribution Detection
Author: Willian T. Lunardi, Samridha Shrestha, Martin Andreoni
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31155v1 Announce Type: new Abstract: Out-of-distribution (OOD) detection for time-series data remains comparatively underexplored compared to vision and language, with a limited principled understanding of how supervised time-series representations can be leveraged for reliable detection ...
114. TabCausal: Pretraining Across Causal Environments for Tabular Causal Discovery
Author: Zi-Rong Li, Si-Yang Liu, Tian-Zuo Wang, Han-Jia Ye
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31156v1 Announce Type: new Abstract: Causal discovery aims to recover directed causal relations from observational and interventional data, providing a basis for mechanistic understanding and reliable decision-making. Causal discovery foundation models (CDFMs) seek to amortize this proble...
115. Trust-Region Behavior Blending for On-Policy Distillation
Author: Daniil Plyusov, Alexey Gorbatovski, Alexey Malakhov, Nikita Balagansky, Boris Shaposhnikov, Daria Korotyshova, Daniil Gavrilov
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.31159v1 Announce Type: new Abstract: On-policy distillation (OPD) trains a student on prefixes sampled from its own policy while matching a stronger teacher. This addresses the prefix mismatch of offline distillation, but early student rollouts can still be poor, placing teacher supervisi...
116. Convergence of Two-Timescale Markovian Stochastic Approximations with Applications in Reinforcement Learning
Author: Vagul Mahadevan, Claire Chen, Shuze Daniel Liu, Shangtong Zhang
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2605.31172v1 Announce Type: new Abstract: This work studies the convergence of two-timescale stochastic approximations (SA), a class of iterative algorithms that update two sets of parameters in fast and slow timescales respectively. Notable examples of two-timescale SA in reinforcement learni...
117. Retriever Portfolios: A Principled Approach to Adaptive RAG
Author: Miltiadis Stouras, Vincent Cohen-Addad, Silvio Lattanzi, Ola Svensson
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.DS
arXiv:2605.31176v1 Announce Type: new Abstract: Retrieval-augmented generation (RAG) systems typically rely on a single retriever and a single set of hyperparameters, despite facing highly heterogeneous queries that range from simple factoid questions to complex multi-hop reasoning. We propose a met...
118. How well does Classification Accuracy capture Concept Drift Detection Quality? An overview of Concept Drift Detection evaluation
Author: Joanna Komorniczak
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31186v1 Announce Type: new Abstract: Data streams are nowadays among the most frequently analyzed data structures, with the concept drift posing a major challenge encountered by processing systems. Despite the proposition of numerous solutions to counteract the accuracy degeneration due t...
119. FlagGAM: Rule-Based Generalized Additive Modeling for Explainable Tabular Prediction
Author: Zijie Zhao, Roy E. Welsch
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31189v1 Announce Type: new Abstract: Tabular prediction in high-stakes domains requires models that are accurate, transparent, and robust to imperfect inputs. We propose FlagGAM, a rule-defined basis framework that separates feature-level rule construction from prediction. A Flag Core Mod...
120. Student Capacity Moderates Knowledge Distillation Effectiveness: A Systematic Study Across ResNet Teacher-Student Pairs on CIFAR-10
Author: Umut Onur Yasar
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.CV
arXiv:2605.31191v1 Announce Type: new Abstract: We investigate how teacher-student capacity relationships modulate knowledge distillation (KD) effectiveness in ResNet-based image classification on CIFAR-10. Across three teacher-student pairs -- R50->R18, R34->R18, and R50->R34 -- we compare Logit-KD...
121. Geometry-based Schr\"odinger Bridges for Trustworthy Multimodal Fusion
Author: Jiayu Xiong, Jing Wang, Qi Zhang, Wanlong Wang, Jun Xue
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31193v1 Announce Type: new Abstract: Real-world multimodal systems must be robust against low-quality data, such as sensor noise, incomplete multimodal data and conflicting inputs. However, existing trustworthy fusion methods rely on the model's own prediction confidence to judge data qua...
122. Beyond Additive Decompositions: Interpretability Through Separability
Author: Jinyang Liu, Munir Eberhardt Hiabu
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2605.31200v1 Announce Type: new Abstract: Interpretable machine learning requires models that are accurate and structurally faithful to the data.Existing explainability methods rely heavily on additive representations (e.g., Generalized Additive Models (GAMs), SHapley Additive exPlanations (SH...
123. Fixed-Point Masked Generative Modeling
Author: Andrea Miele, Yiming Qin, Alba Carballo-Castro, Justin Deschenaux, Pascal Frossard
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.CV
arXiv:2605.31215v1 Announce Type: new Abstract: Masked Generative Models (MGMs) enable parallel decoding and achieve strong performance across modalities, but require full-sequence bidirectional transformers at every step, making training costly and degrading quality under low sampling budgets. Exis...
124. Multivariate Distributional Reinforcement Learning Using Sliced Divergences
Author: Baptiste Debes, Tinne Tuytelaars
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31222v1 Announce Type: new Abstract: Distributional reinforcement learning (DRL) models the full return distribution rather than expectations, but extending it to multivariate settings remains challenging. Many common metrics do not naturally generalize beyond one dimension or lose comput...
125. What changes after deployment? A survey on On-device Learning in TinyML
Author: Massimo Pavan, Luca Pezzarossa, Fabrizio Pittorino, Manuel Roveri, Xenofon Fafoutis
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.31226v1 Announce Type: new Abstract: Machine learning models on microcontroller-class devices (TinyML) face a fundamental challenge: post-deployment distribution change undermines static models. On-device learning (ODL) addresses this by running the learning process directly on the device...
126. EchoRL: Reinforcement Learning via Rollout Echoing
Author: Jinhe Bi, Aniri, Minglai Yang, Xingcheng Zhou, Wenke Huang, Sikuan Yan, Yujun Wang, Zixuan Cao, Michael F"arber, Xun Xiao, Volker Tresp, Yunpu Ma
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.31228v1 Announce Type: new Abstract: Reinforcement Learning with Verifiable Rewards is an effective route for post-training to strengthen the reasoning capability of large language models. However, as training proceeds, the learning signal can collapse thus makes the training gain become ...
127. Bifurcated Remaining Useful Life Prediction: A Hybrid Approach for Realistic Uncertainty Characterization
Author: Xabier Belaunzaran, Antonio Nappa, Arkaitz Artetxe, Basilio Sierra
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31241v1 Announce Type: new Abstract: This study presents a novel hybrid prognostic framework for uncertainty-aware Remaining Useful Life (RUL) estimation in turbofan engines using the NASA C-MAPSS dataset. The framework employs a state-aware strategy that bifurcates the engines operationa...
128. Spectral Reach: Understanding Neural Scaling as Progress into the Spectral Tail
Author: Konstantin Nikolaou, Jonas Scheunemann, Sven Krippendorf, Samuel Tovey, Christian Holm
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, physics.comp-ph
arXiv:2605.31244v1 Announce Type: new Abstract: Neural scaling laws describe predictable power-law relationships between model size, dataset size, compute, and performance. While these laws guide the development of modern foundation models, the mechanisms underpinning them remain poorly understood, ...
129. Toward Identifiable Sparse Autoencoders
Author: Walter Nelson, Theofanis Karaletsos, Francesco Locatello
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31245v1 Announce Type: new Abstract: Recently, sparse autoencoders (SAEs) have emerged as an attractive tool for interpreting and interacting with representations in practical neural networks. While it is common empirical folklore, we also show theoretically that SAEs are highly unstable:...
130. Learning Cardiac Latent Representations in Vectorcardiogram Space
Author: Bosong Huang, Panzhen Zhao, Zengxiang Li, Patricia Lee, Wei Jin, Alan Wee-Chung Liew, Ming Jin, Shirui Pan
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.31249v1 Announce Type: new Abstract: Electrocardiography (ECG) is a cornerstone of cardiac assessment, making the learning of informative ECG representations fundamental to tasks ranging from disease diagnosis to clinical report generation. However, existing methods operate almost exclusi...
131. Fraud Type Decomposition and the Observation-Mechanism Taxonomy:Class-Specific Detection Limits in Payment Networks
Author: Gaurav Dhama
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2605.31257v1 Announce Type: new Abstract: Fraud detection in payment networks relies on labels generated through heterogeneous and imperfect observation processes, yet existing approaches treat fraud as a homogeneous binary variable. We show that this assumption is structurally incorrect and l...
132. Lightweight CNN-Based Anomaly Detection for High Voltage Converter Modulators in the Spallation Neutron Source
Author: Alberto D. Cencillo, Leonardo Concepci'on, Juli'an Luengo, Isaac Triguero
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31259v1 Announce Type: new Abstract: Unscheduled trips of high-power pulsed converters are a leading source of downtime at large accelerator facilities. At the Spallation Neutron Source (SNS), the High Voltage Converter Modulators (HVCMs) are consistently the second-largest contributor to...
133. Why Linear Recurrent Memory Works in Partially Observable Reinforcement Learning
Author: Yike Zhao, Onno Eberhard, Malek Khammassi, Ali H. Sayed, Michael Muehlebach
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, stat.ML
arXiv:2605.31261v1 Announce Type: new Abstract: The family of linear recurrent neural networks has shown strong performance as recurrent memory units in partially observable reinforcement learning. We provide a theoretical justification for their empirical effectiveness by constructing and studying ...
134. Algorithmic Recourse of In-Context Learning for Tabular Data
Author: Wenshuo Dong, Jiaming Zhang, Shaopneg Fu, Hongbin Lin, Di Wang, Lijie Hu
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31272v1 Announce Type: new Abstract: As predictive models are increasingly deployed in high-stakes settings such as credit approval, there is a growing need for post-hoc methods that provide recourse to affected individuals. Many such models operate on tabular data, where features corresp...
135. Survival Reinforcement Learning: Toward Scalable Self-Supervised RL
Author: Franki Nguimatsia-Tiofack, Fabian Schramm, Th'eotime Le Hellard, Justin Carpentier
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31273v1 Announce Type: new Abstract: While self-supervised Contrastive Reinforcement Learning (CRL) has shown remarkable depth-scaling capabilities, successfully using networks over 64 layers, scaled CRL still struggles with long-horizon goal-conditioned planning due to the uniformity-tol...
136. Learning Parametric Nitrogen Fertilizer Response Curves Using Neuro Symbolic Regression
Author: Giorgio Morales, John Sheppard
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31276v1 Announce Type: new Abstract: Accurately modeling crop response to Nitrogen (N) fertilization is a fundamental challenge in precision agriculture, as it impacts both economic returns and environmental sustainability. Existing approaches either rely on predefined parametric forms or...
137. The Terminal Representation in Reinforcement Learning
Author: Amir Esterhuysen, Anders Jonsson
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.31289v1 Announce Type: new Abstract: Representation learning is a powerful tool for spatio-temporal abstraction within reinforcement learning (RL). Two well established approaches are through the successor representation (SR) and the default representation (DR). The SR encodes states by t...
138. Interpretability Without Tradeoffs: Disentangling Polysemanticity At Equal Predictive Performance
Author: Do\u{g}ukan Ba\u{g}c{\i}, Bernt Schiele, Simone Schaub-Meyer, Jonas Fischer, Robin Hesse
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.CV
arXiv:2605.31304v1 Announce Type: new Abstract: Deep neural networks (DNNs) are widely used, but interpreting what they actually learn remains difficult. A major obstacle is that individual neurons often encode multiple unrelated concepts, obscuring the decision process of the network. While prior w...
139. Non-Asymptotic Convergence of Stochastic Iterative Algorithms: A Lyapunov Framework
Author: Zaiwei Chen, Siva Theja Maguluri
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, math.PR, stat.ML
arXiv:2605.31309v1 Announce Type: new Abstract: We survey Lyapunov-based techniques for the finite-time analysis of stochastic iterative algorithms, also known as stochastic approximation (SA) algorithms, for solving fixed-point equations $\bar{F}(x)=x$, where the operator $\bar{F}(\cdot)$ can only ...
140. Graph Neural Networks Are Not Continuous Across Graph Resolutions
Author: Christian Koke, Yuesong Shen, Abhishek Saroha, Marvin Eisenberger, Bastian Rieck, Michael Bronstein, Daniel Cremers
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31315v1 Announce Type: new Abstract: We show that contrary to conventional wisdom in the community, graph neural networks (GNNs) are not continuous with respect to all natural modes of graph convergence. As a result, GNNs may generate substantially different latent representations for gra...
141. Forgetting Has Neighbors: Localized Collateral Forgetting in Machine Unlearning
Author: Polina Dolgova, Sebastian U. Stich
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31317v1 Announce Type: new Abstract: Machine unlearning aims to remove the influence of selected training examples without full retraining. Standard evaluations often summarize unlearning quality with aggregate metrics, such as accuracy- and forgetting-based scores, which can hide localiz...
142. Generalized Intention Modeling in Multi-Agent Reinforcement Learning
Author: Mateusz Odrowaz-Sypniewski, Jasmine Bayrooti, Ajay Shankar, Amanda Prorok
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.MA
arXiv:2605.31318v1 Announce Type: new Abstract: Modeling an opponent's intent is critical for effective decision-making in non-cooperative, competitive, and general-sum multi-agent reinforcement learning. Existing opponent modeling methods encode intent using an embedding derived from episode inform...
143. Inconsistency-Aware Minimization: Improving Generalization with Unlabeled Data
Author: Hee-Sung Kim, Hyeonseong Kim, Sungyoon Lee
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.31324v1 Announce Type: new Abstract: Estimating the generalization gap and developing optimization methods that improve generalization are crucial for deep learning models, for both theoretical understanding and practical applications. Leveraging unlabeled data for these purposes offers s...
144. dashi: A Python library for Dataset Shift Characterization to Support Trustworthy AI Development and Deployment
Author: David Fern'andez-Narro, Pablo Ferri, 'Angel S'anchez-Garc'ia, Juan M. Garc'ia-G'omez, Carlos S'aez
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.31360v1 Announce Type: new Abstract: The Artificial Intelligence (AI) life cycle requires a thorough understanding of the underlying data dynamics for robust, safe and cost-effective AI development and use. Dataset shifts are defined as changes between train and test data distributions. W...
145. Trading Complexity for Expressivity Through Structured Generalized Linear Token Mixing
Author: Erwan Fagnou, Paul Caillon, Blaise Delattre, Alexandre Allauzen
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.CL
arXiv:2605.31367v1 Announce Type: new Abstract: Token mixing layers play a key role in how language models can learn and generate long-range dependencies. Their efficiency relies on the necessary trade-off between decoding speed and the memory requirements, along with the cache size. Considering cau...
146. A Unifying View of Variational Generative Wasserstein Flows
Author: Paul Caucheteux, Cl'ement Bonet, Anna Korba
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.CV
arXiv:2605.31369v1 Announce Type: new Abstract: Many modern generative models can be viewed as minimizing divergences between probability distributions, yet they rely on different algorithmic and geometric principles. Wasserstein gradient flows provide a continuous-time formulation for optimizing ov...
147. Softsign: Smooth Sign in Your Optimizer For Better Parameter Heterogeneity Handling
Author: Dmitrii Feoktistov, Timofey Belinsky, Andrey Veprikov, Amir Zainullin, Aleksandr Beznosikov
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31371v1 Announce Type: new Abstract: Sign-based and LMO-inspired optimizers have recently attracted substantial attention in deep learning due to their strong performance and low memory footprint. However, their fixed-magnitude updates can hurt terminal convergence: they decouple update m...
148. Scaling Higher-Order Graph Learning with Maximal Clique Complexes
Author: Antoine Vialle, Aref Einizade, Fragkiskos D. Malliaros, Jhony H. Giraldo
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.31373v1 Announce Type: new Abstract: Graph neural networks (GNNs) are limited to modeling pairwise interactions, while higher-order models based on cell complexes achieve greater expressivity but often suffer from poor scalability. We introduce simplified and factored cellular Weisfeiler ...
149. Constrained Multi-Objective Reinforcement Learning with Max-Min Criterion
Author: Giseung Park, Hyunyoung Nam, Woohyeon Byeon, Amir Leshem, Youngchul Sung
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31388v1 Announce Type: new Abstract: Multi-Objective Reinforcement Learning (MORL) extends standard RL by optimizing policies with respect to multiple, often conflicting, objectives. While max-min MORL has emerged as an effective approach for promoting fairness, its applicability remains ...
150. Fixed Universal Transformers
Author: Jingwen Liu, Alexandr Andoni, Daniel Hsu
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31423v1 Announce Type: new Abstract: We introduce \emph{universal transformers}: fixed transformers that can simulate any transformer in a given class via a suitable input embedding. Analogous to a universal Turing machine, the input embedding encodes a description of the target model whi...
151. DG-CoLearn: An Efficient Collaborative Learning Framework for Dynamic Graphs
Author: Ashley Hoi-Ting Au, Zikun Zhang, Ligang He, Qiang Ni
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.DC
arXiv:2605.31427v1 Announce Type: new Abstract: Dynamic graph learning (DGL) is essential for modelling evolving graph data, but existing methods suffer from significant computational overhead due to repeated full-snapshot retraining and are not well-suited for collaborative settings with partitione...
152. Flow map learning in nonlinear vector autoregressive models: influence of the feature-library structure on the training error
Author: Markus Gross
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31438v1 Announce Type: new Abstract: Time series forecasting often requires learning nonlinear and time-delayed dependencies. A paradigmatic class of forecasting models are nonlinear vector autoregressive processes (NVAR), also known as next-generation reservoir computers (NG-RCs). These ...
153. DRIFT: Decoupled Rollouts and Importance-Weighted Fine-Tuning for Efficient Multi-Turn Optimization
Author: Jian Mu, Tianyi Lin, Chengwei Qin, Zhongxiang Dai, Yao Shu
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.CL
arXiv:2605.31455v1 Announce Type: new Abstract: Large language models are increasingly deployed in multi-turn interactive settings where users or environments can iteratively provide lightweight feedback. Unfortunately, optimizing such behavior presents a sharp dilemma in practice: online reinforcem...
154. PithTrain: A Compact and Agent-Native MoE Training System
Author: Ruihang Lai, Hao Kang, Haozhan Tang, Akaash R. Parthasarathy, Zichun Yu, Junru Shao, Todd C. Mowry, Chenyan Xiong, Tianqi Chen
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL, cs.DC
arXiv:2605.31463v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) has become the dominant architecture for frontier language models. To meet this demand, production frameworks have built optimized MoE training stacks over years of engineering effort. Yet evolving these stacks for new architec...
155. GPU Forecasters: Language Models as Selective Surrogates for Kernel Runtime Optimization
Author: Zaid Khan, Justin Chih-Yao Chen, Jaemin Cho, Elias Stengel-Eskin, Mohit Bansal
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.31464v1 Announce Type: new Abstract: GPU kernels are the workhorse of modern deep learning, and optimizing them (via evolutionary search or coding agents) usually requires repeated measurement on target hardware. While these measurements provide the ground-truth signal necessary for kerne...
156. Balanced LoRA: Removing Parameter Invariance to Accelerate Convergence
Author: Val'erie Castin, Kimia Nadjahi, Pierre Ablin, Gabriel Peyr'e
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31484v1 Announce Type: new Abstract: Low-Rank Adaptation (LoRA) is the most widely adopted method for fine-tuning large language models. Notably, LoRA is inherently overparameterized: multiple pairs of low-rank factors can yield the same adapted weight matrix. We show--both theoretically ...
157. Graphical einops: bridging tensor networks and computation graphs
Author: Vincent Wang-Ma'scianica, Nikhil Khatri
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, math.CT
arXiv:2605.31485v1 Announce Type: new Abstract: Architecture diagrams are ubiquitous in deep learning, but they are usually only representational: the tensor-program identities they suggest are still proved by prose and tensor-axis manipulation. We introduce a formal graphical calculus for the struc...
158. Assign and Add: A Mechanistic Study of Compositional Arithmetic
Author: Brady Exoo, Alberto Bietti, John Sous
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2605.31497v1 Announce Type: new Abstract: Large language models are able to compose skills in order to perform complex tasks, many of which might not have been seen during training. The details of how exactly this composition occurs remain elusive. In this paper, we study a mechanism for compo...
159. Scalable Inference-Time Annealing with Surrogate Likelihood Estimators
Author: Daniel Pe~naherrera, Rishal Aggarwal, David Ryan Koes
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, q-bio.BM
arXiv:2605.31498v1 Announce Type: new Abstract: A long standing challenge in computational chemistry and biophysics is efficiently sampling the Boltzmann distribution of molecules. Advances in generative modeling have been proposed to address the limitations of conventional sampling techniques by el...
160. On Efficient Scaling of GNNs via IO-Aware Layers Implementations
Author: Daria Fomina, Daniil Krasylnikov, Alexey Boykov, Andrey Dolgovyazov, Vyacheslav Zhdanovskiy, Fedor Velikonivtsev
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.31500v1 Announce Type: new Abstract: Graph Neural Networks (GNNs) are bottlenecked by sparse, irregular memory access. Popular frameworks such as DGL and PyTorch Geometric support general message passing, but complex layers often materialize edge-wise intermediates, increasing memory traf...
161. When Are Multimodal Predictions Biologically Supported? A Diagnostic Evaluation Framework
Author: Dylan Steiner, Gustavo Arango-Argoty, Gerald Sun, Etai Jacob
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2605.31504v1 Announce Type: new Abstract: Multimodal models in oncology can produce accurate predictions, but accurate prediction does not reveal whether the model has learned biology that is shared across modalities, biology confined to one modality, or spurious correlations that reflect conf...
162. Skill Reuse as Compression in Agentic RL
Author: Zhikun Xu, Yu Feng, Jacob Dineen, Taiwei Shi, Jieyu Zhao, Ben Zhou
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.31509v1 Announce Type: new Abstract: Large language model agents trained with reinforcement learning (RL) often learn brittle, task-specific shortcuts. We hypothesize that agents generalize better when their successful trajectories are structurally compressible, decomposed into a small se...
163. On the Relationship Between Activation Outliers and Feature Death in Sparse Autoencoders
Author: Elana Simon, Etowah Adams, James Zou
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31518v1 Announce Type: new Abstract: Sparse autoencoders (SAEs) decompose neural network activations into interpretable features, but many learned features never activate, a problem called feature death that wastes dictionary capacity and can reintroduce superposition. Death rates vary dr...
164. Chem-PerturBridge: a harmonized compendium of small molecule perturbation transcriptomic effects
Author: Artur Sza{\l}ata, Olga Novitskaia, Maiia Shulman, Matthew Mella, Altynbek Zhubanchaliyev, Fabian J. Theis
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, q-bio.GN, q-bio.QM
arXiv:2605.31522v1 Announce Type: new Abstract: Large perturbation models require training data encompassing chemical, cellular, and assay diversity. Current transcriptomic resources for small-molecule modeling, however, are fragmented across technologies, metadata conventions, controls, doses, and ...
165. Value Functions as Supermartingale Certificates
Author: Alessandro Abate, Daniel Contro, Mirco Giacobbe, Agust'in Mart'inez-Su~n'e, Diptarko Roy
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.LO
arXiv:2605.31524v1 Announce Type: new Abstract: Certification methods for stochastic systems provide sufficient proof rules, based on real-valued supermartingale certificates, to determine the almost-sure satisfaction of $\omega$-regular properties (and therefore of linear temporal logic) over gener...
166. The Dynamic-Probabilistic Consistency Gap in Chaotic Surrogate Modeling
Author: Andre Herz, Matthijs Pals, Daniel Durstewitz, Georgia Koppe
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, math.DS, stat.ML
arXiv:2605.31547v1 Announce Type: new Abstract: Dynamical systems reconstruction (DSR) aims to learn surrogate models that capture the dynamics underlying time-series data. Reliably deploying these surrogates requires uncertainty estimates consistent with the learned dynamics. We expose a dynamic-pr...
167. Positional versus Symbolic Attention Heads: Learning Dynamics, RoPE Geometry, and Length Generalization
Author: Felipe Urrutia, Juan Jos'e Alegr'ia, Cinthia Sanchez Macias, Jorge Salas, Cristian B. Calderon, Cristobal Rojas
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.31558v1 Announce Type: new Abstract: Transformer-based language models are widespread in today's society. As such, understanding the mechanisms by which they solve structured tasks and predicting how they may behave in novel scenarios is of great importance for safe deployment. We study t...
168. Functional Attention: From Pairwise Affinities to Functional Correspondences
Author: Jiefang Xiao, Maolin Gao, Simon Weber, Guandao Yang, Daniel Cremers
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31559v1 Announce Type: new Abstract: Learning mappings between infinite-dimensional function spaces, or operator learning, is essential for many machine learning applications. Although transformer-based operators are popular, they often rely on token-wise attention. These methods treat co...
169. Effective Biological Representation Learning by Masking Gene Expression
Author: Kian Kenyon-Dean, Alina Selega, Ihab Bendidi, Jordan M. Sorokin, Luca Bertinetto, David Errington, Hayley Donnella, Oren Kraus
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31562v1 Announce Type: new Abstract: RNA sequencing produces rich and diverse datasets of gene expression, offering compelling insights into cellular state and function that have many applications in drug discovery. Modeling such data is challenging due to inherent technical noise and exp...
170. Giving Sensors a Voice: Multimodal JEPA for Semantic Time-Series Embeddings
Author: Utsav Dutta, Gerardo Pastrana, Sina Khoshfetrat Pakazad, Henrik Ohlsson
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.31580v1 Announce Type: new Abstract: Transformer-based architectures have advanced sequence modeling in language and vision, yet general-purpose representation learning for heterogeneous multivariate time series remains underexplored. We introduce CHARM (Channel-Aware Representation Model...
171. A Tight Theory of Error Feedback Algorithms in Distributed Optimization
Author: Daniel Berg Thomsen, Adrien Taylor, Aymeric Dieuleveut
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, math.OC
arXiv:2605.31594v1 Announce Type: new Abstract: Communication costs are a major bottleneck in distributed learning and first-order optimization. A common approach to alleviate this issue is to compress the gradient information exchanged between agents. However, such compression typically degrades th...
172. TRINE: A Token-Aware, Runtime-Adaptive FPGA Inference Engine for Multimodal AI
Author: Hyunwoo Oh, Hanning Chen, Sanggeon Yun, Yang Ni, Suyeon Jang, Behnam Khaleghi, Fei Wen, Mohsen Imani
Published: 6/1/2026, 4:00:00 AM
Categories: cs.AR, cs.AI, cs.LG
arXiv:2603.22867v1 Announce Type: cross Abstract: Multimodal stacks that mix ViTs, CNNs, GNNs, and transformer NLP strain embedded platforms because their compute/memory patterns diverge and hard real-time targets leave little slack. TRINE is a single-bitstream FPGA accelerator and compiler that exe...
173. Kernel Foundry: A Diagnosis-driven Evolutionary Kernel Optimizer with Multi-Experts
Author: Zixuan Huang, Da Chen, Kecheng Huang, Lihao Yin, Xing Li, Huiling Zhen, Mingxuan Yuan, Zili Shao
Published: 6/1/2026, 4:00:00 AM
Categories: cs.NE, cs.DC, cs.LG, cs.PF, cs.SE, cs.SY, eess.SY
arXiv:2605.30359v1 Announce Type: cross Abstract: Generating high-performance GPU kernels remains challenging due to the need for both correctness and hardware-aware optimization. While large language models (LLMs) show promise in code generation, they often fail to produce kernels that are both cor...
174. Gradient-Free Training of Spiking Neural Networks via Low-Rank Evolution Strategies
Author: Dhruv Patankar, Sachit Ramesha Gowda
Published: 6/1/2026, 4:00:00 AM
Categories: cs.NE, cs.AI, cs.LG
arXiv:2605.30361v1 Announce Type: cross Abstract: Spiking Neural Networks (SNNs) offer compelling energy efficiency on neuromorphic hardware, yet their training remains challenging because the discrete spike threshold is non-differentiable. Surrogate-gradient methods sidestep this by approximating t...
175. Enhancing Regime Shift Detection Using Unstructured Data: A Study on the Treasury Market
Author: Mingxuan Yi, Vidal Mehra, Jing Chen, John Cartlidge
Published: 6/1/2026, 4:00:00 AM
Categories: q-fin.CP, cs.AI, cs.LG, q-fin.ST
arXiv:2605.30363v1 Announce Type: cross Abstract: Regime shifts in financial markets reorganise the joint dynamics of asset prices and macro variables, breaking any single-regime calibration. They are nonetheless difficult to detect reliably because the data signal is noisy and heavily multicollinea...
176. Updating the standard neuron model in artificial neural networks
Author: Raul Mohedano, Thomas Batard, Erik Velasco-Salido, Ramsses De Los Santos Mendoza, Jorge H. Mart'inez, Stacey Levine, Marcelo Bertalm'io
Published: 6/1/2026, 4:00:00 AM
Categories: cs.NE, cs.AI, cs.CV, cs.LG
arXiv:2605.30370v1 Announce Type: cross Abstract: From their inception in the 1950s, artificial neural networks (ANNs) started using the so-called point neuron model then prevalent in neuroscience, hoping that this analogy would allow for a better emulation of brain function. Over the years the neur...
177. From Mean-Field Limits to Semiclassical Concentration: Global Convergence of the Canonical Evolutionary Strategy
Author: Mat'ias Neto, Nicol'as Garay, Luis Mart'i, Nayat Sanchez-Pi
Published: 6/1/2026, 4:00:00 AM
Categories: cs.NE, cs.LG, math.DS
arXiv:2605.30371v1 Announce Type: cross Abstract: We address the issue of global convergence in stochastic continuous optimization. For that purpose, we formulate the Canonical Evolutionary Strategy (CES) as a controlled mathematical framework to analyze global convergence in evolutionary algorithms...
178. Evolutionary Algorithm for Reservoir Learning and Yielding
Author: Julien Testu (UB, Mnemosyne), Pierrick Legrand (ENSC, Bordeaux INP), Xavier Hinaut (Mnemosyne)
Published: 6/1/2026, 4:00:00 AM
Categories: cs.NE, cs.AI, cs.LG, q-bio.NC
arXiv:2605.30372v1 Announce Type: cross Abstract: Reservoir computing, a type of recurrent neural network, is a promising approach for temporal learning as it separates dynamic processing from the trained readout layer. However, classical Echo State Networks (ESNs) often require task-specific tuning...
179. The Inclusion Depth of Pattern Languages: An Open Problem in Algorithmic Learning Theory
Author: Wei Luo
Published: 6/1/2026, 4:00:00 AM
Categories: cs.FL, cs.LG
arXiv:2605.30389v1 Announce Type: cross Abstract: Pattern languages are a classical model in formal language theory and algorithmic learning theory. This note formulates the problem of computing the inclusion depth of a pattern language: the length of the longest strict inclusion chain from the univ...
180. Smaller and Faster 3DGS via Post-Training Dictionary Learning
Author: Jiarong Gong, Jonas Unger, Ehsan Miandji
Published: 6/1/2026, 4:00:00 AM
Categories: cs.GR, cs.LG
arXiv:2605.30396v1 Announce Type: cross Abstract: 3D Gaussian Splatting (3DGS) is a promising neural scene representation for real-time rendering, but trained models often suffer from large memory footprints, limiting deployment on less powerful devices. Existing compression techniques often lead to...
181. A Novel Computer Vision Approach for Assessing Fish Responses to Intrusive Objects in Aquaculture
Author: Hanne-Grete Alvheim, Stian Mjelde Jakobsen, Martin F{\o}re, Eleni Kelasidi
Published: 6/1/2026, 4:00:00 AM
Categories: q-bio.QM, cs.LG, eess.IV
arXiv:2605.30399v1 Announce Type: cross Abstract: The aquaculture industry needs to address several challenges to secure sustainable seafood production that can serve an increasing global demand. One major challenge is to ensure good fish health and acceptable welfare during production since the imp...
182. Exploring Autonomous Agentic Data Engineering for Model Specialization
Author: Yujie Luo, Xiangyuan Ru, Jingsheng Zheng, Jingjing Wang, Yuqi Zhu, Jintian Zhang, Runnan Fang, Kewei Xu, Ye Liu, Zheng Wei, Jiang Bian, Zang Li, Shumin Deng
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.IR, cs.LG
arXiv:2605.30407v1 Announce Type: cross Abstract: Large Language Models (LLMs) have demonstrated strong performance on general tasks, while often struggling to adapt to specialized domains without high-quality domain-specific data. Existing LLM-based data curation methods primarily rely on human-des...
183. Attention-based optimizer for symmetry finding
Author: Shreya Banerjee, Vinodh Raj Rajagopal Muthu, Charlie Nation, Rick P. A. Simon, Francesco Martini, Alessandro Ricottone, Federico Cerisola, Luca Dellantonio
Published: 6/1/2026, 4:00:00 AM
Categories: quant-ph, cs.LG
arXiv:2605.30429v1 Announce Type: cross Abstract: Finding symmetries is crucial for understanding physical models. In this work, we present an optimization framework that searches Pauli symmetries of Hamiltonians, merging the fields of machine learning with automated symmetry finding. Built on a Set...
184. Learning effective models from network dynamics data with multiple initial conditions using weak form SINDy
Author: Moyi Tian, Daniel A. Messenger, Vanja Dukic, Nancy Rodr'iguez, David M. Bortz
Published: 6/1/2026, 4:00:00 AM
Categories: math.DS, cs.LG, cs.SI, nlin.AO, physics.soc-ph
arXiv:2605.30432v1 Announce Type: cross Abstract: Social systems consist of networks of individuals who influence one another through social interactions. Studying how processes evolve on these networks can help us better understand patterns of social behavior. We study a system that couples online ...
185. Generative Models and Statistical Validation
Author: Sascha Diefenbacher, Sofia Palacios Schweitzer, Gregor Kasieczka
Published: 6/1/2026, 4:00:00 AM
Categories: hep-ph, cs.LG, physics.data-an
arXiv:2605.30453v1 Announce Type: cross Abstract: Generative machine learning has become an essential tool in theoretical and experimental physics, especially in the context of fast surrogates and density estimators. In this work, we first introduce the underlying framework of modern generative netw...
186. Local Differential Privacy with Correlated Noise Achieves Central-DP Optimal Cost
Author: Madhura Pathegama, Srikanth Avasarala, Viveck R. Cadambe, Juba Ziani
Published: 6/1/2026, 4:00:00 AM
Categories: cs.IT, cs.CR, cs.LG, math.IT
arXiv:2605.30476v1 Announce Type: cross Abstract: We study privately estimating the sum of $n$ user-held values in the presence of an honest-but-curious server. This motivates requiring privacy not only at data release but also throughout server-side computation. We therefore adopt the local (pure) ...
187. Improved Distribution Estimation in $\ell_\infty$
Author: Doron Cohen, Aryeh Kontorovich, Yonatan Livshitz
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ML, cs.AI, cs.LG
arXiv:2605.30509v1 Announce Type: cross Abstract: We present improved bounds for estimating discrete probability distributions under the $\ell_\infty$ norm. These include minimax bounds in expectation and high-probability tail bounds. We resolve some of the open questions posed in Kontorovich and Pa...
188. Generalistic or Specific Embeddings, Which is Better? An Empirical Study on Search for Clinical Coding in Non-English Languages
Author: David Rey-Blanco, Roberto Cruz
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG
arXiv:2605.30529v1 Announce Type: cross Abstract: Sentence-embedding models for semantic search are overwhelmingly developed and evaluated on English corpora. When applied to clinical retrieval in other languages -- particularly retrieval of ICD-10-CM / CIE-10 codes -- recall degrades in ways often ...
189. True Self-Avoiding Walk for Accelerating Markov-Chain Monte Carlo Integration
Author: Qinghua (Devon), Ding, Venkat Anantharam
Published: 6/1/2026, 4:00:00 AM
Categories: stat.CO, cs.LG, stat.ML
arXiv:2605.30532v1 Announce Type: cross Abstract: We study true self-avoiding walk (TSAW) as a mechanism for improving empirical integral estimation via Markov chain Monte Carlo (MCMC). We consider finite-state adaptive sampling dynamics associated with an irreducible Markov kernel $P$ on a finite s...
190. Speculative Decoding Across Languages
Author: Nirajan Paudel, Michael Ginn, Luc De Nardi, Alexis Palmer
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CL, cs.LG
arXiv:2605.30580v1 Announce Type: cross Abstract: Speculative decoding has become a crucial component of large language model (LLM) inference, enabling faster generation by drafting multiple tokens and verifying them in parallel. However, small draft models tend to suffer from disproportionately poo...
191. Learning effective Sargassum transport dynamics from limited drifter observations
Author: F. J. Beron-VEra, M. J. Olascoaga, J. Morell, E. Cruz
Published: 6/1/2026, 4:00:00 AM
Categories: physics.ao-ph, cs.LG
arXiv:2605.30603v1 Announce Type: cross Abstract: Floating-material transport is influenced by unresolved processes that are often absent from available circulation products. We develop a data-driven transport-learning framework for learning effective transport corrections from limited Lagrangian ob...
192. ZAPS-DA: Zero-Phase Action Policy Smoothing with Decoupled Actor for Continuous Control in Reinforcement Learning
Author: Faiq Shamass
Published: 6/1/2026, 4:00:00 AM
Categories: cs.RO, cs.LG, cs.SY, eess.SY
arXiv:2605.30612v1 Announce Type: cross Abstract: Continuous control policies trained with off-policy reinforcement learning frequently exhibit high-frequency action jitter, rendering direct deployment on physical actuators impractical. Post-hoc filtering attenuates jitter but introduces phase lag; ...
193. CacheProbe: Auditing Prompt Cache Isolation in Gateway APIs
Author: Ryan Fahey
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CR, cs.LG
arXiv:2605.30613v1 Announce Type: cross Abstract: Over the past year, prompt caching in Large Language Models (LLMs) has become increasingly more popular across inference APIs. Prompt caching helps save precious compute resources and speeds up response times by reusing parts of the KV cache of a spe...
194. Reward Learning from Best-of-$N$ Preference Data: Targets, Tradeoffs, and Design Principles
Author: Rattana Pukdee, Maria-Florina Balcan, Pradeep Ravikumar
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ML, cs.AI, cs.LG
arXiv:2605.30619v1 Announce Type: cross Abstract: Best-of-$N$ sampling is widely used to construct pairwise preference data: $N$ candidates are drawn from a base distribution, and the best is paired with a rejected response. Despite its widespread use, what Bradley--Terry (BT) reward learning extrac...
195. Jamming-Resilient PRB Reservation for Latency-Critical O-RAN Network Slicing
Author: Elahe Delavari, Junaid Farooq
Published: 6/1/2026, 4:00:00 AM
Categories: cs.NI, cs.LG
arXiv:2605.30622v1 Announce Type: cross Abstract: Open radio access network (O-RAN) architectures enable near real-time, software-driven control of network slicing through programmable xApps deployed on the near-real-time RAN Intelligent Controller (near-RT RIC). In industrial 5G downlink systems, a...
196. The Architecture of Errors: From Universal Impossibility to Patch-Local LLM Reliability
Author: Mikhail L. Arbuzov, Lee Mosbacker, Sisong Bei, Ziwei Dong, Dmitri Kalaev, Alexey Shvets
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG
arXiv:2605.30628v1 Announce Type: cross Abstract: Universal LLM reliability is not a finite-library problem: across all possible tasks, tools, schemas, knowledge sources, and evaluator expectations, new intervention-distinguishable failure modes can appear without bound, so no finite intervention di...
197. Controllable Lung Nodule Synthesis via Histogram-Regularized Latent Diffusion Models
Author: Arunkumar Kannan, Yanbo Zhang, Han Liu, Michael Baumgartner, Jianing Wang, Alexander Hertel, Bogdan Georgescu, Sasa Grbic
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CV, cs.AI, cs.LG
arXiv:2605.30631v1 Announce Type: cross Abstract: While automated diagnosis systems have achieved remarkable success in computed tomography (CT)-based lung cancer screening, their development remains limited by the scarcity of diverse, annotated pulmonary nodule datasets. Diffusion-based generative ...
198. Rationalize: Shared Semantic Reasoning for Human-AI Alignment
Author: Aritra Dasgupta, Naga Datha Saikiran Battula, Avina Nakarmi, Sohom Sen, Subhodeep Ghosh, Xun Song
Published: 6/1/2026, 4:00:00 AM
Categories: cs.HC, cs.AI, cs.LG
arXiv:2605.30632v1 Announce Type: cross Abstract: We introduce Rationalize, a role-pair framework for shared semantic reasoning between humans and AI models in data-driven sensemaking. Building on ideas in human-machine teaming and critical thinking, we conceptualize human-AI interaction as a series...
199. Depth-Dependent Indirect Prompt Injection in Tool-Calling ReAct Agents: Injection Depth, Payload Framing, and Turn-Budget Sensitivity
Author: Mohammadreza Rashidi
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CR, cs.AI, cs.LG
arXiv:2605.30686v1 Announce Type: cross Abstract: ReAct agents that interleave chain-of-thought reasoning with tool calls are increasingly deployed for real tasks such as scheduling, file retrieval, and data access. Their tool observation loop creates a direct attack surface: an adversary who contro...
200. Mathematical Morphology in Machine Learning
Author: Erick Oliveira Rodrigues, Aura Conci
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2605.30700v1 Announce Type: cross Abstract: This work introduces mathematical morphology-an established visual computing theory-into machine learning to exploit shape and density aspects often overlooked by standard techniques. We propose a fast clustering algorithm based on morphological reco...
201. Equivariant Latent Alignment via Flow Matching under Group Symmetries
Author: Sunghyun Kim, Jaehoon Hahm, Jeongwoo Shin, Joonseok Lee
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2605.30705v1 Announce Type: cross Abstract: Geometry-aware generative models and novel view synthesis approaches have shown strong potential in visual fidelity and consistency. In parallel, equivariant representation learning has emerged as a powerful framework for constructing latent spaces w...
202. SAGE: A Novelty Gate for Efficient Memory Evolution in Agentic LLMs
Author: Sijia Wang, Dhanajit Brahma, Ricardo Henao
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG, stat.ML
arXiv:2605.30711v1 Announce Type: cross Abstract: Agentic LLMs must continuously decide whether newly extracted facts should be added, merged with existing memories, or ignored, yet prior work has focused more on retrieval and storage than on principled write-side control. We frame memory evolution ...
203. Is the Last Layer Sufficient for Uncertainty Quantification?
Author: Joseph Wilson, Chris van der Heide, Liam Hodgkinson, Fred Roosta
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:2605.30741v1 Announce Type: cross Abstract: Epistemic uncertainty quantification (UQ) for deep neural networks (DNNs) is a requirement for safe adoption of AI in mission-critical settings. Several leading methods for UQ linearize DNNs to form Bayesian Generalized Linear Models (GLMs), where ep...
204. Pairwise Reference Alignment as a Model-Level Ordinal Observable
Author: Mujing Li
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CL, cs.LG
arXiv:2605.30758v1 Announce Type: cross Abstract: Pairwise preference data is widely used in language-model evaluation and alignment, often for model ranking, reward modeling, or preference optimization. This note formulates a more basic measurement question: given a reference distribution of pairwi...
205. XLGoBench: Detecting cross-lingual skill gaps with algorithmic tasks
Author: Purvam Jain, Preethi Jyothi, Vihari Piratla, Suvrat Raju
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG
arXiv:2605.30788v1 Announce Type: cross Abstract: We introduce a set of synthetic algorithmic tasks to detect cross-lingual gaps in the abilities of large language models. Our benchmark is commensurate across languages, since it requires models to perform the same underlying task in different langua...
206. Differentially Private Preference Data Synthesis for Large Language Model Alignment
Author: Fengyu Gao, Jing Yang
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CR, cs.AI, cs.LG
arXiv:2605.30808v1 Announce Type: cross Abstract: Preference alignment is a crucial post-training step for large language models (LLMs) to ensure their outputs align with human values. However, post-training on real human preference data raises privacy concerns, as these datasets often contain sensi...
207. The Geometry of Activity Cliffs: Representation Dependence and Multi-Scale Characterization of Activity Landscapes
Author: Pawel Dabrowski-Tumanski, Bartosz Topolski, Dariusz Plewczynski, Tomasz Jetka
Published: 6/1/2026, 4:00:00 AM
Categories: q-bio.QM, cs.LG, physics.chem-ph
arXiv:2605.30831v1 Announce Type: cross Abstract: Activity cliffs, structurally similar compounds with large potency differences, are widely treated as intrinsic features of chemical datasets. We argue that apart from target biology, much of our cliff understanding is a consequence of the geometry i...
208. Send a SCOUT First: Pre-hoc Reasoning for Adaptive Detector Allocation in Prompt-Injection Defense
Author: Shuhao Zhang, Jiarui Li, Qi Cao, Ruiyi Zhang, Pengtao Xie
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CR, cs.LG
arXiv:2605.30837v1 Announce Type: cross Abstract: Prompt-injection detectors are heterogeneous: each is strong on a different slice of attacks, and none is always reliable. Yet existing systems still treat detection as a fixed single-detector pipeline, committing every request to one detector's blin...
209. Bayesian Inference with Shaped Deep Non-linear MLPs
Author: Boris Hanin, Tianze Jiang
Published: 6/1/2026, 4:00:00 AM
Categories: math.ST, cs.LG, math.PR, stat.TH
arXiv:2605.30860v1 Announce Type: cross Abstract: A central aim of deep learning theory is to characterize how neural networks make predictions in the regime of simultaneously large model and training set size. Since the limits of diverging number of model parameters and dataset size do not commute ...
210. Generative Quantum Data Embeddings for Supervised Learning
Author: Jaewoong Heo, Daniel K. Park
Published: 6/1/2026, 4:00:00 AM
Categories: quant-ph, cs.LG
arXiv:2605.30866v1 Announce Type: cross Abstract: Many practically relevant applications of quantum machine learning involve classical data, for which performance depends critically on how inputs are embedded into quantum states. Yet the use of a fixed embedding circuit ansatz remains standard pract...
211. MLIPilot: LLM-Driven Auto-Research for Machine-Learned Interatomic Potentials
Author: Etinosa Osaro, Santosh Adhikari, Stamatia Zavitsanou, Kelsey Parker, Dario Rocca
Published: 6/1/2026, 4:00:00 AM
Categories: physics.chem-ph, cs.LG
arXiv:2605.30889v1 Announce Type: cross Abstract: Constructing production-quality machine-learned interatomic potentials (MLIPs) requires balancing accuracy, dynamical stability, and computational throughput under constraints that are not captured by a single training loss. We introduce MLIPilot, an...
212. A Unifying View of Anchoring via Operator-Side Tikhonov Regularization
Author: Zihao Chen
Published: 6/1/2026, 4:00:00 AM
Categories: math.OC, cs.LG
arXiv:2605.30905v1 Announce Type: cross Abstract: Anchored fixed point and monotone equation methods, including Halpern iteration, extra anchored gradient, and their relatives, add a vanishing pull toward a reference point to obtain last-iterate guarantees. Existing anchored variants often achieve s...
213. BlueFin: Benchmarking LLM Agents on Financial Spreadsheets
Author: Srivatsa Kundurthy, Clara Na, Colton Moraine, Anoushka Mohta, Case Winter, George Fang, John Ling, Emma Strubell, Zach Kirshner
Published: 6/1/2026, 4:00:00 AM
Categories: cs.SE, cs.AI, cs.CL, cs.LG
arXiv:2605.30907v1 Announce Type: cross Abstract: We present BlueFin, a benchmark that tasks large language model (LLM) agents with synthesis, manipulation, and comprehension tasks over spreadsheet workbooks in the professional finance domain. Though estimates of the global population of paying user...
214. Batched Stochastic Linear Bandits with 1-Bit Communication Constraints
Author: Ivan Lau, Daniel McMorrow, Kevin Jamieson, Jonathan Scarlett
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ML, cs.IT, cs.LG, math.IT
arXiv:2605.30976v1 Announce Type: cross Abstract: We study stochastic linear bandits under a natural combination of batching and communication constraints: the time horizon is partitioned into batches of equal size $B$, and during each batch the learner sends $B$ requested arm pulls to an agent, who...
215. Cognitive Fatigue in Autoregressive Transformers: Formalization and Measurement
Author: Riju Marwah, Ritvik Garimella, Vishal Pallagani, Atishay Jain, Michael Stewart, Amit Sheth
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CL, cs.LG
arXiv:2605.30981v1 Announce Type: cross Abstract: Autoregressive language models frequently degrade during long-horizon generation, producing repetitive text, losing instruction adherence, and exhibiting unstable entropy. Despite the prevalence of these failures, practitioners lack online diagnostic...
216. Hedging on the Frontier: Learning New Tasks with Few Samples
Author: Tobias Wegel, Federico Di Gennaro, Geelon So, Fanny Yang
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:2605.30997v1 Announce Type: cross Abstract: When a learner faces a new task with few samples, it must leverage any available side information. In practice, this often comes in the form of model evaluations on related tasks in public benchmarks. A key question then is how to model task relatedn...
217. HetCCL: Enabling Collective Communication For Mixed-Vendor Heterogeneous Clusters
Author: Yuejie Wang, Tao Chang, Yuanyuan Zhao, Yulong Ao, Zeyu Gu, Zhiyu Li, Yanmin Jia, Yan Zhang, Mingjun Zhang, He Liu, Yongzhe He, Yonghua Lin, Guyue Liu
Published: 6/1/2026, 4:00:00 AM
Categories: cs.NI, cs.LG
arXiv:2605.31000v1 Announce Type: cross Abstract: Training Large Language Models (LLMs) on heterogeneous clusters presents significant challenges for collective communication, as hardware from multiple vendors introduces diverse network and computational characteristics. Existing collective communic...
218. A Persona-Based Evaluation Framework for Pluralistic Alignment in Generative AI
Author: Atahan Karagoz
Published: 6/1/2026, 4:00:00 AM
Categories: cs.AI, cs.CL, cs.LG
arXiv:2605.31021v1 Announce Type: cross Abstract: Current alignment paradigms for generative artificial intelligence rely predominantly on monolithic benchmarking frameworks that reduce the plurality of human judgment to aggregated statistical baselines, thereby obscuring cultural, demographic, and ...
219. HADT: A Heterogeneous Multi-Agent Differential Transformer for Autonomous Earth Observation Satellite Cluster
Author: Mohamad A. Hady, Muhammad Anwar Masum, Siyi Hu, Mahardhika Pratama, Jimmy Cao, Ryszard Kowalczyk
Published: 6/1/2026, 4:00:00 AM
Categories: cs.AI, cs.LG, cs.MA
arXiv:2605.31023v1 Announce Type: cross Abstract: This work addresses the problem of autonomous resource management in heterogeneous satellite cluster conducting Earth Observation (EO) missions including optical and Synthetic Aperture Radar (SAR) satellites. In autonomous operation mode, satellites ...
220. Model Monotonicity in Autobidding Auctions: When Do Better Predictions Lead to Better Outcomes?
Author: Ashwinkumar Badanidiyuru
Published: 6/1/2026, 4:00:00 AM
Categories: cs.GT, cs.LG
arXiv:2605.31036v1 Announce Type: cross Abstract: Online advertising platforms rely on machine learning models to predict click-through rates (pCTR) and conversion rates (pCVR) for auction mechanisms. We introduce a novel framework to study the interaction between recommender system model quality, a...
221. Routing on the Stiefel Manifold: When Does Adaptive Subspace Selection Help for Cross-Domain EEG Decoding?
Author: Isabella Costa Maia, Pedro L. C. Rodrigues, Salem Said, Marco Congedo
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ML, cs.AI, cs.LG
arXiv:2605.31043v1 Announce Type: cross Abstract: Cross-domain EEG decoding remains challenging despite advances in Riemannian deep learning: covariance matrices from different subjects occupy systematically distinct regions of the SPD manifold, yet existing domain adaptation methods either require ...
222. LVSA: Training-Free Sparse Attention for Long Video Diffusion
Author: Gael Glorian, Ioannis Lamprou, Zhen Zhang, Yujie Yuan, Hongsheng Liu
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2605.31057v1 Announce Type: cross Abstract: Dense self-attention is the compute and quality bottleneck of long-video diffusion inference: cost grows quadratically with the sequence length, and beyond the training horizon the model converges to near-static output, that is, "frozen" repetitive v...
223. Free energy Estimation on Any State Space
Author: Jiajun He, Zijing Ou, Francisco Vargas, Yingzhen Li, Jos'e Miguel Hern'andez-Lobato, Carles Domingo-Enrich, Yuanqi Du
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ML, cs.LG, physics.chem-ph, physics.comp-ph
arXiv:2605.31063v1 Announce Type: cross Abstract: Free energy estimation is a fundamental yet challenging problem, from physics to statistics. Classical approaches rely on thermodynamic transformations, ranging from direct estimation, quasistatic integration, to finite-time averaging. Recent work [H...
224. Remembering by Reconstructing: Domain Incremental Learning With Test-Time Training on Video Streams
Author: Jonathan Swinnen, Tinne Tuytelaars
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2605.31108v1 Announce Type: cross Abstract: In this work we introduce a novel approach to domain incremental learning, adapting models over time to evolving, non-stationary data. In contrast to other works, we do not attempt to avoid catastrophic forgetting, but rather allow it and exploit it....
225. Don't Fool Me Twice: Adapting to Adversity in the Wild with Experience-Driven Reasoning
Author: Navin Sriram Ravie, Andrew Jong, Krrish Jain, John Liu, Omar Alama, Bijo Sebastian, Sebastian Scherer
Published: 6/1/2026, 4:00:00 AM
Categories: cs.RO, cs.LG
arXiv:2605.31119v1 Announce Type: cross Abstract: In robotics, dangers and adversity modes are often embodiment-specific and relative to each agent. A frontier of autonomous mobile robotics is to enable agents to operate effectively in the wild in unseen unstructured environments. A significant chal...
226. SWIM: Single-Instance Whole-Body Imitation for swiMming
Author: Binglun Wang, Edmond S. L. Ho, He Wang
Published: 6/1/2026, 4:00:00 AM
Categories: cs.GR, cs.AI, cs.LG
arXiv:2605.31120v1 Announce Type: cross Abstract: We propose a new method for synthesizing physically-based swimming motions. Physically-based character animation aims to generate physically valid, controllable, and natural-looking motions which can respond to unexpected disturbances, where one dict...
227. Not All Synthetic Data Is Yours to Learn From
Author: Sina Alemohammad, Li Chen, Richard G. Baraniuk, Zhangyang Wang
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG
arXiv:2605.31126v1 Announce Type: cross Abstract: Can a language model improve from plain text sampled from itself, with no prompts, no teacher, no verifier, and no reward model? Yes, but only when the synthetic corpus is compatible with the student, a relational property of the source-student pair ...
228. FOCUS: Forcing In-Context Object Localization through Visual Support Constraints and Policy Optimization
Author: Mohammed Asad Karim, Vinay Kumar Verma
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CV, cs.AI, cs.LG
arXiv:2605.31145v1 Announce Type: cross Abstract: In-context localization (ICL) seeks to localize a target object specified by a small set of support examples in a query image, operating on the fly without training or parameter updates. Despite rapid advances in vision-language models (VLMs), achiev...
229. Approximation and learning of anisotropic and mixed smooth functions by deep ReLU neural networks
Author: Yunfei Yang, Jun Fan
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ML, cs.LG, cs.NA, math.NA
arXiv:2605.31152v1 Announce Type: cross Abstract: This paper studies how efficiently deep ReLU neural networks can approximate and learn smooth functions. When the error is measured in $L^p([0,1]^d)$ norm and the approximator is a network with width $W$ and depth $L$, recent works have proven the su...
230. Light Interaction: Training-Free Inference Acceleration for Interactive Video World Models
Author: Jiacheng Lu, Haoyi Zhu, Sipei Yi, Enze Xie, Yu Li, Cheng Zhuo
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2605.31158v1 Announce Type: cross Abstract: Interactive video world models generate video chunk by chunk in response to user-controlled camera movements, enabling applications such as real-time game simulation, virtual scene navigation, and embodied AI training. However, scaling to long intera...
231. Memory by Design: Probabilistic Sequence Layers
Author: Matthew Dowling, Hyungju Jeon, Cristina Savin, Il Memming Park
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:2605.31163v1 Announce Type: cross Abstract: We introduce the design-model framework: a way to derive efficient recurrent sequence maps from explicit assumptions about memory. A design model writes evidence into memory by exact Bayesian filtering; a query-dependent readout produces a predictive...
232. Detect in Any Scene: An Agentic Framework for Object Detection with Experience-Aware Reasoning
Author: Wenlun Zhang, Jun Yin, Kentaro Yoshioka
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2605.31174v1 Announce Type: cross Abstract: Object detection in real-world scenarios remains challenging due to diverse image degradations and heterogeneous object distributions, which significantly hinder the generalization of existing detectors. Conventional approaches, including scene-speci...
233. Steering LLMs? Actually, Sparse Autoencoders can outperform simple baselines
Author: Mikkel Godsk J{\o}rgensen, Lars Kai Hansen
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG
arXiv:2605.31183v1 Announce Type: cross Abstract: Sparse Autoencoders (SAEs) have been seen as a promising avenue for exploring the internals of Large Language Models (LLMs) and for steering model output generation. When AxBench - a model steering benchmark - was introduced in Wu et al. (2025), SAEs...
234. From Local Geometry to Global Pseudo Labeling for Robust Positive Unlabeled Learning under Covariate Shift
Author: Firas Gabetni, Alexandre Rocchi Henry, Nacim Belkhir, Ziyi Liu, Gianni Franchi
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2605.31187v1 Announce Type: cross Abstract: Detecting covariate shift is critical for building reliable vision systems. While most prior work focuses on improving robustness to shift, explicitly detecting covariate shift remains underexplored. Existing approaches typically rely on fully superv...
235. Latent Geometric Chords for Query-Efficient Decision-Based Adversarial Attacks
Author: Ei Hmue Khine, Yao Li, Jiebao Sun, Shengzhu Shi, Zhichang Guo, Boying Wu
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CV, cs.CR, cs.LG
arXiv:2605.31219v1 Announce Type: cross Abstract: While decision-based black-box adversarial attacks present a severe security threat, current methodologies suffer from fundamental limitations. Pixel-wise attacks frequently introduce unnatural, high-frequency visual artifacts, while latent-space fra...
236. Shared Doubt: Zero-shot Cross-Lingual Confidence Estimation for Language Models
Author: Athina Kyriakou, Dennis Ulmer, Ivan Titov
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG
arXiv:2605.31220v1 Announce Type: cross Abstract: Confidence estimation (CE), i.e. quantifying the reliability of a model's prediction, has attracted great interest in the context of large language models (LLMs). However, most studies focus on English, ignoring the multilingual reality of LLM usage,...
237. A holomorphic neural network framework for 3D boundary value problems governed by harmonic potentials
Author: Enrico Ballini, Allan Peter Engsig-Karup, Tito Andriollo
Published: 6/1/2026, 4:00:00 AM
Categories: math.NA, cs.LG, cs.NA
arXiv:2605.31231v1 Announce Type: cross Abstract: We present a neural-network-based framework for the solution of three-dimensional boundary value problems where the solution is expressible in terms of harmonic potentials. The approach leverages the Whittaker integral formula, which allows represent...
238. Scaling Multi-Hop Training Data via Graph-Constrained Path Selection
Author: Pengyu Chen, Yonggang Zhang, Mingming Chen, Jun Song, Wei Xue, Yike Guo
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CL, cs.LG
arXiv:2605.31238v1 Announce Type: cross Abstract: Endowing large language models with compositional reasoning over specialized documents requires multi-hop training data at scale, where such data rarely exists outside of curated benchmarks built on structured sources. To construct it directly from p...
239. Correcting Split Selection in Online Decision Trees via Anytime-Valid Inference
Author: Salim I. Amoukou, Saumitra Mishra, Manuela Veloso
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ML, cs.AI, cs.LG
arXiv:2605.31239v1 Announce Type: cross Abstract: Bagging-based ensembles, most notably Adaptive Random Forests, are among the strongest performers for learning from data streams. A common denominator across these methods is their reliance on Hoeffding Trees as base learners, which grow decision tre...
240. Entropic Projection Alignment: Estimating, Explaining, and Improving Model Performance Under Distribution Shift
Author: Salim I. Amoukou, Emanuele Albini, Tom Bewley, Saumitra Mishra, Manuela Veloso
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ML, cs.AI, cs.LG
arXiv:2605.31250v1 Announce Type: cross Abstract: We propose a unified framework for addressing three key challenges of distribution shift: (1) estimating a model's performance on an unlabeled target domain, (2) explaining the shift by identifying the features responsible, and (3) improving the targ...
241. COLLEAGUE.SKILL: Automated AI Skill Generation via Expert Knowledge Distillation
Author: Tianyi Zhou, Dongrui Liu, Leitao Yuan, Jing Shao, Xia Hu
Published: 6/1/2026, 4:00:00 AM
Categories: cs.AI, cs.CL, cs.LG
arXiv:2605.31264v1 Announce Type: cross Abstract: LLM agents are increasingly expected not only to complete isolated tasks, but also to carry bounded representations of human expertise, judgment, and interaction style. Building such person-grounded agents remains difficult because actionable knowled...
242. Envisioning Beyond the Few: Disentangled Semantics and Primitives for Few-Shot Atypical Layout-to-Image Generation
Author: Nan Bao, Yifan Zhao, Wenzhuang Wang, Jia Li
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CV, cs.AI, cs.LG
arXiv:2605.31266v1 Announce Type: cross Abstract: The layout-to-image (L2I) task enables fine-grained control over image generation via object categories and spatial layouts. However, existing L2I methods yield fragmented and distorted generations under few-shot atypical settings. We term this failu...
243. GETA: Generalized Encrypted Traffic Analysis
Author: Ransika Gunasekara, Rahat Masood, Salil Kanhere
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CR, cs.LG
arXiv:2605.31277v1 Announce Type: cross Abstract: Traditional traffic analysis is being fundamentally challenged by the rapid adoption of encryption, tunnelling, and privacy-preserving protocols, which increasingly obscure packet payloads and limit the usefulness of Deep Packet Inspection (DPI). Alt...
244. Industrializing Prediction-Powered Inference: The GLIDE Library for Reliable GenAI and Agentic Systems Evaluation
Author: Gr'egoire Martinon, Ibrahim Merad, Mohammed Raki
Published: 6/1/2026, 4:00:00 AM
Categories: cs.AI, cs.LG, stat.ME
arXiv:2605.31278v1 Announce Type: cross Abstract: Reliable evaluation of agentic systems requires unbiased estimates with valid uncertainty, but standard practice navigates between costly human annotation and biased LLM-as-judge proxies. Prediction-powered inference (PPI) combines both into debiased...
245. Contextual Scalarisation Thompson Sampling for multi-objective decisions in public media
Author: Th'eo Ma"etz, Luc Guillet, Andrea Cavallaro
Published: 6/1/2026, 4:00:00 AM
Categories: cs.IR, cs.LG
arXiv:2605.31291v1 Announce Type: cross Abstract: Recommender systems may operate under multiple, competing objectives. For example, audience reach, cultural values, public service mandate, and operational constraints must be balanced in editorial decisions of public service media. Existing approach...
246. Latent Space Disentanglement via Activation Steering for Interpretable Attribute Control in Symbolic Music Generation
Author: Ioannis Prokopiou, Pantelis Vikatos, Maximos Kaliakatsos-Papakostas, Theodoros Giannakopoulos, Themos Stafylakis
Published: 6/1/2026, 4:00:00 AM
Categories: cs.SD, cs.AI, cs.IR, cs.LG
arXiv:2605.31295v1 Announce Type: cross Abstract: Transformer-based architectures have significantly advanced the generation of complex symbolic sequences, yet a significant gap remains in achieving fine-grained, interpretable control over discrete signal attributes. This paper investigates the mech...
247. mRNAutilus: Multi-Objective-Guided Discrete Generation of mRNA with Optimized Therapeutic Properties
Author: Sawan Patel, Sophia Tang, Yesol Kim, Yinuo Zhang, Divya Srijay, Ping-Jung Lin, Shambhavi Shubham, Fengmei Pi, Cedric Wu, Sherwood Yao, Pranam Chatterjee
Published: 6/1/2026, 4:00:00 AM
Categories: q-bio.BM, cs.LG
arXiv:2605.31296v1 Announce Type: cross Abstract: Therapeutic mRNA design requires coordinating multiple interacting sequence features across the full transcript, where codon usage, untranslated regions (UTRs), and their coupling jointly determine stability, translation efficiency, and protein expre...
248. S$^3$LDBO: A Snapshot Single-Loop Algorithm for Decentralized Bilevel Optimization
Author: Chao Yin, Youran Dong, Shiqian Ma, Bofan Wang, Junfeng Yang
Published: 6/1/2026, 4:00:00 AM
Categories: math.OC, cs.DC, cs.LG
arXiv:2605.31311v1 Announce Type: cross Abstract: Networked AI systems increasingly rely on multiple agents that collaboratively learn and adapt models over communication networks. In such systems, bilevel formulations naturally arise in hyperparameter optimization, data cleaning, and meta-learning,...
249. Log-Ratio Propagation on the Simplex: A Theory of Cellwise Contamination for Compositional Data
Author: Matthias Templ
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ML, cs.LG, stat.ME
arXiv:2605.31345v1 Announce Type: cross Abstract: Compositional data must be analysed through log-ratios: scale invariance, the defining axiom of the field, leaves no alternative. The centred log-ratio divides by the geometric mean of every part, so a single contaminated component shifts every centr...
250. Wall-Clock Complexity for Zeroth-Order Optimization with Tunable Oracle Fidelity
Author: Alexandra Suvorikova, Igor Pavlov, Artem Vasin, Georgii Bychkov, Anastasia Antsiferova, Darina Dvinskikh, Alexander Gasnikov
Published: 6/1/2026, 4:00:00 AM
Categories: math.OC, cs.LG
arXiv:2605.31346v1 Announce Type: cross Abstract: Zeroth-order (black-box) optimization is applied when gradients are unavailable and objective evaluations rely on expensive simulations. In many such applications, the oracle fidelity is tunable: higher-accuracy queries reduce noise but incur higher ...
251. Diagnosing Failure Modes of Shared-State Collaboration in Resource-Constrained Visual Agents
Author: Yunpeng Zhou
Published: 6/1/2026, 4:00:00 AM
Categories: cs.AI, cs.LG
arXiv:2605.31354v1 Announce Type: cross Abstract: Modular visual reasoning systems increasingly rely on shared working memory for multi-step collaboration, yet the failure dynamics of intermediate state evolution in low-capacity regimes remain underexplored. We study failure modes of collaborative r...
252. Dreaming Of Others: Latent Teammate Modeling In World Models For Multi-Agent Reinforcement Learning
Author: Tomas Leroy-Stone
Published: 6/1/2026, 4:00:00 AM
Categories: cs.MA, cs.AI, cs.LG
arXiv:2605.31361v1 Announce Type: cross Abstract: In cooperative multi-agent reinforcement learning (MARL), agents must coordinate with partners whose internal policies and intentions are not directly observable. While world models such as Dreamer have demonstrated strong generalization and sample e...
253. Deep-learning-based low-energy trigger algorithms for the Hyper-Kamiokande experiment
Author: Katharina Lachner, Sa'ul Alonso-Monsalve, Benjamin Richards, Davide Sgalaberna
Published: 6/1/2026, 4:00:00 AM
Categories: physics.ins-det, cs.LG, hep-ex
arXiv:2605.31391v1 Announce Type: cross Abstract: Modern machine learning techniques have become increasingly important in particle physics because of their powerful pattern-recognition capabilities, including in real-time data acquisition where stringent runtime constraints apply. This paper detail...
254. Skill Availability and Presentation Granularity in Large-Language-Model Agents: A Controlled SkillsBench Study
Author: Xiaonan Xu, Wenjing Wu
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG
arXiv:2605.31408v1 Announce Type: cross Abstract: Skill documents provide procedural knowledge to large-language-model agents at inference time. This article studies whether the presentation granularity of controlled skill knowledge changes downstream task success. The experiment uses a pinned Skill...
255. Improved Guarantees for Langevin Monte Carlo with Average Smoothness
Author: Arnak S. Dalalyan, Avetik Karagulyan
Published: 6/1/2026, 4:00:00 AM
Categories: math.ST, cs.LG, stat.TH
arXiv:2605.31413v1 Announce Type: cross Abstract: We establish improved nonasymptotic bounds for Langevin Monte Carlo in the strongly log-concave setting, when the error is measured by the Wasserstein distance. The main result shows that the discretization error is governed by an average coordinate-...
256. Modeling Covariate Transition for Efficient Estimation of Longitudinal Treatment Effects in Randomized Experiments
Author: Naoki Chihara, Tatsushi Oka, Yasuko Matsubara, Yasushi Sakurai, Shota Yasui
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ME, cs.LG, econ.EM, math.ST, stat.TH
arXiv:2605.31443v1 Announce Type: cross Abstract: We present a regression-adjustment framework designed for the estimation of longitudinal treatment effects in randomized experiments under static regimes. While regression-adjustment methods are useful for variance reduction in randomized experiments...
257. Used Car Salesbots? Honesty and Credulity of LLMs as Bargaining Agents under Partial Information
Author: Antonio Valerio Miceli-Barone, Vaishak Belle, Shay B. Cohen
Published: 6/1/2026, 4:00:00 AM
Categories: cs.GT, cs.AI, cs.CL, cs.LG
arXiv:2605.31445v1 Announce Type: cross Abstract: In this work we study agents in simulated bargaining scenarios, where a buyer and a seller communicate through a text channel and attempt to negotiate mutually beneficial trades, under different information regimes (complete information, information ...
258. Consolidating Rewarded Perturbations for LLM Post-Training
Author: Zheyu Zhang, Shuo Yang, Gjergji Kasneci
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CL, cs.LG
arXiv:2605.31494v1 Announce Type: cross Abstract: Post-training of language models is commonly framed as a sample-score-update loop implemented by gradient descent. A recent line of work, exemplified by RandOpt, relocates this loop to weight space, sampling Gaussian perturbations around a pretrained...
259. How can embedding models bind concepts?
Author: Arnas Uselis, Darina Koishigarina, Seong Joon Oh
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2605.31503v1 Announce Type: cross Abstract: Humans easily determine which color belongs to which shape in multi-object scenes, an ability known as concept binding. Vision-language embedding models such as CLIP struggle with binding: they recognize individual concepts but fail to represent whic...
260. Discovering Thermodynamically Admissible Dissipation Potentials via Grammar-Based Symbolic Regression
Author: Federico Califano, Jacopo Ciambella
Published: 6/1/2026, 4:00:00 AM
Categories: cond-mat.soft, cs.LG
arXiv:2605.31532v1 Announce Type: cross Abstract: Constitutive laws for inelastic materials must satisfy strict thermodynamic admissibility requirements, yet current data-driven approaches sacrifice interpretability, even when formal guarantees are provided by physics-encoded architectures. We propo...
261. RayDer: Scalable Self-Supervised Novel View Synthesis from Real-World Video
Author: Ulrich Prestel, Stefan Andreas Baumann, Nick Stracke, Bj"orn Ommer
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CV, cs.AI, cs.LG
arXiv:2605.31535v1 Announce Type: cross Abstract: Self-supervised novel view synthesis (NVS) remains challenging to scale, despite the abundance of video data, largely due to the brittleness of training on realistic videos and the hard-to-predict scaling behavior of multi-network system designs. We ...
262. Automated Prediction of Postoperative Pancreatic Fistula Using Preoperative Computed Tomography
Author: Ashok Choudhary, Chris Varghese, Leo Y. Li-Han, Frank G. Lee, Ellen L. Larson, Elizabeth B. Habermann, Cornelius A. Thiels, Hojjat Salehinejad
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CV, cs.LG, q-bio.QM
arXiv:2605.31539v1 Announce Type: cross Abstract: Postoperative pancreatic fistula (POPF) is a serious complication after pancreatic resection, increasing morbidity, hospital stay, and healthcare costs. We present an automatic, end-to-end deep learning pipeline-from pancreatic segmentation to classi...
263. LongTraceRL: Learning Long-Context Reasoning from Search Agent Trajectories with Rubric Rewards
Author: Nianyi Lin, Jiajie Zhang, Lei Hou, Juanzi Li
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG
arXiv:2605.31584v1 Announce Type: cross Abstract: Long-context reasoning remains a central challenge for large language models, which often fail to locate and integrate key information in extensive distracting content. Reinforcement learning with verifiable rewards (RLVR) has shown promise for this ...
264. KLIP: localized distribution shift detection via KL-divergence with diffusion priors in Inverse Problems
Author: Alireza Kheirandish, Jihoon Hong, Sara Fridovich-Keil
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2605.31596v1 Announce Type: cross Abstract: Diffusion models have shown promising performance as data-driven priors for computational imaging, as well as some capacity to detect out-of-distribution (OOD) images. However, existing approaches to OOD detection often require some knowledge of the ...
265. Advances and Challenges in Meta-Learning: A Technical Review
Author: Anna Vettoruzzo, Mohamed-Rafik Bouguelia, Joaquin Vanschoren, Thorsteinn R"ognvaldsson, KC Santosh
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2307.04722v2 Announce Type: replace Abstract: Meta-learning empowers learning systems with the ability to acquire knowledge from multiple tasks, enabling faster adaptation and generalization to new tasks. This review provides a comprehensive technical overview of meta-learning, emphasizing its...
266. Graph Machine Learning in the Era of Large Language Models (LLMs)
Author: Shijie Wang, Jiani Huang, Zhikai Chen, Yu Song, Wenzhuo Tang, Haitao Mao, Wenqi Fan, Hui Liu, Xiaorui Liu, Dawei Yin, Qing Li
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL, cs.SI
arXiv:2404.14928v3 Announce Type: replace Abstract: Graphs play an important role in representing complex relationships in various domains like social networks, knowledge graphs, and molecular discovery. With the advent of deep learning, Graph Neural Networks (GNNs) have emerged as a cornerstone in ...
267. Forecasting with Hyper-Trees
Author: Alexander M"arz, Kashif Rasul
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, stat.ME
arXiv:2405.07836v5 Announce Type: replace Abstract: We introduce Hyper-Trees as a novel framework for modeling time series data using gradient boosted trees. Unlike conventional tree-based approaches that forecast time series directly, Hyper-Trees learn the parameters of a target time series model, ...
268. HYGENE: A Diffusion-based Hypergraph Generation Method
Author: Dorian Gailhard, Enzo Tartaglione, Lirida Naviner, Jhony H. Giraldo
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.DM
arXiv:2408.16457v5 Announce Type: replace Abstract: Hypergraphs are powerful mathematical structures that can model complex, high-order relationships in various domains, including social networks, bioinformatics, and recommender systems. However, generating realistic and diverse hypergraphs remains ...
269. Learning Coupled Subspaces for Multi-Condition Spike Data
Author: Yididiya Y. Nadew, Xuhui Fan, Christopher J. Quinn
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2410.19153v2 Announce Type: replace Abstract: In neuroscience, numerous studies conduct sensory or behavioral experiments under multiple conditions to acquire neural responses in the form of high-dimensional spike train datasets. Analyzing high-dimensional spike data is a challenging statistic...
270. Adaptive NAD: Online and Self-adaptive Unsupervised Network Anomaly Detector
Author: Yachao Yuan, Yu Huang, Jin Wang
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, eess.SP
arXiv:2410.22967v5 Announce Type: replace Abstract: The widespread usage of the Internet of Things (IoT) has raised the risks of cyber threats; thus, developing Anomaly Detection Systems (ADSs) that can adapt to evolving traffic pattern is critical. Previous studies primarily focused on offline unsu...
271. Minibatch Optimal Transport and Perplexity Bound Estimation in Discrete Flow Matching
Author: Etrit Haxholli, Yeti Z. Gurbuz, Ogul Can, Eli Waxman
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2411.00759v5 Announce Type: replace Abstract: Discrete flow matching, a recent framework for modeling categorical data, has shown competitive performance with autoregressive models. However, unlike continuous flow matching, the rectification strategy cannot be applied due to the stochasticity ...
272. Learning Randomized Reductions
Author: Ferhat Erata, Orr Paradise, Thanos Typaldos, Timos Antonopoulos, ThanhVu Nguyen, Shafi Goldwasser, Ruzica Piskac
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.CC, cs.PL, cs.SE
arXiv:2412.18134v4 Announce Type: replace Abstract: Randomized self-reductions (RSRs) express $f(x)$ using $f$ evaluated at random correlated points, enabling self-correcting programs, instance-hiding protocols, and applications in complexity theory and cryptography. Yet discovering RSRs has require...
273. Learning General Causal Structures with Hidden Dynamic Process for Climate Analysis
Author: Minghao Fu, Biwei Huang, Zijian Li, Yujia Zheng, Ignavier Ng, Guangyi Chen, Yingyao Hu, Kun Zhang
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, stat.ME
arXiv:2501.12500v3 Announce Type: replace Abstract: Understanding climate dynamics requires going beyond correlations in observational data to uncover the underlying causal process. Latent drivers such as atmospheric processes play a central role in temporal dynamics, while direct causal influences ...
274. Auto-Discovery-Bench: Diagnosing Structured State Tracking in Oracle-Guided Discovery
Author: Tingting Chen, Beibei Lin, Srinivas Anumasa, Vedant Shah, Zifeng Yuan, Qiran Zou, Anirudh Goyal, Dianbo Liu
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2502.15224v2 Announce Type: replace Abstract: Interactive discovery requires agents to maintain and update structured beliefs over many rounds of feedback. Before evaluating agents in noisy, open-ended scientific environments, it is useful to isolate this prerequisite capability under controll...
275. How does Bayesian Sampling help Membership Inference Attacks?
Author: Zhenlong Liu, Wenyu Jiang, Feng Zhou, Hongxin Wei
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2503.07482v3 Announce Type: replace Abstract: Membership Inference Attacks (MIAs) aim to estimate whether a specific data point was used in the training of a given model. Existing state-of-the-art attacks typically rely on training multiple reference models to approximate the conditional score...
276. NeUQI: Near-Optimal Uniform Quantization Parameter Initialization for Low-Bit LLMs
Author: Li Lin, Xinyu Hu, Xiaojun Wan
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.CL
arXiv:2505.17595v4 Announce Type: replace Abstract: Large language models (LLMs) achieve impressive performance across domains but face significant challenges when deployed on consumer-grade GPUs or personal devices such as laptops, due to high memory consumption and inference costs. Post-training q...
277. Ubiquity of Emergent Hebbian Dynamics in Regularized Learning
Author: David Koplow, Tomaso Poggio, Liu Ziyin
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, eess.SP
arXiv:2505.18069v3 Announce Type: replace Abstract: Hebbian and anti-Hebbian plasticity are widely observed in the brain and are classically modeled as mechanistic, local homosynaptic rules stabilized by homeostatic constraints. This raises an identifiability question: does observing Hebbian/anti-He...
278. Aggregation Buffer: Revisiting DropEdge with a New Parameter Block
Author: Dooho Lee, Myeong Kong, Sagad Hamid, Cheonwoo Lee, Jaemin Yoo
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2505.20840v2 Announce Type: replace Abstract: We revisit DropEdge, a data augmentation technique for GNNs which randomly removes edges to expose diverse graph structures during training. While being a promising approach to effectively reduce overfitting on specific connections in the graph, we...
279. Who Gets Credit or Blame? Attributing Accountability in Modern AI Systems
Author: Shichang Zhang, Hongzhe Du, Jiaqi W. Ma, Himabindu Lakkaraju
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2506.00175v5 Announce Type: replace Abstract: Modern AI systems are typically developed through multiple stages-pretraining, fine-tuning rounds, and subsequent adaptation or alignment, where each stage builds on the previous ones and updates the model in distinct ways. This raises a critical q...
280. Unlearning's Blind Spots: Over-Unlearning and Prototypical Relearning Attack
Author: SeungBum Ha, Saerom Park, Sung Whan Yoon
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2506.01318v4 Announce Type: replace Abstract: Machine unlearning (MU) aims to expunge a designated forget set from a trained model without costly retraining, yet the existing techniques overlook two critical blind spots: "over-unlearning" that deteriorates retained data near the forget set, an...
281. Feature-Aware (Hyper)graph Generation via Next-Scale Prediction
Author: Dorian Gailhard, Enzo Tartaglione, Lirida Naviner, Jhony H. Giraldo
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.DM
arXiv:2506.01467v3 Announce Type: replace Abstract: Graph generative models perform well on small structured data but struggle to scale to large, complex structures. Hierarchical approaches improve scalability but often ignore node and edge features, which are critical in real-world applications, pa...
282. SHIELD: Secure Hypernetworks for Incremental Expansion Learning Defense
Author: Patryk Krukowski, {\L}ukasz Gorczyca, Piotr Helm, Kamil Ksi\k{a}.zek, Przemys{\l}aw Spurek
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CR
arXiv:2506.08255v4 Announce Type: replace Abstract: Continual learning under adversarial conditions remains an open problem, as existing methods often compromise either robustness, scalability, or both. We propose a novel framework that integrates Interval Bound Propagation (IBP) with a hypernetwork...
283. Unfolding Generative Flows with Koopman Operators: Trajectory-Preserving Linearization
Author: Erkan Turan, Aristotelis Siozopoulos, Louis Martinez, Julien Gaubil, Emery Pierson, Maks Ovsjanikov
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.CV
arXiv:2506.22304v3 Announce Type: replace Abstract: Continuous Normalizing Flows (CNFs) enable elegant generative modeling but remain bottlenecked by their iterative nature requiring costly sampling and lacking interpretability of the intermediate states. Recent approaches accelerate sampling by str...
284. Cost-aware Stopping for Bayesian Optimization
Author: Qian Xie, Linda Cai, Alexander Terenin, Peter I. Frazier, Ziv Scully
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2507.12453v5 Announce Type: replace Abstract: In automated machine learning, scientific discovery, and other applications of Bayesian optimization, deciding when to stop evaluating expensive black-box functions in a cost-aware manner is an important but underexplored practical consideration. A...
285. Population-Free Pareto Tracking for Sample-Efficient Multi-Policy MORL
Author: Zeyu Zhao, Yueling Che, Kaichen Liu, Jian Li, Junmei Yao
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2508.02217v2 Announce Type: replace Abstract: Multi-objective reinforcement learning (MORL) is a fundamental framework for real-world decision-making problems involving multiple conflicting criteria. Existing multi-policy (MP) methods typically rely on online evolutionary frameworks that maint...
286. Residual Reservoir Memory Networks
Author: Matteo Pinna, Andrea Ceni, Claudio Gallicchio
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2508.09925v3 Announce Type: replace Abstract: We introduce a novel class of untrained Recurrent Neural Networks (RNNs) within the Reservoir Computing (RC) paradigm, called Residual Reservoir Memory Networks (ResRMNs). ResRMN combines a linear memory reservoir with a non-linear reservoir, where...
287. Native Hierarchical and Compositional Representations with Subspace Embeddings
Author: Gabriel Moreira, Zita Marinho, Manuel Marques, Jo~ao Paulo Costeira, Chenyan Xiong
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2508.16687v2 Announce Type: replace Abstract: Traditional embeddings represent datapoints as vectors, which makes similarity easy to compute but limits how well they capture hierarchies and compositionality. We propose a fundamentally different approach: representing concepts as linear subspac...
288. Beyond Tokens: Enhancing RTL Quality Estimation via Structural Graph Learning
Author: Yi Liu, Hongji Zhang, Yiwen Wang, Dimitris Tsaras, Lei Chen, Mingxuan Yuan, Qiang Xu
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AR
arXiv:2508.18730v2 Announce Type: replace Abstract: Estimating the quality of register transfer level (RTL) designs is crucial in the electronic design automation (EDA) workflow, as it enables instant feedback on key performance metrics like area and delay without the need for time-consuming logic s...
289. Delayed Momentum Aggregation: Communication-efficient Byzantine-robust Federated Learning with Partial Participation
Author: Kaoru Otsuka, Yuki Takezawa, Makoto Yamada
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, math.OC
arXiv:2509.02970v3 Announce Type: replace Abstract: Partial participation is essential for communication-efficient federated learning at scale, yet existing Byzantine-robust methods typically assume full client participation. In the partial participation setting, a majority of the sampled clients ma...
290. LiMuon: Light and Fast Muon Optimizer for Large Models
Author: Feihu Huang, Yuning Luo, Songcan Chen
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, math.OC
arXiv:2509.14562v3 Announce Type: replace Abstract: Large models recently are widely applied in machine learning, so efficient training of large models has received widespread attention. More recently, the useful Muon optimizer is specifically designed for matrix-structured parameters of large model...
291. Towards Foundation Models for Zero-Shot Time Series Anomaly Detection: Leveraging Synthetic Data and Relative Context Discrepancy
Author: Tian Lan, Hao Duong Le, Jinbo Li, Wenjun He, Meng Wang, Chenghao Liu, Chen Zhang
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2509.21190v5 Announce Type: replace Abstract: Time series anomaly detection (TSAD) is a critical task, but developing models that generalize to unseen data in a zero-shot manner remains challenging. Existing foundation models for TSAD often rely on reconstruction-error scoring at inference tim...
292. Spectral Collapse Drives Loss of Plasticity in Deep Continual Learning
Author: Arjun Prakash, Naicheng He, Kaicheng Guo, Saket Tiwari, Ruo Yu Tao, Tyrone Serapio, Amy Greenwald, George Konidaris
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2509.22335v3 Announce Type: replace Abstract: We investigate why deep neural networks suffer from loss of plasticity in continual learning, and thus fail to learn new tasks without reinitializing parameters. We show that this failure is preceded by Hessian spectral collapse at new-task initial...
293. Federated Learning with Enhanced Privacy via Model Splitting and Random Client Participation
Author: Yiwei Li, Shuai Wang, Zhuojun Tian, Xiuhua Wang, Shijian Su
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2509.25906v2 Announce Type: replace Abstract: Federated Learning (FL) often adopts differential privacy (DP) to protect client data, but the added noise required for privacy guarantees can substantially degrade model accuracy. To resolve this challenge, we propose model-splitting privacy-ampli...
294. Learning a Zeroth-Order Optimizer for Fine-Tuning LLMs
Author: Kairun Zhang, Haoyu Li, Yanjun Zhao, Yifan Sun, Huan Zhang
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2510.00419v2 Announce Type: replace Abstract: Zeroth-order optimizers have recently emerged as an attractive approach for fine-tuning large language models (LLMs), as they avoid backpropagation and can substantially reduce memory overhead relative to standard first-order training. However, exi...
295. Mechanistic Interpretability as Statistical Estimation: A Variance Analysis
Author: Maxime M'eloux, Fran\c{c}ois Portet, Maxime Peyrard
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL
arXiv:2510.00845v4 Announce Type: replace Abstract: Mechanistic Interpretability (MI) aims to reverse-engineer model behaviors by identifying functional sub-networks. Yet, the scientific validity of these findings depends on their stability. In this work, we argue that circuit discovery is not a sta...
296. Re-examining Low Rank adaptation for private LLM fine-tuning
Author: Ali Dadsetan, Frank Rudzicz
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2510.01137v3 Announce Type: replace Abstract: Privacy is a central concern when fine-tuning large language models (LLMs) on sensitive data, and differentially private stochastic gradient descent (DP-SGD) -- which clips per-sample gradients and adds calibrated Gaussian noise -- is the standard ...
297. Adaptive Node Feature Selection For Graph Neural Networks
Author: Madeline Navarro, Ali Azizpour, Santiago Segarra
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2510.03096v3 Announce Type: replace Abstract: We propose an adaptive node feature selection approach for graph neural networks (GNNs) that identifies and removes unnecessary features during training. The ability to measure how features contribute to model output is key for interpreting decisio...
298. Technical note on Sequential Test-Time Adaptation via Martingale-Driven Fisher Prompting
Author: Behraj Khan, Tahir Qasim Syed
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2510.03839v2 Announce Type: replace Abstract: We present a theoretical framework for M-FISHER, a method for sequential distribution shift detection and stable adaptation in streaming data. For detection, we construct an exponential martingale from non-conformity scores and apply Ville's inequa...
299. Expand Neurons, Not Parameters
Author: Linghao Kong, Inimai Subramanian, Yonadav Shavit, Micah Adler, Dan Alistarh, Nir Shavit
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2510.04500v2 Announce Type: replace Abstract: This work demonstrates how increasing the number of neurons in a network without increasing its total number of non-zero parameters improves performance. We show that this gain corresponds with a decrease in interference between multiple features t...
300. PAC-Bayesian Reinforcement Learning Trains Generalizable Policies
Author: Abdelkrim Zitouni, Mehdi Hennequin, Juba Agoun, Ryan Horache, Nadia Kabachi, Omar Rivasplata
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, stat.ML
arXiv:2510.10544v3 Announce Type: replace Abstract: We derive a novel PAC-Bayesian generalization bound for reinforcement learning that explicitly accounts for Markov dependencies in the data, through the chain's mixing time. This contributes to overcoming challenges in obtaining generalization guar...
301. Boundary-Guided Policy Optimization for Memory-efficient RL of Diffusion Large Language Models
Author: Nianyi Lin, Jiajie Zhang, Lei Hou, Juanzi Li
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL
arXiv:2510.11683v3 Announce Type: replace Abstract: A key challenge in applying reinforcement learning (RL) to diffusion large language models (dLLMs) is the intractability of their likelihood functions, which are essential for the RL objective, necessitating corresponding approximation during train...
302. Reinforced sequential Monte Carlo for amortised sampling
Author: Sanghyeok Choi, Sarthak Mittal, V'ictor Elvira, Jinkyoo Park, Esmeralda S. Whitammer
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2510.11711v2 Announce Type: replace Abstract: This paper proposes a synergy of amortised and particle-based methods for sampling from distributions defined by unnormalised density functions. We state a connection between sequential Monte Carlo (SMC) and neural sequential samplers trained by ma...
303. Expert Merging in Sparse Mixture of Experts with Nash Bargaining
Author: Dung V. Nguyen, Anh T. Nguyen, Minh H. Nguyen, Luc Q. Nguyen, Shiqi Jiang, Ethan Fetaya, Linh Duy Tran, Gal Chechik, Tan M. Nguyen
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2510.16138v2 Announce Type: replace Abstract: Existing expert merging strategies for Sparse Mixture of Experts (SMoE) typically rely on input-dependent or input-independent averaging of expert parameters, but often lack a principled weighting mechanism. In this work, we reinterpret expert merg...
304. Scaling Multi-Agent Environment Co-Design with Diffusion Models
Author: Hao Xiang Li, Michael Amir, Amanda Prorok
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.MA
arXiv:2511.03100v2 Announce Type: replace Abstract: The agent-environment co-design paradigm jointly optimises agent policies and environment configurations in search of improved system performance. With application domains ranging from warehouse logistics to windfarm management, co-design promises ...
305. Go-UT-Bench: A Fine-Tuning Dataset for LLM-Based Unit Test Generation in Go
Author: Yashshi Pipalani, Hritik Raj, Rajat Ghosh, Vaishnavi Bhargava, Debojyoti Dutta
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2511.10868v2 Announce Type: replace Abstract: Training data imbalance poses a major challenge for code LLMs. Most available data heavily over represents raw opensource code while underrepresenting broader software engineering tasks, especially in low resource languages like Golang. As a result...
306. Deterministic Inference across Tensor Parallel Sizes That Eliminates Training-Inference Mismatch
Author: Ziyang Zhang, Xinheng Ding, Jiayi Yuan, Rixin Liu, Huizi Mao, Jiarong Xing, Zirui Liu
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.CL, stat.ML
arXiv:2511.17826v2 Announce Type: replace Abstract: Deterministic inference is increasingly critical for large language model (LLM) applications such as LLM-as-a-judge evaluation, multi-agent systems, and Reinforcement Learning (RL). However, existing LLM serving frameworks exhibit non-deterministic...
307. Row-Stochastic Matrices Can Provably Outperform Doubly Stochastic Matrices in Decentralized Learning
Author: Bing Liu, Boao Kong, Limin Lu, Kun Yuan, Chengcheng Zhao
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2511.19513v3 Announce Type: replace Abstract: Decentralized learning often involves a weighted global loss with heterogeneous node weights $\lambda$. We revisit two natural strategies for incorporating these weights: (i) embedding them into the local losses to retain a uniform weight (and thus...
308. IntAttention: A Fully Integer Attention Pipeline for Efficient Edge Inference
Author: Wanli Zhong, Haibo Feng, Zirui Zhou, Hanyang Peng, Shiqi Yu
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2511.21513v2 Announce Type: replace Abstract: Deploying Transformer models on edge devices is limited by latency and energy budgets. While INT8 quantization effectively accelerates the primary matrix multiplications, it exposes the softmax-related path as the dominant bottleneck. This stage in...
309. The SuperActivator Mechanism: Transformers Concentrate Reliable Concept Signals in the Tail
Author: Cassandra Goldberg, Chaehyeon Kim, Adam Stein, Eric Wong
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2512.05038v2 Announce Type: replace Abstract: Concept vectors aim to enhance model interpretability by linking internal representations with human-understandable semantics, but their practical utility is often limited by noisy and inconsistent activations. In this work, we uncover the SuperAct...
310. View Space: Learning Representation across Arbitrary Graphs
Author: Dooho Lee, Myeong Kong, Minho Jeong, Jaemin Yoo
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2512.11561v2 Announce Type: replace Abstract: Generalizing pretrained models to unseen datasets without retraining is a central challenge toward foundation models. Achieving fully inductive inference on numerical data is particularly difficult due to large variations in feature dimensionality ...
311. Softly Constrained Denoisers for Diffusion Models Applied to Partial Differential Equations
Author: Victor M. Yeom-Song, Severi Rissanen, Arno Solin, Samuel Kaski, Mingfei Sun
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2512.14980v4 Announce Type: replace Abstract: Diffusion models have become a powerful generative prior for solutions of partial differential equations (PDEs). Existing approaches enforce physical constraints either by adding the PDE residuals as loss regularizers or through inference-time adju...
312. Bottom-up Policy Optimization: Your Language Model Policy Secretly Contains Internal Policies
Author: Yuqiao Tan, Minzheng Wang, Shizhu He, Huanxuan Liao, Chengfeng Zhao, Qiunan Lu, Tian Liang, Jun Zhao, Kang Liu
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL
arXiv:2512.19673v3 Announce Type: replace Abstract: Existing reinforcement learning (RL) approaches treat large language models (LLMs) as a unified policy, overlooking their internal mechanisms. In this paper, we decompose the LLM-based policy into Internal Layer Policies and Internal Modular Polici...
313. FEM-Bench: A Structured Scientific Reasoning Benchmark for Evaluating Code-Generating LLMs
Author: Saeed Mohammadzadeh, Erfan Hamdi, Joel Shor, Emma Lejeune
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.SE
arXiv:2512.20732v2 Announce Type: replace Abstract: As LLMs advance their reasoning capabilities about the physical world, the absence of rigorous benchmarks for evaluating their ability to generate scientifically valid physical models has become a critical gap. Computational mechanics, which develo...
314. Flow Equivariant World Models: Memory for Partially Observed Dynamic Environments
Author: Hansen Jin Lillemark, Benhao Huang, Fangneng Zhan, Yilun Du, Thomas Anderson Keller
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CV
arXiv:2601.01075v2 Announce Type: replace Abstract: Embodied systems experience the world as 'a symphony of flows': a combination of many continuous streams of sensory input coupled to self-motion, interwoven with the dynamics of external objects. These sensory streams and the underlying dynamics of...
315. Context-Free Recognition with Transformers
Author: Selim Jerad, Anej Svete, Sophie Hao, Ryan Cotterell, William Merrill
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.CC, cs.CL, cs.FL
arXiv:2601.01754v3 Announce Type: replace Abstract: Transformers excel empirically on tasks that process well-formed inputs according to some grammar, such as natural language and code. However, it remains unclear how they can process grammatical syntax. In fact, under standard complexity conjecture...
316. Sequential Subspace Noise Injection Prevents Accuracy Collapse in Certified Unlearning
Author: Polina Dolgova, Sebastian U. Stich
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2601.05134v2 Announce Type: replace Abstract: Certified unlearning based on differential privacy offers strong guarantees but remains largely impractical: the noisy fine-tuning approaches proposed so far achieve these guarantees but severely reduce model accuracy. We propose sequential noise s...
317. Weights to Code: Extracting Interpretable Algorithms from the Discrete Transformer
Author: Yifan Zhang, Wei Bi, Kechi Zhang, Dongming Jin, Jie Fu, Zhi Jin
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.CL
arXiv:2601.05770v3 Announce Type: replace Abstract: Algorithm extraction aims to synthesize executable programs directly from models trained on algorithmic tasks, enabling de novo recovery of executable mechanisms from weights without relying on human-written target programs. However, applying this ...
318. Post-Training Neural Network Pruning using Graph Curvature
Author: Shuhang Tan, Jayson Sia, Paul Bogdan, Radoslav Ivanov
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.SC
arXiv:2601.16366v2 Announce Type: replace Abstract: This paper provides a fresh view of the neural network (NN) pruning problem through the lens of graph theory. To achieve effective pruning, we aim to identify the main NN data flows and the corresponding NN connections that are most and least impor...
319. Accelerated Multiple Wasserstein Gradient Flows for Multi-objective Distributional Optimization
Author: Dai Hai Nguyen, Duc Dung Nguyen, Atsuyoshi Nakamura, Hiroshi Mamitsuka
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2601.19220v2 Announce Type: replace Abstract: We study multi-objective optimization over probability distributions in Wasserstein space. Recently, Nguyen et al. (2025) introduced Multiple Wasserstein Gradient Descent (MWGraD) algorithm, which exploits the geometric structure of Wasserstein spa...
320. From Internal Diagnosis to External Auditing: A VLM-Driven Paradigm for Data-Free Online Backdoor Defense
Author: Binyan Xu, Fan Yang, Xilin Dai, Di Tang, Kehuan Zhang
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.CR
arXiv:2601.19448v2 Announce Type: replace Abstract: Deep Neural Networks remain inherently vulnerable to backdoor attacks. Traditional test-time defenses largely operate under the paradigm of internal diagnosis methods like model repairing or input robustness, yet these approaches are often fragile ...
321. To Grok Grokking: Provable Grokking in Ridge Regression
Author: Mingyue Xu, Gal Vardi, Itay Safran
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2601.19791v3 Announce Type: replace Abstract: We study grokking, the onset of generalization long after overfitting, in a classical ridge regression setting. We prove end-to-end grokking results for learning over-parameterized linear regression models using gradient descent with weight decay. ...
322. Gap-K%: Measuring Top-1 Prediction Gap for Detecting Pretraining Data
Author: Minseo Kwak, Jaehyung Kim
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL
arXiv:2601.19936v2 Announce Type: replace Abstract: The opacity of massive pretraining corpora in Large Language Models (LLMs) raises significant privacy and copyright concerns, making pretraining data detection a critical challenge. Existing state-of-the-art methods typically rely on token likeliho...
323. When More Data Doesn't Help: Limits of Adaptation in Multitask Learning
Author: Steve Hanneke, Mingyue Xu
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2601.20774v2 Announce Type: replace Abstract: Multitask learning and related frameworks have achieved tremendous success in modern applications. In multitask learning problem, we are given a set of heterogeneous datasets collected from related source tasks and hope to enhance the performance a...
324. Identifiable Equivariant Networks are Layerwise Equivariant
Author: Vahid Shahverdi, Giovanni Luca Marchetti, Georg B"okman, Kathl'en Kohn
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, math.CT, math.RT
arXiv:2601.21645v2 Announce Type: replace Abstract: We investigate the relation between end-to-end equivariance and layerwise equivariance in deep neural networks. We prove the following: For a network whose end-to-end function is equivariant with respect to group actions on the input and output spa...
325. Don't be so Stief! Learning KV Cache low-rank approximation over the Stiefel manifold
Author: Luca Benfenati, Matteo Risso, Andrea Vannozzi, Ahmet Caner Y"uz"ug"uler, Lukas Cavigelli, Enrico Macii, Daniele Jahier Pagliari, Alessio Burrello
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2601.21686v2 Announce Type: replace Abstract: Key-value (KV) caching enables fast autoregressive decoding but at long contexts becomes a dominant bottleneck in High Bandwidth Memory (HBM) capacity and bandwidth. A common mitigation is to compress cached keys and values by projecting per-head m...
326. Quantifying the Uncertainty of Foundation Models with Singular Value Ensembles
Author: Mehmet Ozgur Turkoglu, Dominik J. M"uhlematter, Alexander Becker, Konrad Schindler, Helge Aasen
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2601.22068v2 Announce Type: replace Abstract: Foundation models have become a dominant paradigm in machine learning, achieving remarkable performance across diverse tasks through large-scale pretraining. However, they often yield overconfident, uncalibrated predictions. The standard approach t...
327. ParalESN: Enabling parallel information processing in Reservoir Computing
Author: Matteo Pinna, Giacomo Lagomarsini, Andrea Ceni, Claudio Gallicchio
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2601.22296v2 Announce Type: replace Abstract: Reservoir Computing (RC) has established itself as an efficient paradigm for temporal processing. However, its scalability remains severely constrained by the need to process temporal data sequentially and the prohibitive memory footprint of high-d...
328. Learning-to-Defer in Non-Stationary Time Series via Switching State-Space Models
Author: Yannis Montreuil, Letian Yu, Axel Carlier, Lai Xing Ng, Wei Tsang Ooi
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, stat.AP
arXiv:2601.22538v3 Announce Type: replace Abstract: Learning-to-defer (L2D) routes each decision to a system's own predictor or to an external expert. Streaming time-series settings break the offline-L2D assumptions: the data are non-stationary, expert availability shifts over time, and the internal...
329. Float8@2bits: Entropy Coding Enables Data-Free Model Compression
Author: Patrick Putzky, Martin Genzel, Mattes Mollenhauer, Sebastian Schulze, Thomas Wollmann, Stefan Dietzel
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2601.22787v2 Announce Type: replace Abstract: Post-training compression is currently divided into two contrasting regimes. On the one hand, fast, data-free, and model-agnostic methods (e.g., NF4 or HQQ) offer maximum accessibility but suffer from functional collapse at extreme bit-rates below ...
330. Scalable Topology-Preserving Graph Coarsening: Concepts and Algorithms
Author: Xiang Wu, Rong-Hua Li, Xunkai Li, Kangfei Zhao, Hongchao Qin, Guoren Wang
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2601.22943v2 Announce Type: replace Abstract: Graph coarsening reduces the size of a graph while preserving certain properties. Most existing methods preserve either spectral or spatial characteristics. Recent research shows that topology-preserving coarsening methods maintain GNN performance ...
331. dgMARK: Decoding-Guided Watermarking for Diffusion Language Models
Author: Pyo Min Hong, Albert No
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2601.22985v2 Announce Type: replace Abstract: We propose dgMARK, a decoding-guided watermarking method for discrete diffusion language models (dLLMs). Unlike autoregressive models, dLLMs can generate tokens in arbitrary order. While an ideal conditional predictor would be invariant to this ord...
332. SALAAD: Sparse And Low-Rank Adaptation via ADMM for Large Language Model Inference
Author: Hao Ma, Melis Ilayda Bal, Liang Zhang, Bingcong Li, Niao He, Melanie Zeilinger, Michael Muehlebach
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2602.00942v3 Announce Type: replace Abstract: Modern large language models are increasingly deployed under compute and memory constraints, making flexible control of model capacity a central challenge. While sparse and low-rank structures naturally trade off capacity and performance, existing ...
333. The Gaussian-Head OFL Family: One-Shot Federated Learning from Client Global Statistics
Author: Fabio Turazza, Marco Picone, Marco Mamei
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2602.01186v2 Announce Type: replace Abstract: Classical Federated Learning relies on a multi-round iterative process of model exchange and aggregation between server and clients, with high communication costs and privacy risks from repeated model transmissions. In contrast, one-shot federated ...
334. Diving into Kronecker Adapters: Component Design Matters
Author: Jiayu Bai, Danchen Yu, Zhenyu Liao, TianQi Hou, Feng Zhou, Robert C. Qiu, Zenan Ling
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2602.01267v2 Announce Type: replace Abstract: Kronecker adapters have emerged as a promising approach for fine-tuning large-scale models, enabling high-rank updates through tunable component structures. However, existing work largely treats the component structure as a fixed or heuristic desig...
335. An Odd Estimator for Shapley Values
Author: Fabian Fumagalli, Landon Butler, Justin Singh Kang, Kannan Ramchandran, R. Teal Witter
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, stat.ML
arXiv:2602.01399v2 Announce Type: replace Abstract: The Shapley value is a ubiquitous framework for attribution in machine learning, encompassing feature importance, data valuation, and causal inference. However, its exact computation is generally intractable, necessitating efficient approximation m...
336. Plain Transformers are Surprisingly Powerful Link Predictors
Author: Quang Truong, Yu Song, Donald Loveland, Mingxuan Ju, Tong Zhao, Neil Shah, Jiliang Tang
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2602.01553v2 Announce Type: replace Abstract: Link prediction is a core challenge in graph machine learning, demanding models that capture rich and complex topological dependencies. While Graph Neural Networks (GNNs) are the standard solution, state-of-the-art pipelines often rely on explicit ...
337. Towards Long-Horizon Interpretability: Efficient and Faithful Multi-Token Attribution for Reasoning LLMs
Author: Wenbo Pan, Zhichao Liu, Xianlong Wang, Haining Yu, Xiaohua Jia
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2602.01914v4 Announce Type: replace Abstract: Token attribution methods provide intuitive explanations for language model outputs by identifying causally important input tokens. However, as modern LLMs increasingly rely on extended reasoning chains, existing schemes face two critical challenge...
338. FlexRank: Nested Low-Rank Knowledge Decomposition for Adaptive Model Deployment
Author: Riccardo Zaccone, Stefanos Laskaridis, Marco Ciccone, Samuel Horv'ath
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2602.02680v2 Announce Type: replace Abstract: The growing scale of deep neural networks, encompassing large language models (LLMs) and vision transformers (ViTs), has made training from scratch prohibitively expensive and deployment increasingly costly. These models are often used as computati...
339. Causal Evaluation of Membership Inference Attacks
Author: Mathieu Even, Cl'ement Berenfeld, Linus Bleistein, Tudor Cebere, Julie Josse, Aur'elien Bellet
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2602.02819v3 Announce Type: replace Abstract: Membership Inference Attacks (MIAs) aim to distinguish training points (members) from unseen data (non-members), and are widely used to quantify memorization and assess privacy risks. Standard MIA evaluation requires repeated retraining, which is c...
340. Mixture of Concept Bottleneck Experts
Author: Francesco De Santis, Gabriele Ciravegna, Giovanni De Felice, Arianna Casanova, Francesco Giannini, Michelangelo Diligenti, Johannes Schneider, Danilo Giordano, Mateo Espinosa Zarlenga, Pietro Barbiero
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2602.02886v2 Announce Type: replace Abstract: Concept Bottleneck Models (CBMs) promote interpretability by grounding predictions in human-understandable concepts. However, existing CBMs typically constrain their task predictor to a single expression whose functional form is set a priori, limit...
341. Sequential Group Composition: A Window into the Mechanics of Deep Learning
Author: Giovanni Luca Marchetti, Daniel Kunin, Adele Myers, Francisco Acosta, Nina Miolane
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2602.03655v2 Announce Type: replace Abstract: How do neural networks trained over sequences acquire the ability to perform structured operations, such as arithmetic, geometric, and algorithmic computation? To gain insight into this question, we introduce the sequential group composition task. ...
342. The Illusion of Generalization in Tabular Language Models
Author: Aditya Gorla, Ratish Puduppully
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2602.04031v2 Announce Type: replace Abstract: Tabular Language Models (TLMs) have been claimed to achieve strong generalization for tabular prediction. We conduct a systematic re-evaluation of Tabula-8B as a representative TLM, utilizing 165 datasets from the UniPredict benchmark. Our investig...
343. Supervised Learning as Lossy Compression: Characterizing Generalization and Sample Complexity via Finite Blocklength Analysis
Author: Kosuke Sugiyama, Masato Uchida
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.IT, math.IT
arXiv:2602.04107v2 Announce Type: replace Abstract: This paper presents a novel information-theoretic perspective on generalization in machine learning by framing the learning problem within the context of lossy compression and applying finite blocklength analysis. In our approach, the sampling of t...
344. Rationality Measurement and Theory for Reinforcement Learning Agents
Author: Kejiang Qian, Amos Storkey, Fengxiang He
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2602.04737v3 Announce Type: replace Abstract: This paper proposes a suite of rationality measures and associated theory for reinforcement learning agents, a property increasingly critical yet rarely explored. We define an action in deployment to be perfectly rational if it maximises the hidden...
345. End-to-End Compression for Tabular Foundation Models
Author: Guri Zab"ergja, Rafiq Kamel, Arlind Kadra, Christian M. M. Frey, Josif Grabocka
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2602.05649v2 Announce Type: replace Abstract: The long-standing dominance of gradient-boosted decision trees for tabular data has recently been challenged by in-context learning tabular foundation models. In-context learning methods fit and predict in one forward pass without parameter updates...
346. Parameter-free Dynamic Regret: Time-varying Movement Costs, Delayed Feedback, and Memory
Author: Hao Qiu, Andrew Jacobsen, Emmanuel Esposito, Mengxiao Zhang
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2602.06902v2 Announce Type: replace Abstract: In this paper, we study dynamic regret in unconstrained online convex optimization (OCO) with movement costs. Specifically, we generalize the standard setting by allowing the movement cost coefficients $\lambda_t$ to vary arbitrarily over time. Our...
347. Fair Decisions from Calibrated Scores: Achieving Optimal Classification While Satisfying Sufficiency
Author: Etam Benger, Katrina Ligett
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2602.07285v2 Announce Type: replace Abstract: Binary classification based on predicted probabilities (scores) is a fundamental task in supervised machine learning. While thresholding scores is Bayes-optimal in the unconstrained setting, using a single threshold generally violates statistical g...
348. ParisKV: Fast and Drift-Robust KV-Cache Retrieval for Long-Context LLMs
Author: Yanlin Qi, Xinhang Chen, Huiqiang Jiang, Qitong Wang, Botao Peng, Themis Palpanas
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.CL, cs.DB
arXiv:2602.07721v3 Announce Type: replace Abstract: KV-cache retrieval is essential for long-context LLM inference, yet existing methods struggle with distribution drift and high latency at scale. We introduce ParisKV, a drift-robust, GPU-native KV-cache retrieval framework based on collision-based ...
349. A Kinetic Energy Perspective of Flow Matching
Author: Ziyun Li, Huancheng Hu, Soon Hoe Lim, Xuyu Li, Fei Gao, Enmao Diao, Zezhen Ding, Michalis Vazirgiannis, Henrik Bostrom
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2602.07928v2 Announce Type: replace Abstract: Flow-based generative models can be viewed through a physics lens: sampling transports a particle from noise to data by integrating a learned velocity field, and each sample corresponds to a trajectory with its own dynamical effort. Motivated by cl...
350. Inverting Data Transformations via Diffusion Sampling
Author: Jinwoo Kim, S'ekou-Oumar Kaba, Jiyun Park, Seunghoon Hong, Siamak Ravanbakhsh
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2602.08267v2 Announce Type: replace Abstract: We study the problem of transformation inversion on general Lie groups: a datum is transformed by an unknown group element, and the goal is to recover an inverse transformation that maps it back to the original data distribution. Such unknown trans...
351. Breaking the Simplification Bottleneck in Amortized Neural Symbolic Regression
Author: Paul Saegert, Ullrich K"othe
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.SC
arXiv:2602.08885v5 Announce Type: replace Abstract: Symbolic regression (SR) aims to discover interpretable analytical expressions that accurately describe observed data. Amortized SR promises to be much more efficient than the predominant genetic programming SR methods, but currently struggles to s...
352. A Behavioural and Representational Evaluation of Goal-Directedness in Language Model Agents
Author: Raghu Arghal, Fade Chen, Niall Dalton, Evgenii Kortukov, Calum McNamara, Angelos Nalmpantis, Moksh Nirvaan, Gabriele Sarti, Mario Giulianelli
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL, cs.CY
arXiv:2602.08964v2 Announce Type: replace Abstract: Understanding an agent's goals helps explain and predict its behaviour, yet there is no established methodology for reliably attributing goals to agentic systems. We propose a framework for evaluating goal-directedness that integrates behavioural e...
353. Biases in the Blind Spot: Detecting What LLMs Fail to Mention
Author: Iv'an Arcuschin, David Chanin, Adri`a Garriga-Alonso, Oana-Maria Camburu
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2602.10117v5 Announce Type: replace Abstract: Large Language Models (LLMs) often provide chain-of-thought (CoT) reasoning traces that appear plausible, but may hide internal biases. We call these unverbalized biases. Monitoring models via their stated reasoning is therefore unreliable, and exi...
354. What Does Preference Learning Recover from Pairwise Comparison Data?
Author: Rattana Pukdee, Maria-Florina Balcan, Pradeep Ravikumar
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2602.10286v2 Announce Type: replace Abstract: Pairwise preference learning is central to machine learning, with recent applications in aligning language models with human preferences. A typical dataset consists of triplets $(x, y^+, y^-)$, where response $y^+$ is preferred over response $y^-$ ...
355. Token-Efficient Change Detection in LLM APIs
Author: Timoth'ee Chauvin, Cl'ement Lalanne, Erwan Le Merrer, Jean-Michel Loubes, Fran\c{c}ois Ta"iani, Gilles Tredan
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.CR
arXiv:2602.11083v3 Announce Type: replace Abstract: Remote change detection in LLMs is a difficult problem. Existing methods are either too expensive for deployment at scale, or require initial white-box access to model weights or grey-box access to log probabilities. We aim to achieve both low cost...
356. Weight Decay Improves Language Model Plasticity
Author: Tessa Han, Sebastian Bordt, Hanlin Zhang, Sham Kakade
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL
arXiv:2602.11137v2 Announce Type: replace Abstract: Large language models are typically trained in two broad phases: pretraining to produce a base model, followed by further training to improve downstream performance. However, hyperparameter optimization and scaling laws are studied primarily from t...
357. Adaptive Physics Transformer with Fused Global-Local Attention for Subsurface Energy Systems
Author: Xin Ju (Hadrian), Nok Hei (Hadrian), Fung, Yuyan Zhang, Carl Jacquemyn, Matthew Jackson, Randolph Settgast, Sally M. Benson, Gege Wen
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2602.11208v2 Announce Type: replace Abstract: The Earth's subsurface is a cornerstone of modern society, providing essential energy resources like hydrocarbons, geothermal, and minerals while serving as the primary reservoir for $CO_2$ sequestration. However, full physics numerical simulations...
358. Protein Language Model Embeddings Improve Generalization of Implicit Transfer Operators
Author: Panagiotis Antoniadis, Beatrice Pavesi, Simon Olsson, Ole Winther
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, physics.bio-ph
arXiv:2602.11216v2 Announce Type: replace Abstract: Molecular dynamics (MD) is a central computational tool in physics, chemistry, and biology, enabling quantitative prediction of experimental observables as expectations over high-dimensional molecular distributions such as Boltzmann distributions a...
359. Structural Bias Beyond Homophily: A Study of Fairness in Link Prediction
Author: Lilian Marey, Mathilde Perez, Tiphaine Viard, Charlotte Laclau
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2602.11802v2 Announce Type: replace Abstract: Graph link prediction (LP) plays a critical role in socially impactful applications such as job recommendation and friendship formation, making fairness a critical concern in this task. While many fairness-aware methods manipulate graph structures ...
360. Memory-Efficient Structured Backpropagation for On-Device LLM Fine-Tuning
Author: Juneyoung Park, Yuri Hong, Seongwan Kim, Jaeho Lee
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.CL
arXiv:2602.13069v2 Announce Type: replace Abstract: On-device fine-tuning enables privacy-preserving personalization of large language models, but mobile devices impose severe memory constraints, typically 6--12GB shared across all workloads. Existing approaches force a trade-off between exact gradi...
361. The Information Geometry of Softmax: Probing and Steering
Author: Kiho Park, Todd Nief, Yo Joong Choe, Victor Veitch
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL, stat.ML
arXiv:2602.15293v2 Announce Type: replace Abstract: This paper concerns the question of how AI systems encode semantic structure into the geometric structure of their representation spaces. The motivating observation is that the natural geometry of these representation spaces should reflect the way ...
362. Beyond ReLU: Bifurcation, Oversmoothing, and Topological Priors
Author: Erkan Turan, Gaspard Abel, Maysam Behmanesh, Emery Pierson, Maks Ovsjanikov
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2602.15634v2 Announce Type: replace Abstract: Graph Neural Networks (GNNs) learn node representations through iterative network-based message-passing. While powerful, deep GNNs suffer from oversmoothing, where node features converge to a homogeneous, non-informative state. We re-frame this pro...
363. HiPER: Hierarchical Reinforcement Learning with Explicit Credit Assignment for Large Language Model Agents
Author: Jiangweizhi Peng, Yuanxin Liu, Ruida Zhou, Charles Fleming, Zhaoran Wang, Alfredo Garcia, Mingyi Hong
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2602.16165v2 Announce Type: replace Abstract: Training LLMs as interactive agents for multi-turn decision-making remains challenging, particularly in long-horizon tasks with sparse and delayed rewards, where agents must execute extended sequences of actions before receiving meaningful feedback...
364. Position: Evaluation of ECG Representations Must Be Fixed
Author: Zachary Berger, Daniel Prakah-Asante, John Guttag, Collin M. Stultz
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2602.17531v2 Announce Type: replace Abstract: This position paper argues that current benchmarking practice in 12-lead ECG representation learning must be fixed to ensure progress is reliable and aligned with clinically meaningful objectives. The field has largely converged on three public mul...
365. On the "Induction Bias" in Sequence Models
Author: M. Reza Ebrahimi, Micha"el Defferrard, Sunny Panchal, Roland Memisevic
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.CL
arXiv:2602.18333v2 Announce Type: replace Abstract: Despite the remarkable practical success of transformer-based language models, recent work has raised concerns about their ability to perform state tracking. In particular, a growing body of literature has shown this limitation primarily through fa...
366. L2G-Net: Local to Global Spectral Graph Neural Networks via Cauchy Factorizations
Author: Samuel Fern'andez-Mendui~na, Eduardo Pavez, Antonio Ortega
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2602.18837v2 Announce Type: replace Abstract: Despite their theoretical advantages, spectral methods based on the graph Fourier transform (GFT) are seldom used in graph neural networks (GNNs) due to the cost of computing the eigenbasis and the lack of vertex-domain locality in the resulting re...
367. HiPPO Zoo: Explicit Memory Mechanisms for Interpretable State Space Models
Author: Jack Goffinet, Casey Hanks, David E. Carlson
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2602.21340v2 Announce Type: replace Abstract: Representing the past in a compressed, efficient, and informative manner is a central problem for systems trained on sequential data. The HiPPO framework, originally proposed by Gu & Dao et al., provides a principled approach to sequential compress...
368. Mollified Value Learning
Author: Hrishikesh Viswanath, Juanwu Lu, S. Talha Bukhari, Mihir Chauhan, Damon Conover, Ziran Wang, Aniket Bera
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.RO
arXiv:2602.23280v2 Announce Type: replace Abstract: Offline goal-conditioned reinforcement learning (GCRL) learns goal-reaching behaviors from static datasets, but accurate value estimation remains challenging under limited state-action coverage. Existing physics-informed approaches address this by ...
369. MASPOB: Bandit-Based Prompt Optimization for Multi-Agent Systems with Graph Neural Networks
Author: Zhi Hong, Qian Zhang, Jiahang Sun, Zhiwei Shang, Mingze Kong, Xiangyi Wang, Yao Shu, Zhongxiang Dai
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2603.02630v2 Announce Type: replace Abstract: Large Language Models (LLMs) have achieved great success in many real-world applications, especially the one serving as the cognitive backbone of Multi-Agent Systems (MAS) to orchestrate complex workflows in practice. Since many deployment scenario...
370. Rank-Factorized Implicit Neural Bias: Scaling Super-Resolution Transformer with FlashAttention
Author: Dongheon Lee, Seokju Yun, Jaegyun Im, Youngmin Ro
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2603.06738v2 Announce Type: replace Abstract: Recent Super-Resolution~(SR) methods mainly adopt Transformers for their strong long-range modeling capability and exceptional representational capacity. However, most SR Transformers rely heavily on relative positional bias~(RPB), which prevents t...
371. Group Entropies and Mirror Duality: A Class of Flexible Mirror Descent Updates for Machine Learning
Author: Andrzej Cichocki, Piergiulio Tempesta
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, hep-th, math-ph, math.MP
arXiv:2603.08651v2 Announce Type: replace Abstract: We introduce a comprehensive theoretical and algorithmic framework that bridges formal group theory and group entropies with modern machine learning, paving the way for an infinite, flexible family of Mirror Descent (MD) optimization algorithms. Ou...
372. Beyond Test-Time Memory: State-Space Optimal Control for LLM Reasoning
Author: Peihao Wang, Shan Yang, Xijun Wang, Tesi Xiao, Xin Liu, Changlong Yu, Yu Lou, Pan Li, Zhangyang Wang, Ming Lin, Ren'e Vidal
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2603.09221v2 Announce Type: replace Abstract: Associative memory has long underpinned the design of sequential models. Beyond recall, humans reason by projecting future states and selecting goal-directed actions, a capability that modern language models increasingly require but do not natively...
373. Variational Routing: A Scalable Bayesian Framework for Calibrated Mixture-of-Experts Transformers
Author: Albus Yizhuo Li, Matthew Wicker
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, stat.ML
arXiv:2603.09453v3 Announce Type: replace Abstract: Foundation models are increasingly being deployed in contexts where understanding the uncertainty of their outputs is critical to ensuring responsible deployment. While Bayesian methods offer a principled approach to uncertainty quantification, the...
374. Generative Drifting is Secretly Score Matching: a Spectral and Variational Perspective
Author: Erkan Turan, Nicolas Dufour, Maks Ovsjanikov
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2603.09936v2 Announce Type: replace Abstract: Generative Modeling via Drifting~\citep{deng2026drifting} has recently achieved state-of-the-art one-step image generation through a kernel-based drift operator, yet its success is largely empirical and its theoretical foundations remain poorly und...
375. Hybrid Energy-Aware Reward Shaping: A Unified Lightweight Physics-Guided Methodology for Policy Optimization
Author: Qijun Liao, Jue Yang, Yiting Kang, Xinxin Zhao, Yong Zhang, Mingan Zhao
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.SY, eess.SY, math.OC
arXiv:2603.11600v2 Announce Type: replace Abstract: Deep reinforcement learning for continuous control often suffers from high variance, low energy efficiency, and poor generalization under distribution shift, as purely data-driven exploration ignores available physical structure. This paper propose...
376. Surprised by Attention: Predictable Query Dynamics for Time Series Anomaly Detection
Author: Kadir-Kaan "Ozer, Ren'e Ebeling, Markus Enzweiler
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2603.12916v3 Announce Type: replace Abstract: Multivariate time series anomalies often manifest as shifts in cross-channel dependencies rather than simple amplitude excursions. In autonomous driving, for instance, a steering command might be internally consistent but decouple from the resultin...
377. Data-driven Progressive Discovery of Physical Laws
Author: Mingkun Xia, Weiwei Zhang
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, physics.data-an
arXiv:2603.13727v2 Announce Type: replace Abstract: Symbolic regression is a powerful tool for knowledge discovery, enabling the extraction of interpretable mathematical expressions directly from data. However, conventional symbolic discovery typically follows an end-to-end, "one-step" process, whic...
378. Functorial Neural Architectures from Higher Inductive Types
Author: Karen Sargsyan
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, math.AT, math.CT
arXiv:2603.16123v2 Announce Type: replace Abstract: Neural networks often learn the parts of a task but fail on novel combinations of those parts. We argue that this failure is architectural: a decoder generalizes compositionally only when it respects the algebraic laws of the task, i.e. when it des...
379. REAL: Regression-Aware Reinforcement Learning for LLM-as-a-Judge
Author: Yasi Zhang, Tianyu Chen, Mingyuan Zhou, Oscar Leong, Ying Nian Wu, Michal Lukasik
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2603.17145v2 Announce Type: replace Abstract: Large language models (LLMs) are increasingly deployed as automated evaluators that assign numeric scores to model outputs, a paradigm known as LLM-as-a-Judge. However, standard Reinforcement Learning (RL) methods typically rely on binary rewards (...
380. Graph Energy Matching: Transport-Aligned Energy-Based Modeling for Graph Generation
Author: Michal Balcerak, Suprosana Shit, Chinmay Prabhakar, Sebastian Kaltenbach, Michael S. Albergo, Yilun Du, Bjoern Menze
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, stat.ML
arXiv:2603.23398v2 Announce Type: replace Abstract: Generative modeling of discrete data, such as graphs, underpins many scientific and industrial applications, including molecular discovery and materials design. In these domains, probabilistic inference is particularly valuable, as it enables compo...
381. Circuit-Inspired High-Order Neural Networks with Unified Neural Dynamics Modeling for PDE Solving and Visual Perception
Author: Tongfei Chen, Jingying Yang, Linlin Yang, Juan Zhang, Jinhu L"u, David Doermann, Chunyu Xie, Long He, Tian Wang, Guodong Guo, Baochang Zhang
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2603.23977v2 Announce Type: replace Abstract: Deep networks often rely on architectural heuristics to shape representation evolution, limiting their ability to model data governed by intrinsic dynamics. We present the Circuit-inspired High-Order Neural Network (CHONN), a modular framework that...
382. Beyond Static Uncertainty: Modeling Temporal Uncertainty Dynamics for Probabilistic Time Series Forecasting
Author: Yijun Wang, Qiyuan Zhuang, Larysa Marchanka, Xiu-Shen Wei
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2603.24254v3 Announce Type: replace Abstract: Real-world time series exhibit temporally structured uncertainty: volatility clusters in turbulent regimes, dissipates in stable periods, and shifts abruptly around structural breaks. Yet many probabilistic forecasting methods estimate predictive u...
383. A Perturbation Approach to Unconstrained Linear Bandits
Author: Andrew Jacobsen, Dorian Baudry, Shinji Ito, Nicol`o Cesa-Bianchi
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2603.28201v2 Announce Type: replace Abstract: We revisit the standard perturbation-based approach of Abernethy et al. (2008) in the context of unconstrained Bandit Linear Optimization (uBLO). We show the surprising result that in the unconstrained setting, this approach effectively reduces Ban...
384. World Action Verifier: Self-Improving World Models via Forward-Inverse Asymmetry
Author: Yuejiang Liu, Fan Feng, Lingjing Kong, Weifeng Lu, Jinzhou Tang, Kun Zhang, Kevin Murphy, Chelsea Finn, Yilun Du
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.RO
arXiv:2604.01985v2 Announce Type: replace Abstract: General-purpose world models promise scalable policy evaluation, optimization, and planning, yet achieving the required level of robustness remains challenging. Unlike policy learning which primarily focuses on optimal actions, a world model needs ...
385. MENO: MeanFlow-Enhanced Neural Operators for Dynamical Systems
Author: Tianyue Yang, Xiao Xue
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, physics.flu-dyn
arXiv:2604.06881v2 Announce Type: replace Abstract: Neural operators have emerged as powerful surrogates for dynamical systems due to their grid-invariant properties and computational efficiency. However, Fourier-based variants inherently truncate high-frequency components in spectral space, resulti...
386. Symmetry Reveals Layerwise Dynamics: How Transformers Perform In-Context Classification
Author: Patrick Lutz, Themistoklis Haris, Arjun Chandra, Aditya Gangrade, Venkatesh Saligrama
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2604.11613v3 Announce Type: replace Abstract: Transformers can perform in-context classification from a few labeled examples, yet the inference-time algorithm remains opaque. We study multi-class linear classification in the hard no-margin regime and make the computation identifiable by enforc...
387. EEG-Based Multimodal Learning via Hyperbolic Mixture-of-Curvature Experts
Author: Runhe Zhou, Shanglin Li, Guanxiang Huang, Xinliang Zhou, Qibin Zhao, Motoaki Kawanabe, Yi Ding, Cuntai Guan
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2604.12579v3 Announce Type: replace Abstract: Electroencephalography (EEG)-based multimodal learning integrates brain signals with complementary modalities to improve mental state assessment, providing great clinical potential. The effectiveness of such paradigms largely depends on the represe...
388. Multi-Objective Bayesian Optimization via Adaptive \varepsilon-Constraints Decomposition
Author: Yaohong Yang, Sammie Katt, Samuel Kaski
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2604.15959v2 Announce Type: replace Abstract: Multi-objective Bayesian optimization (MOBO) provides a principled framework for optimizing multiple expensive black-box functions. However, existing MOBO methods often struggle with coverage, scalability, and handling constraints and preferences. ...
389. SVL: Goal-Conditioned Reinforcement Learning as Survival Learning
Author: Franki Nguimatsia Tiofack, Fabian Schramm, Th'eotime Le Hellard, Justin Carpentier
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2604.17551v2 Announce Type: replace Abstract: Standard approaches to goal-conditioned reinforcement learning (GCRL) that rely on temporal-difference learning can be unstable and sample-inefficient due to bootstrapping. While recent work has explored contrastive and supervised formulations to i...
390. Conditional Attribution for Root Cause Analysis in Time-Series Anomaly Detection
Author: Shashank Mishra, Karan Patil, Cedric Schockaert, Didier Stricker, Jason Rambach
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2604.17616v2 Announce Type: replace Abstract: Root cause analysis (RCA) for time-series anomaly detection is critical for the reliable operation of complex real-world systems. Existing explanation methods often rely on unrealistic feature perturbations and ignore temporal and cross-feature dep...
391. Compile to Compress: Boosting Formal Theorem Provers by Compiler Outputs
Author: Guchan Li, Rui Tian, Hongning Wang
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.LO, cs.PL
arXiv:2604.18587v2 Announce Type: replace Abstract: Large language models (LLMs) have demonstrated significant potential in formal theorem proving, yet state-of-the-art performance often necessitates prohibitive test-time compute via massive roll-outs or extended context windows. In this work, we ad...
392. Cost-Aware Learning
Author: Clara Mohri, Amir Globerson, Haim Kaplan, Tomer Koren, Yishay Mansour
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2604.28020v2 Announce Type: replace Abstract: We consider the problem of Cost-Aware Learning, where sampling different components of a finite-sum objective incurs different costs. The objective is to reach a target error while minimizing the total cost. We propose Cost-Aware SGD, which uses a ...
393. Polaris: Coupled Orbital Polar Embeddings for Hierarchical Concept Learning
Author: Sahil Mishra, Srinitish Srinivasan, Sourish Dasgupta, Tanmoy Chakraborty
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.00265v2 Announce Type: replace Abstract: Real-world knowledge is often organized as hierarchies such as product taxonomies, medical ontologies, and label trees, yet learning hierarchical representations is challenging due to asymmetric structure and noisy semantics. We introduce Polaris, ...
394. Bayesian Rain Field Reconstruction using Commercial Microwave Links and Diffusion Model Priors
Author: Badr Moufad, Albina Ilina, Hai Victor Habi, Salem Lahlou, Yazid Janati, Hagit Messer, Eric Moulines
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, stat.AP, stat.ML
arXiv:2605.05520v2 Announce Type: replace Abstract: Commercial Microwave Links (CMLs) offer dense spatial coverage for rainfall sensing but produce path-integrated measurements that make accurate ground-level reconstruction challenging. Existing methods typically oversimplify CMLs as point sensors a...
395. Why DDIM Hallucinates More Than DDPM: A Theoretical Analysis of Reverse Dynamics
Author: Muhammad H. Ashiq, Samanyu Arora, Abhinav N. Harish, Ishaan Kharbanda, Hung Yun Tseng, Grigorios G. Chrysos
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.06831v2 Announce Type: replace Abstract: We theoretically study the hallucination phenomena in two canonical diffusion samplers: the stochastic Denoising Diffusion Probabilistic Model (DDPM) and the deterministic Denoising Diffusion Implicit Model (DDIM). We analyze the reverse ODE (DDIM)...
396. Spurious Correlation Learning in Preference Optimization: Mechanisms, Consequences, and Mitigation via Tie Training
Author: Christian Moya, Alex Semendinger, Guang Lin, Elliott Thornley
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.11134v2 Announce Type: replace Abstract: Preference learning methods like Direct Preference Optimization (DPO) are known to induce reliance on spurious correlations, leading to sycophancy and length bias in today's language models and potentially severe goal misgeneralization in future sy...
397. Njord: A Probabilistic Graph Neural Network for Ensemble Ocean Forecasting
Author: Daniel Holmberg, Joel Oskarsson, Erik Wikingsson, Fredrik Lindsten, Teemu Roos
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, physics.ao-ph
arXiv:2605.15470v2 Announce Type: replace Abstract: Ocean dynamics are inherently chaotic, yet existing machine learning ocean models produce only deterministic forecasts. We introduce Njord, a probabilistic data-driven model for ocean forecasting, applicable to both global and regional domains. Njo...
398. Rethinking Neural Network Learning Rates: A Stackelberg Perspective
Author: Sihan Zeng, Sujay Bhatt, Sumitra Ganesh
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.15530v3 Announce Type: replace Abstract: Neural networks are typically trained with a single learning rate across all layers. While recent empirical evidence suggests that assigning layer-specific learning rates can accelerate training, a principled understanding of the conditions and mec...
399. Differentiable Mixture-of-Agents Incentivizes Swarm Intelligence of Large Language Models
Author: Xingjian Wu, Junkai Lu, Siyu Yan, Xiangfei Qiu, Jilin Hu, Chenjuan Guo, Bin Yang
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.15706v2 Announce Type: replace Abstract: Recent advances in Large Language Models (LLMs) have catalyzed the development of multi-agent systems (MAS) for complex reasoning tasks. However, existing MAS typically rely on pre-defined or pre-compiled communication topologies, which limits thei...
400. FML-bench: A Controlled Study of AI Research Agent Strategies from the Perspective of Search Dynamics
Author: Qiran Zou, Hou Hei Lam, Wenhao Zhao, Tingting Chen, Yiming Tang, Samson Yu, Yingtao Zhu, Srinivas Anumasa, Zufeng Zhang, Tianyi Zhang, Chang Liu, Zhengyao Jiang, Anirudh Goyal, Dianbo Liu
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.17373v2 Announce Type: replace Abstract: AI research agents accelerate ML research by automating hypothesis generation, experimentation, and empirical refinement. Existing agent strategies range from greedy hill-climbing to tree search and evolutionary optimization, yet which strategy cho...
401. Covariance Structure and Coordinate Heterogeneity Govern Binary Quantization of Contrastive Embeddings
Author: Wenxuan Xiao
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.DB
arXiv:2605.17524v2 Announce Type: replace Abstract: Binary quantization (BQ) compresses high-dimensional embeddings into one or two bits per coordinate, enabling nearest neighbor search at extreme speed. Yet a striking puzzle persists: BQ achieves competitive recall on contrastive embeddings but fai...
402. Interaction-Breaking Adversarial Learning Framework for Robust Multi-Agent Reinforcement Learning
Author: Sunwoo Lee, Mingu Kang, Yonghyeon Jo, Seungyul Han
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.MA
arXiv:2605.18024v2 Announce Type: replace Abstract: Cooperation is central to multi-agent reinforcement learning (MARL), yet learned coordination can be fragile when external perturbations disrupt inter-agent interactions. Prior robust MARL methods have primarily considered value-oriented attacks, l...
403. Proximal basin hopping: global optimization with guarantees
Author: Guillaume Lauga (LJAD), Cesare Molinari (MaLGA), Samuel Vaiter (CNRS, LJAD)
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, math.OC
arXiv:2605.18364v2 Announce Type: replace Abstract: Global optimization is a challenging problem, with plenty of algorithms displaying empirical success, but scarce theoretical backing. In this work, we propose a new theoretical framework called Proximal Basin Hopping (PBH), carefully tailored to co...
404. PROWL: Prioritized Regret-Driven Optimization for World Model Learning
Author: Ahmet H. G"uzel, Jenny Seidenschwarz, Benjamin Graham, Jonathan Sadeghi, Jeffrey Hawke, Ilija Bogunovic
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.18803v2 Announce Type: replace Abstract: Modern action-conditioned video world models achieve strong short-horizon visual realism, yet remain unreliable on rare, interaction-critical transitions that dominate downstream planning and policy performance. Because passive demonstration data s...
405. Block-Based Double Decoders
Author: Asher Labovich, Benjamin Bradley, Vanessa Alexander, Chaitanya Harsha
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.18807v2 Announce Type: replace Abstract: Encoder-decoder models offer substantial inference-time savings over decoder-only models, but their pretraining objectives suffer from sparse supervision and dynamic sequence lengths, keeping them out of practice at scale. We propose block-based do...
406. PMF-CL: Pareto-Minimal-Forgetting Continual Learner for Conflicting Tasks
Author: Srijith Nair, Atilla Eryilmaz, Jia Liu
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.19145v2 Announce Type: replace Abstract: In the literature, many continual learning (CL) algorithms have been proposed to address the issue of catastrophic forgetting in ML models (i.e., learning new tasks leads to the loss of performance on previously learned tasks). Although all CL appr...
407. D$^3$-Subsidy: Online and Sequential Driver Subsidy Decision-Making for Large-Scale Ride-Hailing Market
Author: Taijie Chen, Rui Su, Siyuan Feng, Laoming Zhang, Hongyang Zhang, Haijiao Wang, Zhaofeng Ma, Jintao Ke, Li Ma
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.20036v4 Announce Type: replace Abstract: Ride-hailing platforms like DiDi Chuxing operate in highly dynamic environments where balancing driver supply and passenger demand is critical. Although driver-side subsidies serve as a primary lever to align these forces and improve key KPIs like ...
408. Efficient Learning of Deep State Space Models via Importance Smoothing
Author: John-Joseph Brady, Nikolas Nusken, Yunpeng Li
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.21108v2 Announce Type: replace Abstract: Latent state space systems are ubiquitous in statistical modelling, arising naturally when time series are observed through noisy measurements. However, training deep state space models (DSSMs) at scale remains difficult. Two largely distinct strat...
409. PRISM: Preference-Aware Influence Function Based Data Selection Method for Efficient Fine-Tuning
Author: Qihao Lin, Guanxu Chen, Dongrui Liu, Jing Shao
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.21422v2 Announce Type: replace Abstract: As LLMs continue to scale up, improving training efficiency heavily relies on effective data utilization. Data selection mitigates this issue by allocating the limited training budget to high-value examples that optimally facilitate the model's tar...
410. Agent JIT Compilation for Latency-Optimizing Web Agent Planning and Scheduling
Author: Caleb Winston, Ron Yifeng Wang, Azalia Mirhoseini, Christos Kozyrakis
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.21470v2 Announce Type: replace Abstract: Computer-use agents (CUAs) automate tasks specified with natural language such as "order the cheapest item from Taco Bell" by generating sequences of calls to tools such as click, type, and scroll on a browser. Current implementations follow a sequ...
411. The Distillation Game: Adaptive Attacks & Efficient Defenses
Author: Youssef Allouah, Mahdi Haghifam, Sanmi Koyejo, Reza Shokri
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.22737v3 Announce Type: replace Abstract: Distillation attacks create a deployment trade-off for model providers: the same outputs that make a model more useful can also make it easier to imitate. We study this trade-off through a minimax game between a utility-constrained teacher and an a...
412. Learned Relay Representations for Forward-Thinking Discrete Diffusion Models
Author: Benjamin Rozonoyer, Jacopo Minniti, Dhruvesh Patel, Neil Band, Avishek Joey Bose, Tim G. J. Rudner, Andrew McCallum
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.22967v2 Announce Type: replace Abstract: When Masked Diffusion Models (MDMs) generate sequences through iterative refinement, the rich internal computation over masked positions is discarded, forcing every subsequent refinement step to recompute the valuable internal information stored as...
413. Assessing Predictive Models for Fairness Based on Movement Patterns
Author: Francesco Lettich, Mario A. Nascimento, Chiara Pugliese, Chiara Renso
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.CY
arXiv:2605.23234v2 Announce Type: replace Abstract: Assessing the spatial fairness of predictive models involves establishing whether they are statistically penalizing (favoring) individuals associated with certain geographical locations. Literature on this topic makes the fundamental assumption tha...
414. Theoretical Analysis of Sparse Optimization with Reparameterization, Weight Decay, and Adaptive Learning Rate
Author: Huangyu Xu, Jingqin Yang, Qianqian Xu, Jiaye Teng
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.25134v3 Announce Type: replace Abstract: Sparse optimization is a fundamental challenge in various practical applications. A popular approach to sparse optimization is $\ell_p$ regularization. However, it may encounter optimization instability due to the unbounded gradients when $0<p<1$. ...
415. GEM: Geometric Entropy Mixing for Optimal LLM Data Curation
Author: Yue Min, Ziyun Qiao, Ruining Chen, Yujun Li
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.26121v2 Announce Type: replace Abstract: LLM pre-training efficacy increasingly depends on data composition rather than sheer volume. Yet, optimal mixing is hindered by categorization flaws: human taxonomies suffer from ontological misalignment, and Euclidean clustering fails to address e...
416. PRISM: Position-encoded Regressive Inverse Spectral Model for Multilayer Thin-Film Design
Author: Runtian Wang, Renhao Xue, Baige Chen, Hao Wu
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, physics.optics
arXiv:2605.26502v2 Announce Type: replace Abstract: The inverse problem of multilayer thin-film optical coatings design represents a complex combinatorial-continuous optimization challenge. We present PRISM (Position-encoded Regressive Inverse Spectral Model), a unified decoder-only autoregressive t...
417. When Muon Optimizer Meets Adversarial Training: A Theoretical and Empirical Study
Author: Jun Yan, Weiquan Huang, Jiankai Zuo, Yujian Mo, Xi Fang, Chengliang Wu, Zeming Wei
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.26929v2 Announce Type: replace Abstract: Adversarial training (AT) remains one of the most reliable empirical defenses against adversarial attacks. Its robustness critically depends on how the underlying min-max objective is optimized. In practice, Stochastic Gradient Descent (SGD) optimi...
418. The Fundamental Limits of Fraud Detection in Card Payment Networks
Author: Gaurav Dhama
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2605.27557v2 Announce Type: replace Abstract: Card payment fraud detection is usually framed as a supervised classification problem. Although this approach has generated practical progress, improvement has remained incremental despite major advances in model architecture. We argue that this is...
419. PINE: Pruning Boosted Tree Ensembles with Conformal In-Distribution Prediction Equivalence
Author: Haruki Yajima, Yusuke Matsui
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.28068v2 Announce Type: replace Abstract: Tree ensembles are machine learning models with strong predictive performance and interpretability, and remain widely used for tabular data. Standard pruning methods for tree ensembles typically optimize an accuracy-compression trade-off and may ch...
420. Conveyance: A Versatile Framework for Learning in Structured Class Spaces
Author: Yasser Taha, Gr'egoire Montavon, Nils K"orber
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.28420v2 Announce Type: replace Abstract: While machine learning (ML) architectures have evolved rapidly to account for complex data, loss functions like cross-entropy remain mostly structure-agnostic in many real-world applications. However, the "class-symmetric" nature of these standard ...
421. Inferring the Size of Large Language Models From Popular Text Memorization
Author: Ivica Nikolic
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.29223v2 Announce Type: replace Abstract: The parameter counts of the most widely used large language models (LLMs) are often withheld by their developers, leaving model size -- a primary reference point for interpreting capabilities and costs -- largely undisclosed. We propose a black-box...
422. Deep Adaptive Dimension Reduction for Bayesian Inference in Inverse Problems
Author: Yueyang Wang, Xili Wang, Kejun Tang, Xiaoliang Wan, Tao Zhou, Chao Yang
Published: 6/1/2026, 4:00:00 AM
Categories: cs.LG, cs.NA, math.NA
arXiv:2605.29373v2 Announce Type: replace Abstract: Solving high-dimensional PDE-governed inverse problems is often challenging due to complex non-Gaussian posterior distributions, expensive forward model evaluations, and misspecified prior information. To address these issues, we propose a deep ada...
423. On the regularization of Wasserstein GANs
Author: Henning Petzka, Asja Fischer, Denis Lukovnikov
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:1709.08894v3 Announce Type: replace-cross Abstract: Since their invention, generative adversarial networks (GANs) have become a popular approach for learning to model a distribution of real (unlabeled) data. Convergence problems during training are overcome by Wasserstein GANs which minimize t...
424. Breaking Information Cocoons: A Hyperbolic Framework for Balancing Exploration and Exploitation in Recommender Systems
Author: Qiyao Ma, Menglin Yang, Mingxuan Ju, Tong Zhao, Neil Shah, Rex Ying
Published: 6/1/2026, 4:00:00 AM
Categories: cs.IR, cs.AI, cs.CL, cs.LG
arXiv:2411.13865v4 Announce Type: replace-cross Abstract: Modern recommender systems often create information cocoons, restricting users' exposure to diverse content. The central challenge is to balance content exploration and exploitation while allowing users to adjust their recommendation preferen...
425. Re-examining Granger Causality with Causal Bayesian Networks and Reichenbachs Principles
Author: S. A. Adedayo
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ML, cs.LG, econ.EM, stat.ME
arXiv:2501.02672v3 Announce Type: replace-cross Abstract: Characterising cause-effect relationships in complex systems is fundamental to understanding their underlying mechanisms. Granger causality (GC) remains a widely used computational tool for identifying causal relationships in time series data...
426. ProofWala: A Framework for Multilingual Proof Data Synthesis and Theorem-Proving
Author: Amitayush Thakur, George Tsoukalas, Greg Durrett, Swarat Chaudhuri
Published: 6/1/2026, 4:00:00 AM
Categories: cs.AI, cs.LG, cs.LO, cs.PL
arXiv:2502.04671v3 Announce Type: replace-cross Abstract: Neural approaches to theorem proving require robust infrastructure for interfacing with interactive theorem provers (ITPs), extracting structured proof data, and executing proof search at scale. However, existing tooling is often assistant-sp...
427. Chain-of-Thought Reasoning In The Wild Is Not Always Faithful
Author: Iv'an Arcuschin, Jett Janiak, Robert Krzyzanowski, Senthooran Rajamanoharan, Neel Nanda, Arthur Conmy
Published: 6/1/2026, 4:00:00 AM
Categories: cs.AI, cs.CL, cs.LG
arXiv:2503.08679v5 Announce Type: replace-cross Abstract: Recent studies indicate that when faced with explicit biases in prompts, models often omit mentioning these biases in their Chain-of-Thought (CoT) output, revealing that verbalized reasoning can give an incorrect picture of how models arrive ...
428. FLOWR: Flow Matching for Structure-Aware De Novo, Interaction- and Fragment-Based Ligand Generation
Author: Julian Cremer, Ross Irwin, Alessandro Tibo, Jon Paul Janet, Simon Olsson, Djork-Arn'e Clevert
Published: 6/1/2026, 4:00:00 AM
Categories: q-bio.QM, cs.LG, q-bio.BM
arXiv:2504.10564v3 Announce Type: replace-cross Abstract: We introduce FLOWR, a novel structure-based framework for the generation and optimization of three-dimensional ligands. FLOWR integrates continuous and categorical flow matching with equivariant optimal transport, enhanced by an efficient pro...
429. Dynamical local Fr\'echet curve regression in manifolds
Author: M. D. Ruiz-Medina, A. Torres-Signes
Published: 6/1/2026, 4:00:00 AM
Categories: math.ST, cs.LG, stat.ML, stat.TH
arXiv:2505.05168v3 Announce Type: replace-cross Abstract: Under mild conditions, this paper derives a least-squares local linear Fr'echet curve predictor for response and regressor evaluated in a separable Hilbert space. We obtain the conditions allowing the implementation of this local linear Fr'...
430. Unraveling LoRA Interference: Orthogonal Subspaces for Robust Model Merging
Author: Haobo Zhang, Jiayu Zhou
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG
arXiv:2505.22934v2 Announce Type: replace-cross Abstract: Fine-tuning large language models (LMs) for individual tasks yields strong performance but is expensive for deployment and storage. Recent works explore model merging to combine multiple task-specific models into a single multi-task model wit...
431. Esoteric Language Models: A Family of Any-Order Diffusion LLMs
Author: Subham Sekhar Sahoo, Zhihan Yang, Yash Akhauri, Johnna Liu, Deepansha Singh, Zhoujun Cheng, Zhengzhong Liu, Eric Xing, John Thickstun, Arash Vahdat
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CL, cs.LG
arXiv:2506.01928v4 Announce Type: replace-cross Abstract: Diffusion-based language models offer a compelling alternative to autoregressive (AR) models by enabling parallel and controllable generation. Within this family, Masked Diffusion Models (MDMs) currently perform best but still underperform AR...
432. Position: Quantum Kernel Machines Should Move Beyond Scalar-Valued Kernels to Realize Their Potential
Author: Hachem Kadri, Joachim Tomasi, Yuka Hashimoto, Sandrine Anthoine
Published: 6/1/2026, 4:00:00 AM
Categories: quant-ph, cs.LG, stat.ML
arXiv:2506.03779v2 Announce Type: replace-cross Abstract: Quantum kernel functions built using quantum-mechanical principles and have emerged as a centerpiece of quantum machine learning. The initial enthusiasm for quantum kernel machines has been tempered by recent studies suggesting that quantum k...
433. DISCO: Mitigating Bias in Deep Learning with Conditional Distance Correlation
Author: Emre Kavak, Tom Nuno Wolf, Christian Wachinger
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CV, cs.AI, cs.LG
arXiv:2506.11653v3 Announce Type: replace-cross Abstract: Dataset bias often leads deep learning models to exploit spurious correlations instead of task-relevant signals. We introduce the Standard Anti-Causal Model (SAM), a unifying causal framework that characterizes bias mechanisms and yields a co...
434. Conformal C2ST: Turning weak classifiers into strong two-sample tests
Author: Vansh Bansal, Tianyu Chen, James G. Scott
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:2507.17026v2 Announce Type: replace-cross Abstract: The two-sample testing problem, a fundamental task in statistics and machine learning, seeks to determine whether two sets of samples, drawn from underlying distributions $p$ and $q$, are in fact identically distributed (i.e. whether $p=q$). ...
435. Benchmarking Uncertainty and its Disentanglement in multi-label Chest X-Ray Classification
Author: Simon Baur, Wojciech Samek, Jackie Ma
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:2508.04457v2 Announce Type: replace-cross Abstract: Reliable uncertainty quantification is crucial for trustworthy decision-making and the deployment of AI models in medical imaging. While prior work has explored the ability of neural networks to quantify predictive, epistemic, and aleatoric u...
436. Reduced-order modeling of Hamiltonian dynamics based on symplectic neural networks
Author: Yongsheng Chen, Wei Guo, Qi Tang, Xinghui Zhong
Published: 6/1/2026, 4:00:00 AM
Categories: math.NA, cs.LG, cs.NA, physics.comp-ph
arXiv:2508.11911v2 Announce Type: replace-cross Abstract: We introduce a novel data-driven symplectic induced-order modeling (ROM) framework for high-dimensional Hamiltonian systems that unifies latent-space discovery and dynamics learning within a single, end-to-end neural architecture. The encoder...
437. Stochastic Gradients under Nuisances
Author: Facheng Yu, Ronak Mehta, Alex Luedtke, Zaid Harchaoui
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ML, cs.LG, math.OC
arXiv:2508.20326v2 Announce Type: replace-cross Abstract: Stochastic gradient optimization is the dominant learning paradigm for a variety of scenarios, from classical supervised learning to modern self-supervised learning. We consider stochastic gradient algorithms for learning problems whose objec...
438. Neuro-Symbolic Predictive Process Monitoring
Author: Axel Mezini, Elena Umili, Ivan Donadello, Fabrizio Maria Maggi, Matteo Mancanelli, Fabio Patrizi
Published: 6/1/2026, 4:00:00 AM
Categories: cs.AI, cs.FL, cs.LG, cs.LO
arXiv:2509.00834v2 Announce Type: replace-cross Abstract: This paper addresses the problem of suffix prediction in Business Process Management (BPM) by proposing a Neuro-Symbolic Predictive Process Monitoring (PPM) approach that integrates data-driven learning with temporal logic-based prior knowled...
439. Sequential Least-Squares Estimators with Fast Randomized Sketching for Linear Statistical Models
Author: Guan-Yu Chen, Dong-Yue Xie, Xi Yang
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ML, cs.LG, cs.NA, math.NA
arXiv:2509.06856v2 Announce Type: replace-cross Abstract: We propose a novel randomized framework for the estimation problem of large-scale linear statistical models, namely Sequential Least-Squares Estimators with Fast Randomized Sketching (SLSE-FRS), which integrates Sketch-and-Solve and Iterative...
440. MatchFixAgent: Language-Agnostic Autonomous Repository-Level Code Translation Validation and Repair
Author: Ali Reza Ibrahimzada, Brandon Paulsen, Reyhaneh Jabbarvand, Joey Dodds, Daniel Kroening
Published: 6/1/2026, 4:00:00 AM
Categories: cs.SE, cs.LG
arXiv:2509.16187v3 Announce Type: replace-cross Abstract: Code translation transforms source code from one programming language (PL) to another. Validating the functional equivalence of translation and repairing, if necessary, are critical steps in code translation. Existing automated validation and...
441. HUNT: High-Speed UAV Navigation and Tracking in Unstructured Environments via Instantaneous Relative Frames
Author: Alessandro Saviolo, Jeffrey Mao, Giuseppe Loianno
Published: 6/1/2026, 4:00:00 AM
Categories: cs.RO, cs.CV, cs.LG
arXiv:2509.19452v4 Announce Type: replace-cross Abstract: Search and rescue operations require unmanned aerial vehicles to both traverse unknown unstructured environments at high speed and track targets once detected. Achieving both capabilities under degraded sensing and without global localization...
442. Unmute the Patch Tokens: Rethinking Probing in Multi-Label Audio Classification
Author: Lukas Rauch, Ren'e Heinrich, Houtan Ghaffari, Lukas Miklautz, Ilyass Moummad, Bernhard Sick, Christoph Scholz
Published: 6/1/2026, 4:00:00 AM
Categories: cs.SD, cs.LG
arXiv:2509.24901v4 Announce Type: replace-cross Abstract: Although probing frozen models has become a standard evaluation paradigm, self-supervised learning in audio defaults to fine-tuning when pursuing state-of-the-art on AudioSet. A key reason is that global pooling creates an information bottlen...
443. Position-Blind Ptychography: Viability of image reconstruction via data-driven variational inference
Author: Simon Welker, Lorenz Kuger, Tim Roith, Berthy Feng, Martin Burger, Timo Gerkmann, Henry Chapman
Published: 6/1/2026, 4:00:00 AM
Categories: eess.IV, cs.CV, cs.LG, cs.NA, math.NA, physics.optics
arXiv:2509.25269v3 Announce Type: replace-cross Abstract: In this work, we present and investigate the novel blind inverse problem of position-blind ptychography, i.e., ptychographic phase retrieval without any knowledge of scan positions, which then must be recovered jointly with the image. The mot...
444. ReTabAD: A Benchmark for Restoring Semantic Context in Tabular Anomaly Detection
Author: Sanghyu Yoon, Dongmin Kim, Suhee Yoon, Ye Seul Sim, Seungdong Yoa, Hye-Seung Cho, Soonyoung Lee, Hankook Lee, Woohyung Lim
Published: 6/1/2026, 4:00:00 AM
Categories: cs.AI, cs.LG
arXiv:2510.02060v2 Announce Type: replace-cross Abstract: In tabular anomaly detection (AD), textual semantics often carry critical signals, as the definition of an anomaly is closely tied to domain-specific context. However, existing benchmarks provide only raw data points without semantic context,...
445. Adversarial Robustness in One-Stage Learning-to-Defer
Author: Yannis Montreuil, Letian Yu, Axel Carlier, Lai Xing Ng, Wei Tsang Ooi
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:2510.10988v4 Announce Type: replace-cross Abstract: Learning-to-Defer (L2D) enables hybrid decision-making by routing inputs either to a predictor or to external experts. While promising, L2D is highly vulnerable to adversarial perturbations, which can not only flip predictions but also manipu...
446. CaptionFormer: Unified Segmentation, Tracking, and Captioning for Spatio-Temporal Objects
Author: Gabriel Fiastre, Antoine Yang, Cordelia Schmid
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CV, cs.AI, cs.LG
arXiv:2510.14904v3 Announce Type: replace-cross Abstract: Dense Video Object Captioning (DVOC) is the task of jointly detecting, tracking, and captioning object trajectories in a video, requiring the ability to understand spatio-temporal details and describe them in natural language. Due to the comp...
447. Singularity-free dynamical invariants-based quantum control
Author: Ritik Sareen, Akram Youssry, Alberto Peruzzo
Published: 6/1/2026, 4:00:00 AM
Categories: quant-ph, cs.LG, cs.SY, eess.SY
arXiv:2510.15340v3 Announce Type: replace-cross Abstract: State preparation is a cornerstone of quantum technologies, underpinning applications in computation, communication, and sensing. Its importance becomes even more pronounced in non-Markovian open quantum systems, where environmental memory an...
448. Non-Parametric Probabilistic Robustness: A Conservative Risk Estimator under Unknown Perturbation Distributions
Author: Zheng Wang, Yi Zhang, Siddartha Khastgir, Carsten Maple, Xingyu Zhao
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2511.17380v2 Announce Type: replace-cross Abstract: Deep learning (DL) models, despite their remarkable success, remain vulnerable to small input perturbations that can cause erroneous outputs, motivating the recent proposal of probabilistic robustness (PR) as a complementary alternative to ad...
449. Outcome-Aware Spectral Feature Learning for Instrumental Variable Regression
Author: Dimitri Meunier, Jakub Wornbard, Vladimir R. Kostic, Antoine Moulin, Alek Fr"ohlich, Karim Lounici, Massimiliano Pontil, Arthur Gretton
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:2512.00919v2 Announce Type: replace-cross Abstract: We address the problem of causal effect estimation in the presence of hidden confounders using nonparametric instrumental variable (IV) regression. An established approach is to use estimators based on learned spectral features, that is, feat...
450. Physics Enhanced Deep Surrogates for the Phonon Boltzmann Transport Equation
Author: Antonio Varagnolo, Giuseppe Romano, Rapha"el Pestourie
Published: 6/1/2026, 4:00:00 AM
Categories: physics.comp-ph, cs.LG
arXiv:2512.05976v3 Announce Type: replace-cross Abstract: Designing materials with controlled heat flow at the nano-scale is central to advances in microelectronics, thermoelectrics, and energy-conversion technologies. At these scales, phonon transport follows the Boltzmann Transport Equation (BTE),...
451. Conditional Coverage Diagnostics for Conformal Prediction
Author: Sacha Braun, David Holzm"uller, Michael I. Jordan, Francis Bach
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ML, cs.AI, cs.LG
arXiv:2512.11779v2 Announce Type: replace-cross Abstract: Evaluating conditional coverage remains one of the most persistent challenges in assessing the reliability of predictive systems. Although conformal methods can give guarantees on marginal coverage, no method can guarantee to produce sets wit...
452. Agentic Physical AI toward a Domain-Specific Foundation Model for Energy Systems: A Case Study on Nuclear Reactor Control
Author: Yoon Pyo Lee, Samrendra Roy, Kazuma Kobayashi, Sajedul Talukder, Diab Abueidda, Seid Koric, Souvik Chakraborty, Syed Bahauddin Alam
Published: 6/1/2026, 4:00:00 AM
Categories: cs.AI, cs.LG
arXiv:2512.23292v4 Announce Type: replace-cross Abstract: The prevailing paradigm in AI for physical systems: scaling general-purpose foundation models toward universal multimodal reasoning, confronts a barrier at the control interface. Frontier vision-language models achieve only 50-53% accuracy on...
453. Regret-Based Federated Causal Discovery with Unknown Interventions
Author: Federico Baldo, Charles K. Assaad
Published: 6/1/2026, 4:00:00 AM
Categories: cs.AI, cs.LG
arXiv:2512.23626v2 Announce Type: replace-cross Abstract: Most causal discovery methods recover a completed partially directed acyclic graph representing a Markov equivalence class from observational data. Recent work has extended these methods to federated settings to address data decentralization ...
454. Rethinking Multimodal Few-Shot 3D Point Cloud Segmentation: From Fused Refinement to Decoupled Arbitration
Author: Wentao Bian, Fenglei Xu
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CV, cs.AI, cs.LG
arXiv:2601.01456v2 Announce Type: replace-cross Abstract: In this paper, we revisit multimodal few-shot 3D point cloud semantic segmentation (FS-PCS), identifying a conflict in "Fuse-then-Refine" paradigms: the "Plasticity-Stability Dilemma." In addition, CLIP's inter-class confusion can result in s...
455. Who Endorsed It? Measuring Authority Bias Across Expertise Levels in Language Models
Author: Priyanka Mary Mammen, Emil Joswin, Shankar Venkitachalam
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CL, cs.LG
arXiv:2601.13433v4 Announce Type: replace-cross Abstract: Prior research demonstrates that performance of language models on reasoning tasks can be influenced by suggestions, hints and endorsements. However, the influence of endorsement source credibility remains underexplored. We investigate whethe...
456. Performance and Complexity Trade-off Optimization of Speech Models During Training
Author: Esteban G'omez, Tom Backstr"om
Published: 6/1/2026, 4:00:00 AM
Categories: cs.SD, cs.AI, cs.LG, eess.AS
arXiv:2601.13704v3 Announce Type: replace-cross Abstract: In speech machine learning, neural network models are typically designed by choosing an architecture with fixed layer sizes and structure. These models are then trained to maximize performance on metrics aligned with the task's objective. Whi...
457. Global Plane Waves From Local Gaussians: Periodic Charge Densities in a Blink
Author: Jonas Elsborg, Felix {\AE}rtebjerg, Luca Thiede, Al'an Aspuru-Guzik, Tejs Vegge, Arghya Bhowmik
Published: 6/1/2026, 4:00:00 AM
Categories: cond-mat.mtrl-sci, cs.LG, physics.chem-ph, physics.comp-ph
arXiv:2601.19966v2 Announce Type: replace-cross Abstract: We introduce ELECTRAFI, a fast, end-to-end differentiable model for predicting periodic charge densities in crystalline materials. ELECTRAFI constructs anisotropic Gaussians in real space and exploits their closed-form Fourier transforms to a...
458. Randomized Feasibility Methods for Constrained Optimization with Adaptive Step Sizes
Author: Abhishek Chakraborty, Angelia Nedi'c
Published: 6/1/2026, 4:00:00 AM
Categories: math.OC, cs.LG
arXiv:2601.20076v2 Announce Type: replace-cross Abstract: We consider minimizing an objective function subject to constraints defined by the intersection of lower-level sets of convex functions. We study two cases: (i) strongly convex and Lipschitz-smooth objective function and (ii) convex but possi...
459. SERA: Soft-Verified Efficient Repository Agents
Author: Ethan Shen, Daniel Tormoen, Saurabh Shah, Ali Farhadi, Tim Dettmers
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CL, cs.LG, cs.SE
arXiv:2601.20789v3 Announce Type: replace-cross Abstract: Open-weight coding agents should hold a fundamental advantage over closed-source systems because they can specialize to private codebases, encoding repository-specific information directly in their weights. Yet the cost and complexity of trai...
460. Error Amplification Limits ANN-to-SNN Conversion in Continuous Control
Author: Zijie Xu, Zihan Huang, Yiting Dong, Kang Chen, Wenxuan Liu, Zhaofei Yu
Published: 6/1/2026, 4:00:00 AM
Categories: cs.NE, cs.LG
arXiv:2601.21778v2 Announce Type: replace-cross Abstract: Spiking Neural Networks (SNNs) can achieve competitive performance by converting already existing well-trained Artificial Neural Networks (ANNs), avoiding further costly training. This property is particularly attractive in Reinforcement Lear...
461. Token Sparse Attention: Efficient Long-Context Inference with Interleaved Token Selection
Author: Dongwon Jo, Beomseok Kang, Jiwon Song, Jae-Joon Kim
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CL, cs.LG
arXiv:2602.03216v3 Announce Type: replace-cross Abstract: The quadratic complexity of attention remains the central bottleneck in long-context inference for large language models. Prior acceleration methods either sparsify the attention map with structured patterns or permanently evict tokens at spe...
462. A hitchhiker's guide to Poisson gradient estimation
Author: Michael Ibrahim, Hanqi Zhao, Eli Sennesh, Zhi Li, Anqi Wu, Jacob L. Yates, Chengrui Li, Hadi Vafaii
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ML, cs.LG, q-bio.NC
arXiv:2602.03896v2 Announce Type: replace-cross Abstract: Poisson-distributed latent variable models are widely used in computational neuroscience, but differentiating through discrete stochastic samples remains challenging. Two approaches address this: Exponential Arrival Time (EAT) simulation an...
463. Effective Reasoning Chains Reduce Intrinsic Dimensionality
Author: Archiki Prasad, Mandar Joshi, Kenton Lee, Mohit Bansal, Peter Shaw
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG
arXiv:2602.09276v2 Announce Type: replace-cross Abstract: Chain-of-thought (CoT) reasoning and its variants have substantially improved the performance of language models on complex reasoning tasks, yet the precise mechanisms by which different strategies facilitate generalization remain poorly unde...
464. How Far Can You Grow? Characterizing the Extrapolation Frontier of Graph Generative Models for Materials Science
Author: Can Polat, Erchin Serpedin, Mustafa Kurban, Hasan Kurban
Published: 6/1/2026, 4:00:00 AM
Categories: cond-mat.mtrl-sci, cond-mat.mes-hall, cs.LG, physics.atm-clus
arXiv:2602.09309v2 Announce Type: replace-cross Abstract: Every generative model for crystalline materials harbors a critical structure size beyond which its outputs become unreliable; we call this the extrapolation frontier. Despite its consequences for nanomaterial design, this frontier has never ...
465. Is Memorization Helpful or Harmful? Prior Information Sets the Threshold
Author: Chen Cheng, Rina Foygel Barber
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ML, cs.IT, cs.LG, math.IT, math.ST, stat.TH
arXiv:2602.09405v2 Announce Type: replace-cross Abstract: We examine the connection between training error and generalization error for arbitrary estimating procedures, working in an overparameterized linear model under general priors in a Bayesian setup. We find determining factors inherent to the ...
466. Provably Convergent Actor-Critic for MARL through Risk-aversion
Author: Yizhou Zhang, Eric Mazumdar
Published: 6/1/2026, 4:00:00 AM
Categories: cs.MA, cs.GT, cs.LG
arXiv:2602.12386v2 Announce Type: replace-cross Abstract: Learning stationary policies in infinite-horizon general-sum Markov games (MGs) remains a fundamental open problem in Multi-Agent Reinforcement Learning (MARL). While stationary strategies are preferred for their practicality, computing stati...
467. BAT: Better Audio Transformer Guided by Convex Gated Probing
Author: Houtan Ghaffari, Lukas Rauch, Christoph Scholz, Paul Devos
Published: 6/1/2026, 4:00:00 AM
Categories: cs.SD, cs.LG
arXiv:2602.16305v2 Announce Type: replace-cross Abstract: Probing is widely adopted in computer vision to faithfully evaluate self-supervised learning (SSL) embeddings, as finetuning may misrepresent their inherent quality. In contrast, audio SSL models still rely on finetuning because simple probin...
468. Quantifying Error Propagation and Model Collapse in Diffusion Models
Author: Nail B. Khelifa, Richard E. Turner, Ramji Venkataramanan
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:2602.16601v2 Announce Type: replace-cross Abstract: Machine learning models are increasingly trained or fine-tuned on synthetic data. Recursively training on such data has been observed to significantly degrade performance in a wide range of tasks, often characterized by a progressive drift aw...
469. Asymptotically Optimal Sequential Testing with Markovian Data
Author: Alhad Sethi, Kavali Sofia Sagar, Shubhada Agrawal, Debabrota Basu, P. N. Karthik
Published: 6/1/2026, 4:00:00 AM
Categories: math.ST, cs.LG, stat.ML, stat.TH
arXiv:2602.17587v2 Announce Type: replace-cross Abstract: We study one-sided and $\alpha$-correct sequential hypothesis testing for data generated by an ergodic, finite-state Markov chain. The null hypothesis is that the unknown transition matrix belongs to a prescribed set $P$ of stochastic matrice...
470. IAPO: Information-Aware Policy Optimization for Token-Efficient Reasoning
Author: Yinhan He, Yaochen Zhu, Mingjia Shi, Wendy Zheng, Lin Su, Xiaoqing Wang, Qi Guo, Jundong Li
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CL, cs.LG
arXiv:2602.19049v2 Announce Type: replace-cross Abstract: Large language models increasingly rely on long chains of thought to improve accuracy, yet such gains come with substantial inference-time costs. We revisit token-efficient post-training and argue that existing sequence-level reward-shaping m...
471. Cross-Chirality Generalization by Axial Vectors for Hetero-Chiral Protein-Peptide Interaction Design
Author: Ziyi Yang, Zitong Tian, Yinjun Jia, Tianyi Zhang, Jiqing Zheng, Hao Wang, Yubu Su, Juncai He, Lei Liu, Yanyan Lan
Published: 6/1/2026, 4:00:00 AM
Categories: q-bio.BM, cs.LG
arXiv:2602.20176v3 Announce Type: replace-cross Abstract: D-peptide binders targeting L-proteins have promising therapeutic potential. Despite rapid advances in machine learning-based target-conditioned peptide design, generating D-peptide binders remains largely unexplored. In this work, we show th...
472. Revisiting the Bertrand Paradox via Equilibrium Analysis of No-regret Learners
Author: Arnab Maiti, Junyan Liu, Kevin Jamieson, Lillian J. Ratliff
Published: 6/1/2026, 4:00:00 AM
Categories: cs.GT, cs.LG
arXiv:2602.21620v2 Announce Type: replace-cross Abstract: We study the discrete Bertrand pricing game with a non-increasing demand function. The game has $n \ge 2$ players who simultaneously choose prices from the set ${1/k, 2/k, \ldots, 1}$, where $k\in\mathbb{N}$. The player who sets the lowest ...
473. KernelCraft: Benchmarking for Agentic Close-to-Metal Kernel Generation on Emerging Hardware
Author: Jiayi Nie, Haoran Wu, Yao Lai, Zeyu Cao, Cheng Zhang, Binglei Lou, Erwei Wang, Jianyi Cheng, Timothy M. Jones, Robert Mullins, Rika Antonova, Yiren Zhao
Published: 6/1/2026, 4:00:00 AM
Categories: cs.AR, cs.LG, cs.SE
arXiv:2603.08721v2 Announce Type: replace-cross Abstract: New AI accelerators with novel instruction set architectures (ISAs) often require developers to manually craft low-level kernels, a time-consuming and error-prone process that does not scale across hardware targets. This delays emerging hardw...
474. What is Missing? Explaining Neurons Activated by Absent Concepts
Author: Robin Hesse, Simone Schaub-Meyer, Janina Hesse, Bernt Schiele, Stefan Roth
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2603.09787v2 Announce Type: replace-cross Abstract: Explainable artificial intelligence (XAI) aims to provide human-interpretable insights into the behavior of deep neural networks (DNNs), typically by estimating a simplified causal structure of the model. In existing work, this causal structu...
475. GradMem: Learning to Write Context into Memory with Test-Time Gradient Descent
Author: Yuri Kuratov, Matvey Kairov, Aydar Bulatov, Ivan Rodkin, Mikhail Burtsev
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CL, cs.LG
arXiv:2603.13875v2 Announce Type: replace-cross Abstract: Many large language model applications require conditioning on long contexts. Transformers typically support this by storing a large per-layer KV-cache of past activations, which incurs substantial memory overhead. A desirable alternative is ...
476. Learning-to-Defer with Expert-Conditional Advice
Author: Yannis Montreuil, Le"ina Montreuil, Axel Carlier, Lai Xing Ng, Wei Tsang Ooi
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:2603.14324v5 Announce Type: replace-cross Abstract: Learning-to-Defer routes each input to the expert that minimizes expected cost, but it assumes that the information available to every expert is fixed at decision time. Many modern systems violate this assumption: after selecting an expert, o...
477. IsoCLIP: Decomposing CLIP Projectors for Efficient Intra-modal Alignment
Author: Simone Magistri, Dipam Goswami, Marco Mistretta, Bart{\l}omiej Twardowski, Joost van de Weijer, Andrew D. Bagdanov
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2603.19862v2 Announce Type: replace-cross Abstract: Vision-Language Models like CLIP are extensively used for inter-modal tasks which involve both visual and text modalities. However, when the individual modality encoders are applied to inherently intra-modal tasks like image-to-image retrieva...
478. SimulCost: A Cost-Aware Benchmark and Toolkit for Automating Physics Simulations with LLMs
Author: Yadi Cao, Sicheng Lai, Jiahe Huang, Yang Zhang, Zach Lawrence, Rohan Bhakta, Izzy F. Thomas, Mingyun Cao, Chung-Hao Tsai, Zihao Zhou, Yidong Zhao, Hao Liu, Alessandro Marinoni, Alexey Arefiev, Rose Yu
Published: 6/1/2026, 4:00:00 AM
Categories: physics.comp-ph, cs.AI, cs.DC, cs.LG
arXiv:2603.20253v2 Announce Type: replace-cross Abstract: Evaluating LLM agents for scientific tasks has focused on token costs while ignoring tool-use costs like simulation time and experimental resources. As a result, metrics like pass@k become impractical under realistic budget constraints. To ad...
479. ShapDBM: Exploring Decision Boundary Maps in Shapley Space
Author: Luke Watkin, Daniel Archambault, Alex Telea
Published: 6/1/2026, 4:00:00 AM
Categories: cs.HC, cs.LG
arXiv:2603.22235v2 Announce Type: replace-cross Abstract: Decision Boundary Maps (DBMs) are an effective tool for visualising machine learning classification boundaries. Yet, DBM quality strongly depends on the dimensionality reduction (DR) technique and high dimensional space used for the data poin...
480. Identifying Connectivity Distributions from Neural Dynamics Using Flows
Author: Timothy Doyeon Kim, Ulises Pereira-Obilinovic, Yiliu Wang, Eric Shea-Brown, Uygar S"umb"ul
Published: 6/1/2026, 4:00:00 AM
Categories: q-bio.NC, cs.LG
arXiv:2603.26506v2 Announce Type: replace-cross Abstract: Connectivity structure shapes neural computation, but inferring this structure from population recordings is degenerate: multiple connectivity structures can generate identical dynamics. Recent work uses low-rank recurrent neural networks (lr...
481. Do covariates explain why these groups differ? The choice of reference group can reverse conclusions in the Oaxaca-Blinder decomposition
Author: Manuel Quintero, Advik Shreekumar, William T. Stephenson, Tamara Broderick
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ME, cs.LG, econ.EM, stat.ML
arXiv:2603.29972v2 Announce Type: replace-cross Abstract: Scientists often want to explain why an outcome is different in two groups. For instance, differences in patient mortality rates across two hospitals could be due to differences in the patients themselves (covariates) or differences in medica...
482. Inversion-Free Natural Gradient Descent on Riemannian Manifolds
Author: Dario Draca, Takuo Matsubara, Minh-Ngoc Tran
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ML, cs.LG, stat.CO, stat.ME
arXiv:2604.02969v2 Announce Type: replace-cross Abstract: The natural gradient method is a central tool for statistical optimisation, but its broader application is hindered by the assumption of a Euclidean parameter space, the repeated estimation of the Fisher information matrix (FIM), and the comp...
483. Sharp description of local minima in the loss landscape of high-dimensional two-layer ReLU neural networks
Author: Jie Huang, Bruno Loureiro, Stefano Sarao Mannelli
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ML, cond-mat.dis-nn, cs.LG
arXiv:2604.09412v2 Announce Type: replace-cross Abstract: We study the population loss landscape of two-layer ReLU networks of the form $\sum_{k=1}^K \mathrm{ReLU}(w_k^\top x)$ in a realisable teacher-student setting with Gaussian covariates. We show that local minima admit an exact low-dimensional ...
484. Beyond Augmented-Action Surrogates for Multi-Expert Learning-to-Defer
Author: Yannis Montreuil, Axel Carlier, Lai Xing Ng, Wei Tsang Ooi
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:2604.09414v5 Announce Type: replace-cross Abstract: A learning-to-defer (L2D) system decides, for each input, whether to predict on its own or to hand it to one of several available experts. The very well established recipe trains classifier and router jointly by treating the $K$ classes and $...
485. Rays as Pixels: Learning A Joint Distribution of Videos and Camera Trajectories
Author: Wonbong Jang, Shikun Liu, Soubhik Sanyal, Juan Camilo Perez, Kam Woh Ng, Sanskar Agrawal, Juan-Manuel Perez-Rua, Yiannis Douratsos, Tao Xiang
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CV, cs.AI, cs.LG
arXiv:2604.09429v4 Announce Type: replace-cross Abstract: Recovering camera parameters from images and rendering scenes from novel viewpoints have been treated as separate tasks in computer vision and graphics. This separation breaks down when image coverage is sparse or poses are ambiguous, since e...
486. Learning to Reason with Insight for Informal Theorem Proving
Author: Yunhe Li, Hao Shi, Bowen Deng, Wei Wang, Mengzhe Ruan, Hanxu Hou, Zhongxiang Dai, Siyang Gao, Chao Wang, Shuang Qiu, Linqi Song
Published: 6/1/2026, 4:00:00 AM
Categories: cs.AI, cs.CL, cs.LG
arXiv:2604.16278v2 Announce Type: replace-cross Abstract: Although most of the automated theorem-proving approaches depend on formal proof systems, informal theorem proving can align better with large language models' (LLMs) strength in natural language processing. In this work, we identify a primar...
487. Aligning Dense Retrievers with LLM Utility via Distillation
Author: Rajinder Sandhu, Di Mu, Cheng Chang, Md Shahriar Tasjid, Himanshu Rai, Maksims Volkovs, Ga Wu
Published: 6/1/2026, 4:00:00 AM
Categories: cs.IR, cs.AI, cs.LG
arXiv:2604.22722v2 Announce Type: replace-cross Abstract: Dense vector retrieval is the practical backbone of Retrieval- Augmented Generation (RAG), but similarity search can suffer from precision limitations. Conversely, utility-based approaches leveraging LLM re-ranking often achieve superior perf...
488. Inference of Online Newton Methods with Nesterov's Accelerated Sketching
Author: Haoxuan Wang, Xinchen Du, Sen Na
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ML, cs.LG, math.OC, stat.CO
arXiv:2604.23436v2 Announce Type: replace-cross Abstract: Reliable decision-making with streaming data requires principled uncertainty quantification of online methods. While first-order methods enable efficient iterate updates, their inference procedures still require updating proper (covariance) m...
489. FedQueue: Queue-Aware Federated Learning for Cross-Facility HPC Training
Author: Yijiang Li, Emon Dey, Zilinghan Li, Krishnan Raghavan, Ravi Madduri, Kibaek Kim
Published: 6/1/2026, 4:00:00 AM
Categories: cs.DC, cs.LG
arXiv:2605.02125v3 Announce Type: replace-cross Abstract: Federated learning (FL) across multiple HPC facilities faces stochastic admission delays from batch schedulers that dominate wall-clock time. Synchronous FL suffers from severe stragglers, while asynchronous FL accumulates stale updates when ...
490. Autoregressive Visual Generation Needs a Prologue
Author: Bowen Zheng, Weijian Luo, Guang Yang, Colin Zhang, Tianyang Hu
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CV, cs.AI, cs.LG
arXiv:2605.06137v2 Announce Type: replace-cross Abstract: In this work, we propose Prologue, an approach to bridging the reconstruction-generation gap in autoregressive (AR) image generation. Instead of modifying visual tokens to satisfy both reconstruction and generation, Prologue generates a small...
491. Self-Captioning Multimodal Interaction Tuning: Amplifying Exploitable Redundancies for Robust Vision Language Models
Author: Yuriel Ryan, Hei Man Ip, Adriel Kuek, Paul Pu Liang, Roy Ka-Wei Lee
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CV, cs.AI, cs.LG
arXiv:2605.08145v2 Announce Type: replace-cross Abstract: Current vision language models face hallucination and robustness issues against ambiguous or corrupted modalities. We hypothesize that these issues can be addressed by exploiting the shared information between modalities to compensate for the...
492. Online Learning-to-Defer with Varying Experts
Author: Dang Hoang Duy, Yannis Montreuil, Maxime Meyer, Axel Carlier, Lai Xing Ng, Wei Tsang Ooi
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:2605.12340v4 Announce Type: replace-cross Abstract: Learning-to-Defer (L2D) methods route each query either to a predictive model or to external experts. While existing work studies this problem in batch settings, real-world deployments require handling streaming data, changing expert availabi...
493. Towards a holistic understanding of Selection Bias for Causal Effect Identification
Author: Yiwen Qiu, Fili Kova\v{c}evi'c, Shimeng Huang, Peter Spirtes, Francesco Locatello
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ME, cs.AI, cs.LG
arXiv:2605.13430v2 Announce Type: replace-cross Abstract: Selection bias is pervasive in observational studies. For example, large scale biobanks data can exhibit ``healthy volunteer bias'' when respondents are healthier and of higher socio-economic status than the population they are meant to repre...
494. ASH: Agents that Self-Hone via Embodied Learning
Author: Benjamin Schneider, Xavier Schneider, Victor Zhong, Sun Sun
Published: 6/1/2026, 4:00:00 AM
Categories: cs.AI, cs.LG
arXiv:2605.14211v2 Announce Type: replace-cross Abstract: Long-horizon embodied tasks remain a fundamental challenge in AI, as current methods rely on hand-engineered rewards or action-labeled demonstrations, neither of which scales. We introduce ASH, an agentic system that learns an embodied policy...
495. Multi-task Linear Regression without Eigenvalue Lower Bounds: Adaptivity, Robustness, and Safety
Author: Seok-Jin Kim
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ML, cs.LG, stat.ME
arXiv:2605.17126v2 Announce Type: replace-cross Abstract: We study the multi-task linear regression problem in the presence of contaminated tasks. We address the setting where the unknown parameters of a majority of tasks are close in the $\ell_2$-norm, while a fraction of tasks are arbitrary outlie...
496. Quantum Machine Learning for Cyber-Physical Anomaly Detection in Unmanned Aerial Vehicles: A Leakage-Free Evaluation with Proxy-Audited Feature Sets
Author: Carlos A. Dur'an Paredes, Javier E. Le'on Calder'on, Nicol'as S'anchez Perea, Germ'an Dar'io D'iaz, Camilo Segura Quintero
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CR, cs.LG, quant-ph
arXiv:2605.19233v2 Announce Type: replace-cross Abstract: Unmanned aerial vehicles (UAVs) are cyber-physical systems whose attack surface spans networked avionics and on-board sensor fusion: a compromised GPS or battery module can mimic a benign mission segment and evade naive anomaly detectors. We ...
497. PlanningBench: Generating Scalable and Verifiable Planning Data for Evaluating and Training Large Language Models
Author: Ziliang Zhao, Zenan Xu, Shuting Wang, Hongjin Qian, Yan Lei, Minda Hu, Zhao Wang, Shihan Dou, Zhicheng Dou, Pluto Zhou
Published: 6/1/2026, 4:00:00 AM
Categories: cs.AI, cs.LG
arXiv:2605.20873v2 Announce Type: replace-cross Abstract: Planning is a fundamental capability for large language models (LLMs) because such complex tasks require models to coordinate goals, constraints, resources, and long-term consequences into executable and verifiable solutions. Existing plannin...
498. BoxLitE: A Faithful Knowledge Base Embedding Based on Convex Optimization
Author: Bruno F. Louren\c{c}o, Hesham Morgan, Ana Ozaki, Aleksandar Pavlovi'c, Emanuel Sallinger
Published: 6/1/2026, 4:00:00 AM
Categories: cs.AI, cs.LG, cs.LO, math.OC
arXiv:2605.23937v2 Announce Type: replace-cross Abstract: Knowledge base (KB) embeddings aim at combining the capability of classical knowledge graph embeddings to generalize the information present in facts, the ABox, with conceptual knowledge represented in an ontology language, the TBox. Several ...
499. Steering Beyond the Support: Adversarial Training on Unsupervised Jailbroken Activation Simulation
Author: Luoyu Chen, Weiqi Wang, Zhiyi Tian, Chenhan Zhang, Feng Wu, Jianhuan Huang, Ahmed Asiri, Shui Yu
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CR, cs.LG
arXiv:2605.24535v2 Announce Type: replace-cross Abstract: Jailbreak prompts can trigger harmful completions on aligned LLMs, In accordance, safety steering has been proposed: test-time activation interventions that steer jailbreak activations to trigger refusal while preserving benign utility. Howev...
500. Efficient Benchmarking Is Just Feature Selection and Multiple Regression
Author: Sam Bowyer, Acyr Locatelli, Kris Cao
Published: 6/1/2026, 4:00:00 AM
Categories: stat.ML, cs.AI, cs.CL, cs.LG
arXiv:2605.25773v2 Announce Type: replace-cross Abstract: Efficient benchmarking techniques aim to lower the computational cost of evaluating LLMs by predicting full benchmark scores using only a subset of a benchmark's questions. By reframing this problem as an instance of multiple regression with ...
501. What Molecular Structure Cannot Tell Us: A Taxonomy of Explainability Gaps in GNN-Based Drug Toxicity Prediction
Author: Juergen Dietrich
Published: 6/1/2026, 4:00:00 AM
Categories: q-bio.QM, cs.LG
arXiv:2605.26183v2 Announce Type: replace-cross Abstract: Not all clinically relevant adverse effects are structurally inferable from molecular graphs - regardless of model quality or architectural complexity. This study introduces an operational taxonomy of the structural information limits that pr...
502. Advancing Creative Physical Intelligence in Large Multimodal Models
Author: Cheng Qian, Hyeonjeong Ha, Jiayu Liu, Jeonghwan Kim, Emre Can Acikgoz, Bingxuan Li, Kunlun Zhu, Jiateng Liu, Aditi Tiwari, Zhenhailong Wang, Xiusi Chen, Mahdi Namazifar, Heng Ji
Published: 6/1/2026, 4:00:00 AM
Categories: cs.AI, cs.CL, cs.LG
arXiv:2605.26396v2 Announce Type: replace-cross Abstract: Large multimodal models (LMMs) have rapidly advanced in perception and reasoning; however, it remains unclear whether these capabilities generalize to discovering visually grounded solutions in open-ended environments, beyond pattern recognit...
503. The Need for an External Observer Formalizing the Sufficiency Gap: A Mathematical Extension of Mixture Identifiability and Contextual Grounding in Sequence Models
Author: Francesco Corielli
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CL, cs.LG
arXiv:2605.26711v2 Announce Type: replace-cross Abstract: We construct a binary mixed-regime process with one deterministic textual regime and one random regime governed by an unobserved latent state. Even an ideal infinite-capacity sequence predictor that exactly recovers the text-only marginal law...
504. Alignment Tampering: How Reinforcement Learning from Human Feedback Is Exploited to Optimize Misaligned Biases
Author: Dongyoon Hahm, Dylan Hadfield-Menell, Kimin Lee
Published: 6/1/2026, 4:00:00 AM
Categories: cs.AI, cs.CL, cs.LG
arXiv:2605.27355v2 Announce Type: replace-cross Abstract: Reinforcement Learning from Human Feedback (RLHF) is the standard method to align Large Language Models (LLMs) with human preferences. In this work, we introduce alignment tampering, a potential vulnerability where the LLM undergoing alignmen...
505. Privately Estimating Monotone Statistics in Polynomial Time
Author: Gavin Brown, Ephraim Linder, Mahbod Majid, Vikrant Singhal
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CR, cs.DS, cs.LG
arXiv:2605.27912v2 Announce Type: replace-cross Abstract: We study efficient differentially private algorithms for estimating monotone statistics, i.e., statistics that are monotone under the addition of new observations. The starting point for our investigation is subsample-and-aggregate: a classic...
506. Learning Logical Operations for Arbitrary Quantum Error Correction Codes
Author: Nico Meyer, Christopher Mutschler, Dominik Seu{\ss}, Andreas Maier, Daniel D. Scherer
Published: 6/1/2026, 4:00:00 AM
Categories: quant-ph, cs.LG
arXiv:2605.28162v2 Announce Type: replace-cross Abstract: Logical operations are essential for quantum computation within quantum error-correcting codes. However, discovering their physical realizations is challenging, especially for non-additive codes that lack a stabilizer description. We present ...
507. Optimal Rates for Differentially Private Hypothesis Testing with E-values
Author: Ben Jacobsen, Tomas Gonzalez, Gavin Brown, Kassem Fawaz, Aaditya Ramdas
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CR, cs.DS, cs.IT, cs.LG, math.IT
arXiv:2605.28952v2 Announce Type: replace-cross Abstract: E-values have attracted considerable interest in recent years as flexible tools for enabling anytime-valid and adaptive data analysis. Hypothesis testing is at the core of many of these applications, which can often involve private or sensiti...
508. Compute Allocation in Evolutionary Search: From Depth-Breadth to Multi-Armed Bandits
Author: Sixue Xing, Haoyu He, Kerui Wu, Zhuo Yang, Haozheng Luo, Tianfan Fu, Aarthy Nagarajan
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG, cs.NE
arXiv:2605.29268v2 Announce Type: replace-cross Abstract: LLM-guided evolutionary search (Evolve systems) has reached state-of-the-art results on mathematical and combinatorial tasks, yet most existing systems report only the best of many runs and leave the run-to-run distribution undocumented. We a...
509. DynaGraph: Lightweight Multi-Model Interaction Framework via Dynamic Topological Reconfiguration
Author: Yanxing Guo, Zihao Zheng, Fangzhou Wu, Ling Liang, Lin Bao, Zongwei Wang, Yimao Cai
Published: 6/1/2026, 4:00:00 AM
Categories: cs.MA, cs.CL, cs.LG
arXiv:2605.29511v2 Announce Type: replace-cross Abstract: Tackling complex reasoning tasks typically relies on massive monolithic LLMs, which suffer from severe computational redundancy. While task decomposition through structured pipelines or multi-agent collaborations offers an alternative, these ...
510. SAAS: Self-Aware Reinforcement Learning for Over-Search Mitigation in Agentic Search
Author: Yunbo Tang, Chengyi Yang, Shiyu Liu, Zhishang Xiang, Zerui Chen, Qinggang Zhang, Jinsong Su
Published: 6/1/2026, 4:00:00 AM
Categories: cs.AI, cs.CL, cs.LG
arXiv:2605.29796v2 Announce Type: replace-cross Abstract: Agentic search enables LLMs to solve complex multi-hop questions through iterative reasoning and external search. Despite the effectiveness, these systems often suffer from a critical limitation in practice: agents fail to recognize their own...
511. Parameter-Efficient Subspace Decoupling ViT for Mitigating Multi-Task Negative Transfer in Histological Scoring
Author: Youhan Huang, Jiajun Li, Yilin Fang, Shuai Wang, Chuheng Li
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CV, cs.LG, cs.MM
arXiv:2605.29852v2 Announce Type: replace-cross Abstract: Histological scoring is essential for diagnosing Non-Alcoholic Fatty Liver Disease (NAFLD), yet its automation remains challenging due to the high annotation cost and negative transfer among the strongly correlated NAFLD Activity Score (NAS) ...
512. Latent Performance Profiling of Large Language Models
Author: Tanmoy Chakraborty, Ayan Sengupta, Suparna Bhattacharya, Partha Pratim Chakrabarti, Amlan Chakrabarti, Supratik Chakraborty, Partha Pratim Das, Lipika Dey, Richa Singh, Mayank Vatsa
Published: 6/1/2026, 4:00:00 AM
Categories: cs.CL, cs.LG
arXiv:2605.30018v2 Announce Type: replace-cross Abstract: Large language models (LLMs) frequently achieve impressive scores on standardized benchmarks, yet accuracy alone offers a limited view of their capabilities. Evaluating open-source LLMs through leaderboards faces persistent issues like data c...
513. No More K-means: Single-Stage Sparse Coding for Efficient Multi-Vector Retrieval
Author: Lixuan Guo, Yifei Wang, Tiansheng Wen, Aosong Feng, Stefanie Jegelka, Chenyu You
Published: 6/1/2026, 4:00:00 AM
Categories: cs.IR, cs.AI, cs.LG
arXiv:2605.30120v2 Announce Type: replace-cross Abstract: Multi-vector retrieval (MVR) models, exemplified by ColBERT, have established new benchmarks in retrieval accuracy by preserving fine-grained token-level interactions. However, this granularity imposes prohibitive storage and retrieval effici...