arXiv cs.LG - 2026-06-05
395 items collected.
1. Early Detection of Alzheimer's Disease Using Explainable Machine Learning on Clinical Biomarkers: A Multi-Class Classification Study Using the Alzheimer's Disease Neuroimaging Initiative (ADNI) Dataset
Author: Afshan Hashmi
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, q-bio.QM
arXiv:2606.03995v1 Announce Type: new Abstract: Background: Alzheimer's disease (AD) affects over 55 million people worldwide. Accurate, interpretable detection of normal cognition (NC), mild cognitive impairment (MCI), and AD from routine clinical assessments remains a critical unmet need. Methods:...
2. Novel Aspects of IEEE SA P3109 Arithmetic Formats for Machine Learning
Author: Andrew Fitzgibbon, Christoph M. Wintersteiger, Jeffrey Sarnoff
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.04028v1 Announce Type: new Abstract: The IEEE P3109 draft standard defines a parameterized family of binary floating-point formats and associated operations, with a focus on facilitating machine learning. These formats allow efficient and consistent representation of values in a small num...
3. Position: Deployed Reinforcement Learning should be Continual
Author: Parnian Behdin, Kevin Roice, Golnaz Mesbahi
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04029v1 Announce Type: new Abstract: Reinforcement Learning (RL) has received increasing attention and adoption in real-world use cases. Most of these systems follow a train-then-fix paradigm, where trained agents do not learn while interacting with the world until performance degrades an...
4. Pseudospectral Bounds for Transient Amplification in Coupled Gradient Descent
Author: Ahanaf Hasan Ariq
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, math.OC, stat.ML
arXiv:2606.04031v1 Announce Type: new Abstract: Coupled gradient descent--where the update of one parameter block depends on another--underlies bilevel optimization, two-time-scale stochastic approximation, and adversarial training. When the coupled Jacobian is block-triangular, asymptotic stability...
5. Do Transformers Need Three Projections? Systematic Study of QKV Variants
Author: Ali Kayyam, Anusha Madan Gopal, M Anthony Lewis
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL, cs.PF
arXiv:2606.04032v2 Announce Type: new Abstract: Transformers have become the standard solution for various AI tasks, with the query, key, and value (QKV) attention formulation playing a central role. However, the individual contribution of these three projections and the impact of omitting some rema...
6. Inverse Critical Experiment Design via Gradient Optimization and a Multigroup Attention-Based Neural Network Architecture
Author: Will Savage, Logan Burnett, Dean Price
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.04033v1 Announce Type: new Abstract: The validation of advanced nuclear reactor designs and fuel concepts requires critical experiments with high neutronic similarity to the target technology. Neutronic similarity is quantified by the correlation coefficient $c_k$, which captures the shar...
7. Self-Distilled Policy Gradient
Author: Yifeng Liu, Shiyuan Zhang, Yifan Zhang, Quanquan Gu
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.04036v1 Announce Type: new Abstract: On-policy self-distillation, where a language model conditions on privileged context to supervise its own generations, is a promising source of dense supervision for sparse-reward reinforcement learning. Actually, it can be instantiated as an auxiliary...
8. Bayes-Sufficient Representations in Supervised Learning
Author: Vasileios Sevetlidis
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04045v1 Announce Type: new Abstract: Representation learning is often described as preserving the information in an input that is relevant for prediction. This work asks what relevance means for a fixed supervised decision problem. A representation is defined to be Bayes-sufficient for a ...
9. Unlocking Feature Learning in Gated Delta Networks at Scale
Author: Yifeng Liu, Quanquan Gu
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04048v1 Announce Type: new Abstract: Training and scaling Large Language Models demand enormous computational resources, motivating both efficient sub-quadratic architectures and principled hyperparameter tuning methods. While the Maximal Update Parametrization ($\mu$P) has enabled zero-s...
10. LiftQuant: Continuous Bit-Width LLM via Dimensional Lifting and Projection
Author: Liulu He, XuanAng Liu, Juntao Liu, Taolue Feng, Ting Lu, Chunsheng Gan, Zhiyv Peng, Yuan Du, Huanrui Yang, Yijiang Liu, Li Du
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04050v1 Announce Type: new Abstract: Existing quantization methods are fundamentally limited by rigid, integer-based bit-widths (e.g., 2, 3-bit), resulting in a ``deployment gap" where Large Language Models cannot be optimally fitted to specific memory budgets. To bridge this gap, we intr...
11. RUBAS: Rubric-Based Reinforcement Learning for Agent Safety
Author: Xian Qi Loye, Qinglin Su, Zhexin Zhang, Shiyao Cui, Qi Zhu, Fei Mi, Hongning Wang, Minlie Huang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CR
arXiv:2606.04051v1 Announce Type: new Abstract: The evolution of LLMs into tool-enabled agents creates a new class of safety challenges associated with real-world execution rather than simple text generation. Existing alignment methods often rely on coarse refusal signals or static supervision, maki...
12. A Goal-Set Characterization of Task Composition in the Boolean Task Algebra
Author: Eduardo Terr'es-Caballero, Herke van Hoof
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04053v1 Announce Type: new Abstract: The Boolean Task Algebra (BTA) provides a principled framework for zero-shot task composition in reinforcement learning by equipping goal-reaching tasks with Boolean operations. We revisit its structural assumptions and formalize a collapse in the spac...
13. Spectral Scaling Laws of Muon
Author: Gagik Magakyan, Pablo Parrilo, Asuman Ozdaglar
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04058v1 Announce Type: new Abstract: Orthonormalized update rules have rapidly become a leading choice of optimizer for training large language models, with recent open-source state-of-the-art models adopting Muon. To keep these updates tractable, Muon performs the orthonormalization with...
14. LLM Compression with Jointly Optimizing Architectural and Quantization choices
Author: Hoang-Loc La, Truong-Thanh Le, Amir Taherkordi, Phuong Hoai Ha
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04063v1 Announce Type: new Abstract: Deploying large language models (LLMs) is challenging due to their significant memory and computational requirements. While some methods address this by developing small or tiny language models from scratch, these approaches demand extensive GPU traini...
15. TPA-AD: A Two-Stage Pseudo Anomaly-Guided Method for Bearing Time-Series Anomaly Detection
Author: Xiancheng Wang, Zhibo Zhang, Ran Li, Rui Wang, Minghang Zhao, Shisheng Zhong, Lin Wang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, stat.ML
arXiv:2606.04073v1 Announce Type: new Abstract: This paper proposes a two-stage pseudo anomaly-guided anomaly detection method (\textbf{T}wo-stage \textbf{P}seudo \textbf{A}nomaly-guided \textbf{A}nomaly \textbf{D}etection, \textbf{TPA-AD}) for axle-box bearing time-series anomaly detection (time se...
16. Adaptive Patching Is Harder Than It Looks For Time-Series Forecasting
Author: Federico Zucchi, Yi Xie, Chao Zhang, Keyuan Luo, Thomas Lampert, Ziyue Li
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.IT, math.IT
arXiv:2606.04074v1 Announce Type: new Abstract: Adaptive patching is a recent and compelling proposal for time-series Transformers: allocate finer patches where the sequence looks locally informative. This paper asks under what conditions a content-adaptive patching operator should outperform a tune...
17. Large Language Models Hack Rewards, and Society
Author: Wei Liu, Xinyi Mou, Hanqi Yan, Zhongyu Wei, Yulan He
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL, cs.CR, cs.CY
arXiv:2606.04075v1 Announce Type: new Abstract: Reinforcement learning (RL) has become a dominant post-training paradigm, enabling large language models (LLMs) to learn from rewards. We observe that societal regulations are structurally similar to reward functions. They define measurable outcomes, t...
18. Stein Kernelized Molecular Dynamics for Active Learning of Interatomic Potentials
Author: Joanna Zou, Fraser Birks, Dallas Foster, Youssef Marzouk
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, physics.comp-ph
arXiv:2606.04100v1 Announce Type: new Abstract: Machine learning interatomic potentials (MLIPs) enable efficient and accurate atomistic simulations but depend critically on the quality and diversity of the training data. We introduce Stein kernelized molecular dynamics (SKMD), an enhanced sampling m...
19. Building The Ph(ysical)AI Layer Of Machine Intelligence
Author: Ulbert Jose Botero, Liam Smith, Brooks Olney, Pooya Khorrami, Steven Kusiak, Watson Jia, Sage Trudeau, Daniel Capecci
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04106v1 Announce Type: new Abstract: Foundation models achieve generalization through massive-scale training on diverse data, but have limitations with transfer to truly unseen domains without paired training data. We propose principle-driven foundation models that encode signal-theoretic...
20. Variance Reduction for Heavy-Tailed Monetization Metrics in Ranking Experiments via Post-Stratification
Author: Neeti Pokharna, Olivier Jeunen, Yatharth Saraf, Aleksei Ustimenko
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2606.04110v1 Announce Type: new Abstract: Online evaluation of ranking and retrieval systems often relies on downstream monetization metrics such as app revenue or creator earnings. These metrics are typically heavy-tailed, with a small fraction of users dominating both mean and variance, lead...
21. dMX: Differentiable Mixed-Precision Assignment for Low-Precision Floating-Point Formats
Author: Giuseppe Franco, Ian Colbert, Pablo Monteagudo-Lago, Felix Marty, Nicholas Fraser
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04115v1 Announce Type: new Abstract: Quantizing large language models (LLMs) to low-precision floating-point representations is central to efficient deployment, yet applying a single bit-width uniformly across all layers is sub-optimal in terms of both performance and accuracy. This work ...
22. Stationarity-Aware Retrieval-Augmented Time Series Forecasting
Author: Shiqiao Zhou, Holger Sch"oner, Zipeng Wu, Edouard Fouch'e, IAG Wilson, Shuo Wang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.04135v1 Announce Type: new Abstract: Time series forecasting relies on historical patterns, but real-world series often exhibit non-stationarity and regime shifts that challenge fully parametric forecasters. Inspired by Retrieval-Augmented Generation (RAG), recent work augments forecaster...
23. Physics-Informed Machine Learning for Short-Term Flood Prediction
Author: Tewodros Syum Gebre, Jagrati Talreja, Leila Hashemi-Beni
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04143v1 Announce Type: new Abstract: Accurate flood forecasting is essential for mitigating disaster risks and protecting communities. However, purely data-driven machine learning models often struggle in data-scarce environments and may violate fundamental hydrological principles. Standa...
24. EvalStop: Using World Feedback to Detect and Correct Reward Overoptimization in Multi-Tenant RLHF Platforms
Author: Guilin Zhang, Chuanyi Sun, Shahryar Sarkani, John M. Fossaceca
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.DC
arXiv:2606.04145v1 Announce Type: new Abstract: Cloud LLM fine-tuning platforms increasingly serve RLHF workloads, where a learned reward model is optimized as a proxy for human quality. As Gao et al. (2023) showed, this proxy diverges from world feedback (downstream eval metrics) under sustained op...
25. When Offline Selectors Cannot Beat the Best Single Model: A Diagnostic Study on edX Dropout Prediction
Author: Tyler Crosse, Alan Nadelsticher Ruvalcaba, Dustin Khang LeDuc, Thomas Trask, Nicholas Lytle, David Joyner
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.04161v1 Announce Type: new Abstract: Different predictors often excel on different inputs, so picking the best one per instance promises higher accuracy than committing to a single model. In practice, selectors trained from logged data routinely fail to beat the strongest single predictor...
26. ADAPTOOD: Uncertainty-Aware Fine-Tuning for Out-of-Distribution ECG Time Series Models
Author: Sotirios Vavaroutas, Yu Yvonne Wu, Ali Etemad, Cecilia Mascolo
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04164v1 Announce Type: new Abstract: Data samples used for training often differ from those encountered during fine-tuning and deployment, and while ML models show promise, their performance remains limited when only small annotated datasets are available. Performance often degrades under...
27. Smart Transportation Without Neurons -- Fair Metro Network Expansion with Tabular Reinforcement Learning
Author: Dimitris Michailidis, Sennay Ghebreab, Fernando P. Santos
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04167v1 Announce Type: new Abstract: We tackle the Metro Network Expansion Problem (MNEP), a subset of the Transport Network Design Problem (TNDP), which focuses on expanding metro systems to satisfy travel demand. Traditional methods rely on exact and heuristic approaches that require ex...
28. When Autoregressive Consistency Hurts Safety Alignment
Author: Bochen Lyu, Yiyang Jia, Xiaohao Cai, Zhanxing Zhu
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.CR
arXiv:2606.04168v1 Announce Type: new Abstract: Safety alignment in large language models (LLMs) is fragile in part because it is often shallow: fine-tuning mainly reshapes the model's behavior near the first few output tokens. We argue that this phenomenon can be understood through autoregressive c...
29. Low-rank Distributional Matrix Completion
Author: Jiayi Wang, Raymond K. W. Wong
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, math.ST, stat.ML, stat.TH
arXiv:2606.04176v1 Announce Type: new Abstract: We study a distributional generalization of the matrix completion problem in which each entry of the target matrix is a probability distribution rather than a scalar. In this setting, only a subset of matrix entries is observed, and even for observed e...
30. KODA: Contrastive Representation Comparison and Alignment for Vision-Language Foundation Models
Author: Youqi Wu, Mohammad Jalali, Farzan Farnia
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.IT, math.IT
arXiv:2606.04180v1 Announce Type: new Abstract: Vision-language foundation models such as CLIP and SigLIP provide widely used representations for multimodal learning systems. While these models are typically compared through downstream performance, such evaluations often do not explain how their rep...
31. Exact Unlearning in Reinforcement Learning
Author: Thanh Nguyen-Tang, Raman Arora
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, stat.ML
arXiv:2606.04182v1 Announce Type: new Abstract: We formulate the problem of \emph{exact unlearning} in reinforcement learning, where the goal is to design an efficient framework that enables the removal of any user's data upon deletion request, i.e., the online learner's output after unlearning is ...
32. Dual Advantage Fields
Author: Alexey Zemtsov, Maxim Bobrin, Alexander Nikulin, Dmitry V. Dylov, Fakhri Karray, Vladislav Kurenkov, Martin Tak'a\v{c}, Arip Asadulaev
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.RO
arXiv:2606.04188v1 Announce Type: new Abstract: Offline goal-conditioned reinforcement learning requires both long-horizon reachability estimates and local action comparisons. Dual goal representations provide value fields that capture global goal reachability, but they do not directly specify which...
33. Metric-Aware Hybrid Forecasting for the CTF4Science Lorenz Challenge
Author: Cen Lu
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04191v1 Announce Type: new Abstract: We describe our approach to the CTF4Science Lorenz challenge, a benchmark that mixes short-horizon forecasting, long-time distribution matching, and trajectory reconstruction across nine task pairs. The key discovery is that no single model family domi...
34. Training-Free Lexical-Dense Fusion for Conversational-Memory Retrieval
Author: Christian Lysenst{\o}en
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.CL, cs.IR
arXiv:2606.04194v1 Announce Type: new Abstract: Retrieving the few past turns that answer a new query across long multi-session histories is the retrieval bottleneck behind long-term conversational memory (LoCoMo, LongMemEval). Recent concurrent work, Nano-Memory, shows that scoring a session by the...
35. A Geometric View of Counterfactual Behavior: Interaction of Boundary Proximity and Local Support
Author: Ioanna Gemou, Matteo Gamba, Randall Balestriero, Ritambhara Singh
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.04209v1 Announce Type: new Abstract: Counterfactual explanations seek small, semantically meaningful changes to an input that alter a model's prediction, and are widely used to interpret and audit machine learning systems. In modern vision, language, and multimodal systems, pretrained enc...
36. Edge of Stability Selectively Shapes Learning Across the Data Distribution
Author: Shauna Kwag, Anakha Ganesh, Tomaso Poggio, Pierfrancesco Beneventano
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2606.04212v1 Announce Type: new Abstract: Existing analyses of the edge of stability (EoS) treat it as a global property of optimization. We show that it is also selective: the stability constraint redistributes learning across subsets of the training distribution, amplifying progress on some ...
37. Recover-LoRA for Aggressive Quantization: Reclaiming Accuracy in 2-Bit Language Models via Low-Rank Adaptation with Knowledge Distillation on Synthetic Data
Author: Devleena Das, Rajeev Patwari, Elliott Delaye, Ashish Sirasao
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04238v1 Announce Type: new Abstract: Aggressive weight quantization to 2-bit precision offers substantial throughput and memory gains for large language model (LLM) inference, but typically incurs severe accuracy degradation. These gains are particularly relevant for edge and on-device de...
38. RL Excursions during Pre-Training: Re-examining Policy Optimization for LLM training
Author: Rachit Bansal, Clara Mohri, Tian Qin, David Alvarez-Melis, Sham Kakade
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.04272v1 Announce Type: new Abstract: The standard LLM training pipeline applies reinforcement learning (RL) only after pre-training and supervised fine-tuning (SFT). We question this status quo by training a LLM from scratch and applying RL, SFT, and SFT followed by RL directly to interme...
39. From Ticks to Flows: Dynamics of Neural Reinforcement Learning in Continuous Environments
Author: Saket Tiwari, Tejas Kotwal, George Konidaris
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04275v1 Announce Type: new Abstract: We present a novel theoretical framework for deep reinforcement learning (RL) in continuous environments by modeling the problem as a continuous-time stochastic process, drawing on insights from stochastic control. Building on previous work, we introdu...
40. Derivative Informed Learning of Exchange-Correlation Functionals
Author: Eike S. Eberhard, Luca A. Thiede, Abdul Aldossary, Andreas Burger, Nicholas Gao, Vignesh Bhethanabotla, Al'an Aspuru-Guzik, Stephan G"unnemann
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, quant-ph
arXiv:2606.04279v1 Announce Type: new Abstract: Machine-learned (ML) exchange-correlation (XC) functionals aim to replace human-designed density functional approximations by learning directly from reference data, but they still do not consistently outperform traditional $\mathcal{O}(N^4)$-scaling hy...
41. The Loss Is Not Enough: Sampling Conditions and Inductive Bias in Contrastive Representation Learning
Author: Justinas Zaliaduonis, Patrick Putzky, Till Richter, Sergios Gatidis
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.IR
arXiv:2606.04280v1 Announce Type: new Abstract: Contrastive learning has become a leading paradigm for self-supervised representation learning, yet the conditions under which it recovers meaningful latent geometry remain incompletely understood. We develop a measure-theoretic framework formalizing t...
42. Sparse Mixture-of-Experts Reward Models Learn Interpretable and Specialized Experts for Personalized Preference Modeling
Author: Yifan Wang, Jinyi Mu, Mayank Jobanputra, Yu Wang, Ji-Ung Lee, Soyoung Oh, Isabel Valera, Vera Demberg
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL
arXiv:2606.04284v1 Announce Type: new Abstract: Preference modeling plays a central role in reinforcement learning from human feedback (RLHF), enabling large language models (LLMs) to align with human values. However, most existing approaches assume a universal reward function, neglecting the divers...
43. Scaling Novel Graph Generation via Lightweight Structure-Guided Autoregressive Models
Author: Alessio Barboni, Massimiliano Lupo Pasini, Bishal Lakha, Edoardo Serra
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04287v1 Announce Type: new Abstract: Generating realistic and diverse graphs is a key problem in machine learning, with applications in molecular discovery, circuit design, cybersecurity, and beyond. However, current graph generative models remain limited by scalability and novelty. Diffu...
44. PE-MHL: Physics-Encoded Modular Hybrid Layers for Scalable Learning of Complex Systems
Author: Ismail Hassaballa, Mircea Lazar
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, math.OC
arXiv:2606.04290v1 Announce Type: new Abstract: Hybrid models that combine physics-based and data-driven components have shown strong potential for achieving accuracy and interpretability in control applications. While recent methods have made progress in incorporating physical consistency, challeng...
45. Offline-to-Online Learning in Linear Bandits
Author: Kushagra Chandak, Toshinori Kitamura, Xiaoqi Tan
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2606.04305v1 Announce Type: new Abstract: We study online learning with an additional offline dataset in the stochastic linear bandit setting. Although this problem arises frequently in practice, the offline-to-online tradeoff remains poorly understood in structured environments. We propose a ...
46. Folded Transport MCMC: Certifiable Quotient Posterior Computation for Symmetric Bayesian Models
Author: Jun Hu
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, stat.CO, stat.ME
arXiv:2606.04307v1 Announce Type: new Abstract: Bayesian models with finite symmetry - mixture models with exchangeable components, structural identification with closely-spaced modes - define posteriors that are invariant under a group of label permutations, creating redundant multimodality that de...
47. Latent Anchor-Driven Test Generation for Deep Neural Networks
Author: Bin Duan, Matthew B. Dwyer, Guowei Yang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.SE
arXiv:2606.04310v1 Announce Type: new Abstract: Deep Neural Networks (DNNs) are increasingly being deployed in security-critical and safety-sensitive applications, which makes rigorous testing essential to identify and mitigate model weaknesses. Existing DNN testing approaches explore either the inp...
48. Testing Neural Networks via Bayesian-Guided Exploration of Decision Landscapes
Author: Bin Duan, Meiru Che, Guowei Yang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.SE
arXiv:2606.04314v1 Announce Type: new Abstract: As neural networks are increasingly deployed in safety-critical domains, testing is essential to evaluate and improve their reliability. Existing testing methods, whether black-box or white-box, primarily use global mutation or coverage-guided strategi...
49. OpenRFM: Dissecting Relational In-Context Learning
Author: Zhikai Chen, Junyu Yin, Jialiang Gu, Siheng Xiong, Xiaoze Liu, Ruowang Zhang, Keren Zhou, Kai Guo
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04320v1 Announce Type: new Abstract: Relational Foundation Models (RFMs) promise a single pre-trained predictor that, given any relational database, returns predictions in one forward pass via relational in-context learning (ICL). Yet a substantial gap separates open RFMs from their comme...
50. Neural Galerkin Normalizing Flows for Bayesian Inference of Diffusions with Inaccessible Boundaries
Author: Riccardo Saporiti, Fabio Nobile
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2606.04324v1 Announce Type: new Abstract: One of the primary challenges in Bayesian inference on the parameters of a diffusion model from discrete observations is the unavailability of an analytical expression for the transition density function between consecutive observation times, which is ...
51. Measuring What Matters: Synthetic Benchmarks for Concept Bottleneck Models
Author: Julian Skirzynski, Harry Cheon, Shreyas Kadekodi, Meredith Stewart, Berk Ustun
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04326v1 Announce Type: new Abstract: Concept bottleneck models predict outcomes from high-level concepts detected in inputs. Although concepts provide a simple way to reap benefits from interpretability, very few datasets include concept labels. This limits researchers' ability to determi...
52. A Geometric Characterization of the Stationary Plateau for Two-Layer Neural Networks
Author: Tian Ding, Dawei Li, Ruoyu Sun
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, math.OC
arXiv:2606.04327v1 Announce Type: new Abstract: We investigate the geometric structure of stationary plateaus that arise in the loss landscape of two-layer neural networks with smooth activation functions. We focus on the phenomenon of "neuron splitting" where duplicating a hidden neuron yields an a...
53. Policy Gradient for Continuous-Time Robust Markov Decision Processes
Author: Tanya Veeravalli, David M. Bossens, Atsushi Nitanda
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.SY, eess.SY
arXiv:2606.04335v2 Announce Type: new Abstract: The framework of robust Markov decision processes (RMDPs) allows the design of reinforcement learning agents that satisfy performance guarantees under worst-case transition dynamics. Traditional RMDPs consider discrete-time dynamics and recently, sampl...
54. Federated Learning for Multi-Center Sepsis Early Prediction with Privacy-Preserving
Author: Xixi Tian, Di Wu, Xiang Liu, Yiziting Zhu, Yujie Li, Xin Shu, Bin Yi
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.CR
arXiv:2606.04338v1 Announce Type: new Abstract: Privacy-sensitive and distributed characteristics of multi-center medical data bring severe obstacles to centralized modeling for accurate early prediction of sepsis. Federated learning (FL) has attracted growing attention as a promising framework for ...
55. Literature-Guided Minimax Optimization of Virtual Epilepsy Neurostimulation
Author: Cathy Liu
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.04339v1 Announce Type: new Abstract: Computational models of epilepsy promise patient-specific treatment design, but most optimization workflows still search for parameters that perform well on average. In neuromodulation, this is a weak target: a protocol that improves the mean response ...
56. Expectations vs. Realities: The Cost of MSE-Optimal Forecasting Under Conditional Uncertainty
Author: Riku Green, Zahraa S. Abdallah, Telmo M Silva Filho
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04342v1 Announce Type: new Abstract: Multi-step time series forecasting (MSF) is commonly evaluated using point-wise error metrics such as mean squared error (MSE), implicitly treating the conditional mean as a sufficient target. We show that this can be misleading under conditional uncer...
57. MeshTok: Efficient Multi-Scale Tokenization for Scalable PDE Transformers
Author: Yanshun Zhao, Xiaoyu Peng, Jiamin Jiang, Congcong Zhu, Jingrun Chen
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.NA, math.NA
arXiv:2606.04366v1 Announce Type: new Abstract: Conventional patchified Transformers operate on uniform spatial partitions, distributing computational effort evenly across the domain irrespective of local features. This inflexible tokenization scheme is inherently limited in its ability to efficient...
58. When Do Fewer Coordinates Suffice in DP-SGD?
Author: Huiqi Zhang, Fang Xie
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2606.04375v1 Announce Type: new Abstract: Differentially private stochastic gradient descent (DP-SGD) injects noise into every updated coordinate, making the injected noise energy scale with the ambient parameter dimension (d). We ask when private training can update fewer coordinates withou...
59. From Symbolic to Geometric: Enabling Spatial Reasoning in Large Language Models
Author: Chen Chu, Bita Azarijoo, Li Xiong, Khurram Shafique, Cyrus Shahabi
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04381v1 Announce Type: new Abstract: Recent large language models (LLMs) often appear to exhibit spatial reasoning ability; however, this capability is largely \emph{symbolic}, arising from pattern matching over spatial language rather than true \emph{geometric} reasoning over space. Beca...
60. Revisiting Privacy Amplification by Subsampling in Selective Release DPSGD
Author: Xiaobo Huang, Fang Xie
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.CR, stat.ML
arXiv:2606.04384v1 Announce Type: new Abstract: Machine learning's reliance on sensitive data necessitates privacy-preserving techniques like Differentially Private Stochastic Gradient Descent (DPSGD). However, DPSGD suffers from substantial utility degradation and slow convergence due to gradient c...
61. Shortcomings and capacities of real-constrained neural networks in complex spaces
Author: Andrew Gracyk
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cond-mat.dis-nn, math.PR
arXiv:2606.04390v1 Announce Type: new Abstract: We find the asymptotic ratio between the storage capacities when enforcing real pre-activations in a complex hypothesis class as opposed to complex ones in the same class. Our methods depend on Gardner volume comparisons at critical capacity. Our proof...
62. Physics-Informed Neural Network Modeling of Biodegradable Contaminant Transport through GCL/SL Composite Liners
Author: Dong Li, Yapeng Cao, Haiping Zhao, Shutong Han
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.CL
arXiv:2606.04392v1 Announce Type: new Abstract: This study develops a two-domain physics-informed neural network framework for contaminant transport through a GCL/SL composite liner system, in which the thin GCL layer is treated using a steady-state advection-dispersion-biodegradation formulation an...
63. DPDL: Towards Differential Privacy Preservation in Decentralized Stochastic Learning on Non-IID Data
Author: Yunsheng Yuan, Xue Xiao, Lina Wang, Feng Li
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.CR
arXiv:2606.04399v1 Announce Type: new Abstract: In the paradigm of decentralized learning, a group of agents collaborate to train a global model using distributed datasets without a central server. Although the power of collaboration has been verified by many state-of-the-art studies, it entails ext...
64. TANDEM: Bi-Level Data Mixture Optimization with Twin Networks
Author: Jiaxing Wang, Deping Xiang, Jin Xu, Mingyang Yi, Guoqiang Gong, Zicheng Zhang, Haoran Li, Pengzhang Liu, Zhen Chen, Ke Zhang, Ju Fan, Qixiang Jiang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.04401v1 Announce Type: new Abstract: The capabilities of large language models (LLMs) significantly depend on training data drawn from various domains. Optimizing domain-specific mixture ratios can be modeled as a bi-level optimization problem, which we simplify into a single-level penali...
65. Low-Rank Decay for Grokking in Scale-Invariant Transformers: A Spectral-Geometric View
Author: Mingyu Li
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04405v1 Announce Type: new Abstract: Modern Transformer architectures frequently employ normalization mechanisms such as RMSNorm and Query-Key Normalization, making parts of the model approximately scale-invariant with respect to weight magnitudes. In this regime, standard Frobenius-norm ...
66. An Ensembled Latent Factor Model via Differential Evolution and Gradient Descent Optimization
Author: Rui Zhang, Jinhang Liu, Wenbo Zhang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04408v1 Announce Type: new Abstract: High-dimensional and incomplete (HDI) data are prevalent in many real-world big data scenarios. Latent factor models serve as a common representation learning approach, capable of uncovering informative latent factors from such data. Nevertheless, most...
67. (Mis)generalization of Helpful-only Fine-tuning
Author: Mohammad Omar Khursheed, Baram Sosis, Fabien Roger
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.04413v1 Announce Type: new Abstract: Helpful-only models, that is, models that are trained to always follow user intent, are valuable for dangerous capability evaluations and other areas of AI R&D where refusals would be an obstacle. Little is known about the generalization properties of ...
68. Loss-Conditional PINNs for Parametric PDE Families
Author: Anna Lazareva, Alexander Tarakanov
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.04420v1 Announce Type: new Abstract: Physics-informed neural networks (PINNs) approximate solutions of ODEs and PDEs by minimising a weighted combination of residual, boundary, initial, and data losses. Their performance is often dominated by the choice of loss weights: a poor weighting c...
69. The price of multi-group transductive learning
Author: Noah Bergam, Samuel Deng, Daniel Hsu
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2606.04423v1 Announce Type: new Abstract: We show every multi-group learner in the transductive setting may incur a multiplicative penalty in its error rate on some group relative to the error rate achievable in the single-group setting, and the penalty can increasing linearly with the number ...
70. LoopMoE: Unifying Iterative Computation with Mixture-of-Experts for Language Modeling
Author: Wenkai Chen, Tianshu Li, Wenyong Huang, Yichun Yin, Lifeng Shang, Chengwei Qin
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04438v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) and looped architectures scale models along two orthogonal axes, namely parameter capacity and effective depth. However, mainstream looped architectures rely on dense backbones that couple parameter count with per-token FLOPs, ...
71. RowNet: A Memory Transformer for Tabular Regression
Author: Askat Rakhymbekov, Gulshat Muhametjanova
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, math.ST, stat.TH
arXiv:2606.04445v1 Announce Type: new Abstract: Real estate valuation is a structured regression problem in which prices are governed by heterogeneous feature types, sparse regional effects, nonlinear interactions, and the practical logic of comparable properties. Standard multilayer perceptrons tre...
72. On Out-of-sample Embedding in UMAP
Author: Mohammad Tariqul Islam, Jason W. Fleischer
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.04451v1 Announce Type: new Abstract: Neighbor embedding algorithms reveal correlations in high-dimensional data by constructing an equivalent graph representation in a lower-dimensional space. An increasingly popular algorithm is Uniform Manifold Learning and Projection (UMAP), which uses...
73. ParetoPilot: Zero-Surrogate Offline Multi-Objective Optimization via Infer-Perturb-Guide Diffusion
Author: Ruiqing Sun, Sen Yang, Dawei Feng, Bo Ding, Yijie Wang, Huaimin Wang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.NE, math.OC
arXiv:2606.04468v1 Announce Type: new Abstract: Offline multi-objective optimization (Offline MOO) aims to discover novel Pareto-optimal designs based on static datasets without expensive environment interactions. While recent generative methods have achieved notable success, they predominantly rely...
74. ChessMimic: Per-Rating Transformer Models for Human Move, Clock, and Outcome Prediction in Online Blitz Chess
Author: Thomas Johnson
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04473v1 Announce Type: new Abstract: We present ChessMimic, a system of three small encoder-only transformers - for move, thinking-time, and outcome prediction - conditioned on the position, recent move history, player rating, and clock state. We fit a separate instance of each model per ...
75. When Both Layers Learn: Training Dynamics of Representing Linear Models via ReLU Networks
Author: Berk Tinaz, Changzhi Xie, Mahdi Soltanolkotabi
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, math.OC, math.ST, stat.ML, stat.TH
arXiv:2606.04476v1 Announce Type: new Abstract: In this paper, we study the gradient descent dynamics for jointly training both layers of a one-hidden-layer ReLU network to fit a linear target function. Concretely, we consider a realizable setting where inputs are drawn i.i.d. from a Gaussian distri...
76. LimiX-2M: Mitigating Low-Rank Collapse and Attention Bottlenecks in Tabular Foundation Models
Author: Yuanrui Wang, Xingxuan Zhang, Han Yu, Mingchao Hao, Gang Ren, Hao Yuan, Li Mao, Yunjia Zhang, Chun Yuan, Peng Cui
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.04485v2 Announce Type: new Abstract: Tabular foundation models (TFMs) increasingly rival tree ensembles, but their performance is often compute-inefficient: with standard affine scalar tokenization, each feature injects value variation through an essentially one-dimensional channel, and f...
77. Episodic Memory Temporal Consistency for Cooperative Multi-Agent Reinforcement Learning
Author: Zicheng Zhao, Yu Lan, Chengzhengxu Li, Zhaohan Zhang, Xiaoming Liu
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.GT
arXiv:2606.04492v1 Announce Type: new Abstract: Cooperative Multi-Agent Reinforcement Learning (MARL) frequently suffers from severe reward sparsity and exploration bottlenecks. While episodic memory mechanisms mitigate these issues by reusing high-return trajectories, they often trap agents in loca...
78. Smart Picks in the Dark: Towards Efficient RLVR for Reasoning via Tracing Metacognitive Pivots
Author: Guangcheng Zhu, Shenzhi Yang, Haobo Wang, Xing Zheng, Yingfan MA, Xuening Feng, Zhongqi Chen, Bowen Song, Weiqiang Wang, Gang Chen
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04503v1 Announce Type: new Abstract: Reinforcement learning with verifiable rewards (RLVR) has greatly advanced large reasoning models (LRMs), but it requires timely training on a huge fully-annotated dataset. To this end, data-efficient RLVR methods have been widely studied from two pers...
79. GeoMin: Data-Efficient Semi-Supervised RLVR via Geometric Distribution Modeling
Author: Guangcheng Zhu, Shenzhi Yang, Haobo Wang, Xing Zheng, Yingfan MA, Xuening Feng, Zhongqi Chen, Kai Tang, Zhengqing Zang, Bowen Song, Weiqiang Wang, Gang Chen
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04516v1 Announce Type: new Abstract: Reinforcement learning with verifiable rewards (RLVR) significantly advances LLM reasoning, yet it faces a dilemma: standard supervised scaling is throttled by high annotation costs, while unsupervised alternatives suffer from severe model collapse. Re...
80. Rollout-Level Advantage-Prioritized Experience Replay for GRPO
Author: Gyeongtae Yoo, Sanghyeok Park, Soohyuk Jang, Ik-hwan Kim, Sungroh Yoon
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04560v2 Announce Type: new Abstract: Reinforcement learning from verifiable rewards with GRPO is a standard approach for post-training reasoning LLMs. It remains sample inefficient. Each rollout is used for a single gradient update and then discarded. Naive replay is not well suited in th...
81. SurvPFN: Towards Foundation Models for Survival Predictions
Author: Samuel B"ohm (Institute of Epidemiology and Prevention, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany), Lennart Purucker (Department of Computer Science, University of Freiburg, Freiburg, Germany, PriorLabs, Freiburg, Germany), Frank Hutter (Department of Computer Science, University of Freiburg, Freiburg, Germany, PriorLabs, Freiburg, Germany), Pascal Schlosser (Institute of Epidemiology and Prevention, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany, Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland, US, CIBSS - Centre for Integrative Biological Signalling Studies, University of Freiburg, Freiburg, Germany)
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.04564v1 Announce Type: new Abstract: Tabular foundation models (TFMs) have made rapid progress in standard classification and regression, but time-to-event survival prediction tasks have remained largely untouched. Unlike in standard regression tasks, survival prediction models must accou...
82. Dynamic Multi-Pair Trading Strategy in Cryptocurrency Markets with Deep Reinforcement Learning
Author: Damian Lebied'z, Robert 'Slepaczuk
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.NE, q-fin.ST, q-fin.TR, stat.ML
arXiv:2606.04574v1 Announce Type: new Abstract: This study aims to determine whether the application of Deep Reinforcement Learning (DRL) as a specialized execution overlay can enhance pair trading in highly volatile cryptocurrency markets. Although classical implementations of the strategy have pro...
83. HalfNet: Randomized Neural Networks with Learned Subspace Geometry
Author: Ethem Alpaydin
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.04583v1 Announce Type: new Abstract: Many researchers investigated neural networks with some of their weights fixed to values randomly drawn from a given distribution, e.g., $N(0, I)$. Our proposed HalfNet draws random weights from $N(0, \Sigma)$, where $\Sigma$, which defines the geometr...
84. QuBLAST: A Framework for Quantizing Large Language Models with Block-Level Compression Approach and Activation Scaling Strategy
Author: Pasindu Wickramasinghe, Achyuta Muthuvelan, Rachmad Vidya Wicaksana Putra, Minghao Shao, Muhammad Shafique
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04620v1 Announce Type: new Abstract: LLMs have become the state-of-the-art algorithms for solving NLP tasks. However, they typically come at huge computational and memory costs, thus making them difficult to deploy on embedded systems. Toward this, state-of-the-art methods typically emplo...
85. Learning symplectic model reduction based on a approximation theorem of symplectic embeddings
Author: Liyi Feng, Yifa Tang, Yulin Xie, Ruili Zhang, Aiqing Zhu
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.04623v1 Announce Type: new Abstract: High-dimensional Hamiltonian systems play a central role in many scientific and engineering disciplines, with dynamics evolving on symplectic manifolds. Although deep learning provides powerful tools for constructing low-dimensional surrogates from dat...
86. VentAgent: When LLMs Learn to Breathe -- Multi-Objective Arbitration for ARDS Ventilation
Author: Teqi Hao, Yuxuan Fu, Xiaoyu Tan, Shaojie Shi, Bohao Lv, Yinghui Xu, Xihe Qiu
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.CL
arXiv:2606.04632v1 Announce Type: new Abstract: Mechanical ventilation for Acute Respiratory Distress Syndrome (ARDS) requires balancing competing physiological goals, including oxygenation, lung protection, and acid-base homeostasis. However, current data-driven methods, especially those imitating ...
87. Explainably Safe Reinforcement Learning
Author: Sabine Rieder, Stefan Pranger, Debraj Chakraborty, Jan K\v{r}et'insk'y, Bettina K"onighofer
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.04634v1 Announce Type: new Abstract: Trust in a decision-making system requires both safety guarantees and the ability to interpret and understand its behavior. This is particularly important for learned systems, whose decision-making processes are often highly opaque. Shielding is a prom...
88. ALINC: Active Learning for Inductive Node Classification via Graph Sampling
Author: Pascal Plettenberg, Denis Huseljic, Andr'e Alcalde, Bernhard Sick, Josephine M. Thomas
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.04647v1 Announce Type: new Abstract: Active learning (AL) for node classification typically focuses on selecting the most informative nodes for annotation within one or a few large graphs (e.g., in social network analysis). However, in other domains, such as molecular chemistry or electro...
89. Why Muon Outperforms Adam: A Curvature Perspective
Author: Shuche Wang, Fengzhuo Zhang, Jiaxiang Li, Dirk Bergemann, Zhuoran Yang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04662v1 Announce Type: new Abstract: Muon improves training efficiency over Adam in large language-model training by about two times, but the local geometric source of this advantage remains unclear. Our work takes a first step toward demystifying Muon's superiority over Adam from a curva...
90. Towards Accurate Model Selection in Deep Unsupervised Domain Adaptation
Author: Kaichao You, Ximei Wang, Mingsheng Long, Michael I. Jordan
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.04665v1 Announce Type: new Abstract: Deep unsupervised domain adaptation (Deep UDA) methods successfully leverage rich labeled data in a source domain to boost the performance on related but unlabeled data in a target domain. However, algorithm comparison is cumbersome in Deep UDA due to ...
91. Learning Long Range Spatio-Temporal Representations over Continuous Time Dynamic Graphs with State Space Models
Author: Ayushman Raghuvanshi, Thummaluru Siddartha Reddy, Sundeep Prabhakar Chepuri, Mahesh Chandran
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04672v2 Announce Type: new Abstract: Continuous-time dynamic graphs (CTDGs) provide a richer framework to capture fine-grained temporal patterns in evolving relational data. Long-range information propagation is a key challenge while learning representations, wherein it is important to re...
92. Test-Time Compute Scaling for ASR with Depth-Conditioned Looped Transformers
Author: Yacouba Kaloga, Shashi Kumar, Shakeel A. Sheikh, Driss Khalil, Petr Motlicek, Ina Kodrasi
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.04678v1 Announce Type: new Abstract: End-to-end ASR systems typically use fixed-depth acoustic encoders at inference, making it difficult to trade additional test-time computation for improved recognition without training a larger model. A natural approach is to reuse a shared Transformer...
93. Cone-Compatible Monge Geometry for High-Dimensional Ordered Optimal Transport
Author: Lei Luo, Hongliang Zhang, Jian Yang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.04695v1 Announce Type: new Abstract: High-dimensional optimal transport is seldom available in closed form. The one-dimensional case is exceptional because the order of the real line is compatible with convex transport costs, making monotone rearrangement optimal. This paper studies when ...
94. Graph-Guided Universum Learning in Generalized Eigenvalue Proximal SVMs for Alzheimer's Disease Classification
Author: Yogesh Kumar, Vrushank Ahire, Mudasir Ganaie
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CV
arXiv:2606.04699v1 Announce Type: new Abstract: Early and accurate detection of Alzheimer's disease (AD) is important for timely intervention and disease management. Generalized Eigenvalue Proximal Support Vector Machine (GEPSVM) and its Universum-based variants have shown promising results for AD c...
95. Contrastive Learning and Correlation Clustering for Sequences of Network Telescope Data
Author: Jannik Presberger, Alexander M"annel, Maynard Koch, Thomas C. Schmidt, Matthias W"ahlisch, Bjoern Andres
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.NI
arXiv:2606.04733v1 Announce Type: new Abstract: Understanding activities of Internet scanners is challenging; it often requires identifying relationships between sources, a task for which semantic annotations are scarce. This work investigates whether semantically meaningful pairwise relationships b...
96. Trace-Mediated Peak Bias: Bridging Temporal Credit Assignment and Cognitive Heuristics in Deep Reinforcement Learning
Author: Viktor Vesel'y, Aleksandar Todorov, Erwan Escudie, Matthia Sabatelli
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04735v1 Announce Type: new Abstract: Temporal credit assignment is central to both biological and artificial intelligence, yet its interaction with non-linear function approximation is poorly understood. We identify a systematic failure mode in deep reinforcement learning (RL) termed Trac...
97. Curvature-aware dynamic precision approach for physics-informed neural networks
Author: Yingjie Shao, Ioannis N. Athanasiadis, George van Voorn, Taniya Kapoor
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04736v1 Announce Type: new Abstract: Physics-informed neural networks (PINNs) have become a promising framework for simulating partial differential equations (PDEs) by embedding physical laws directly into neural network training. However, recent studies show that PINN optimisation is sen...
98. An Empirical Audit of Input Encoders for Multi-Channel Signal Transformers
Author: Ossi Lehtinen
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04752v1 Announce Type: new Abstract: Transformers consuming multi-channel scalar signals must embed $C$ simultaneous values into one $d_{\text{model}}$-dimensional vector per time step. We empirically audit eight input encoders -- spanning a shared-scalar baseline, per-channel linear proj...
99. Beyond Structural Symmetries: Linear Mode Connectivity via Neuron Identifiability
Author: Vincent B"urgin, Daniel Herbst, Ya-Wei Eileen Lin, Stefanie Jegelka
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.04754v1 Announce Type: new Abstract: Many striking phenomena in deep learning, such as linear mode connectivity and the structured behavior of training dynamics, are closely tied to parameter symmetries: transformations that leave the realized function unchanged. Despite growing attention...
100. Measuring Model Robustness via Fisher Information: Spectral Bounds, Theoretical Guarantees, and Practical Algorithms
Author: Chong Zhang, Xiang Li, Jia Wang, Qiufeng Wang, Xiaobo Jin
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.CV
arXiv:2606.04767v1 Announce Type: new Abstract: The robustness of deep neural networks is crucial for safety-critical deployments, yet existing evaluation methods are often attack-dependent and lack interpretability. We propose a principled, attack-agnostic robustness metric based on the spectral no...
101. Activation Steering of Video Generation Models via Reduced-Order Linear Optimal Control
Author: Jihoon Hong, Alice Chan, Qiyue Dai, Julian Skifstad, Glen Chou
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CV, cs.SY, eess.SY, math.OC
arXiv:2606.04775v1 Announce Type: new Abstract: Text-to-video (T2V) models trained on large-scale web data can generate undesired content, motivating interventions that reduce harmful outputs without sacrificing visual quality. Activation steering offers an attractive mechanistic alternative to fine...
102. UniFair: A unified fair clustering approach based on separation and compactness
Author: Antonia Karra, Vasiliki Papanikou, Georgios Vardakas, Evaggelia Pitoura, Aristidis Likas
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.04777v2 Announce Type: new Abstract: Clustering is increasingly used to support high-impact decisions, yet standard objectives such as k-means can produce clusterings that treat demographic groups unequally. Existing fair clustering methods typically optimize a single notion of fairness a...
103. Uncertainty-Aware (Un)Supervised Few-Shot User Adaptation for On-Device Personalized Human Activity Recognition
Author: Maximilian Burzer, Till Riedel, Michael Beigl, Tobias R"oddiger
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.04798v1 Announce Type: new Abstract: Sensor-based Human Activity Recognition (HAR) models often degrade on unseen users due to domain shifts caused by individual movement patterns and sensor placement. Practical wearable HAR systems therefore require personalization methods that are light...
104. The Right Measure for Physics-Constrained Generation: A Co-Area Correction for Posterior-Consistent PDE Inverse Problems
Author: Jian Xu, Delu Zeng, John Paisley, Qibin Zhao
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.04804v2 Announce Type: new Abstract: Generative models -- diffusion and flow matching -- are increasingly used to solve partial differential equation (PDE) inverse problems, enforcing the governing physics as a \emph{hard constraint} (via projection or guidance) and reporting the resultin...
105. Scenario Generation for Risk-Aware Reinforcement Learning with Probably Approximately Safe Guarantees
Author: Mohit Prashant, Arvind Easwaran
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04812v1 Announce Type: new Abstract: Guaranteeing safety is critical to the deployment of reinforcement learning (RL) agents in the real-world, especially as policies learned using deep RL may demonstrate susceptibility to transition perturbations that result in unknown or unsafe behaviou...
106. Learning While Acting: A Skill-Enhanced Test-Time Co-Evolution Framework for Online Lifelong Learning Agents
Author: Bo Mao, Jie Zhou, Yutao Yang, Xin Li, Xian Wei, Qin Chen, Xingjiao Wu, Liang He
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04815v1 Announce Type: new Abstract: Lifelong learning is essential for Large Language Model (LLM) agents operating in dynamic, interactive environments. However, existing lifelong learning agents for long-horizon tasks typically depend on discrete skill or past experiences retrieval with...
107. Reconciling Causality and Non-Equilibrium Thermodynamics with Hamiltonian Causal Models
Author: Dario Rancati, Max Welling, Francesco Locatello
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.04822v1 Announce Type: new Abstract: Causal modeling of physical temporal phenomena must handle interventions that act along trajectories, nonstationary induced laws, path-dependent effects, and feedback mediated by dynamics, all challenging in standard causal models. We introduce Hamilto...
108. Signed Dual Attention: Capturing Signed Dependencies in Time Series Forecasting
Author: Balthazar Courvoisier, Tristan Cazenave
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04833v1 Announce Type: new Abstract: Initially developed for natural language processing, Transformer architectures and attention mechanisms are now central to a wide range of deep learning models, including applications in time series forecasting. A standard attention mechanism, however,...
109. Prediction Under Imperfect Compression: A Theory of Approximate MDL
Author: Qian Li, Xinyu Mao, Shang-Hua Teng, Guangxu Yang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.04834v1 Announce Type: new Abstract: Minimum Description Length (MDL) formalizes the principle of Occam's razor by optimizing the total description length: $L(\mathrm{model})+L(\mathrm{data} \ | \ \mathrm{model})$. For sequential prediction, the MDL method repeatedly selects a model with ...
110. Uncertainty-Aware End-to-End Co-Design of Neural Network Processors: From Training and Mapping to Fabrication
Author: Yuyang Du, Yujun Huang, Gioele Zardini
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.AR, math.OC
arXiv:2606.04850v1 Announce Type: new Abstract: Designing a neural network processor is an end-to-end co-design problem: network architecture and training budget determine the inference workload; hardware mapping decisions determine chip area, latency, and energy; and these characteristics govern fa...
111. Rethinking Incompleteness: Formalizing Protocol Divergence and Train-Once Learning for Robust IMVC
Author: Haolu Liu, Xiyue Wang, Xuanting Xie, Liangjian Wen, Zhao Kang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.04857v1 Announce Type: new Abstract: Standard IMVC evaluation retrains separate models for different missing-data configurations. We show that this paradigm obscures a fundamental vulnerability: missing rate alone is insufficient to characterize data incompleteness. Specifically, we show ...
112. Learning Empirically Admissible Neural Heuristics for Combinatorial Search
Author: Siddharth Sahay
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.04860v1 Announce Type: new Abstract: Finding optimal solution paths for combinatorial puzzles like the Rubik's Cube, sliding tile puzzles, and Lights Out remains a classical challenge in artificial intelligence. Heuristic search algorithms, such as A* , guarantee path optimality only when...
113. Provably Reduced Sample Cost in Prior-Guided Hyperparameter Optimization
Author: Leona Hennig, Jasmin Brandt, Lukas Fehring, Barbara Hammer, Marius Lindauer, Marcel Wever
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.04866v1 Announce Type: new Abstract: Large-scale hyperparameter optimization (HPO) in automated machine learning (AutoML) consumes substantial computational resources, raising growing concerns about scalability and energy efficiency. Existing methods use prior information heuristically to...
114. Towards Pretraining Text Encoders for TabPFN
Author: Mustafa Tajjar, Alexander Pfefferle, Lennart Purucker, Frank Hutter
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.04876v1 Announce Type: new Abstract: Tabular foundation models, such as TabPFN, achieve strong performance on tabular datasets with numerical and categorical data, but do not natively handle high-cardinality text features. Standard pipelines, therefore, embed text with a language model an...
115. Worker Utility as Hysteresis: A Preisach Model of Transaction Acceptance in Gig Labour Markets
Author: Piotr Frydrych
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, econ.GN, q-fin.EC, stat.ML
arXiv:2606.04916v1 Announce Type: new Abstract: Worker utility is not observed -- only its consequence is. Each gig transaction produces a single bit: accepted or rejected. We argue this structure points directly to the Preisach hysteresis model as the natural representation of latent worker prefere...
116. Toward Multi-Domain and Long-Tailed Quantization via Feature Alignment and Scaling
Author: Chin-Yuan Yeh, Ting-An Chen, De-Nian Yang, Ming-Syan Chen
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.CV
arXiv:2606.04920v1 Announce Type: new Abstract: Quantizing deep neural networks is essential for efficient inference on resource-constrained devices. However, most existing methods are designed for single-domain and class-balanced data, leaving practical settings with domain shifts or severe class i...
117. Reproducing, Analyzing, and Detecting Reward Hacking in Rubric-Based Reinforcement Learning
Author: Xuekang Wang, Zhuoyuan Hao, Shuo Hou, Hao Peng, Juanzi Li, Xiaozhi Wang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL
arXiv:2606.04923v1 Announce Type: new Abstract: Rubric-based reinforcement learning (RL) uses an LLM-as-a-Judge (LaaJ) to score model outputs according to rubrics as rewards. However, policy models may exploit latent biases in the judge, leading to reward hacking and ineffective or unsafe training o...
118. Data Attribution in Large Language Models via Bidirectional Gradient Optimization
Author: Fr'ed'eric Berdoz, Luca A. Lanzend"orfer, Kaan Bayraktar, Roger Wattenhofer
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.CL
arXiv:2606.04928v1 Announce Type: new Abstract: Large Language Models (LLMs) are increasingly deployed across diverse applications, raising critical questions for governance, accountability, and data provenance. Understanding which training data most influenced a model's output remains a fundamental...
119. Sequential Data Poisoning in LLM Post-Training
Author: Jack Sanderson, Yihan Wang, Xiaoqian Lu, Gautam Kamath, Yiwei Lu
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.CR
arXiv:2606.04929v1 Announce Type: new Abstract: LLM post-training proceeds through multiple stages, e.g., supervised fine-tuning (SFT) followed by reinforcement learning from human feedback (RLHF) or direct preference optimization (DPO), where each stage draws data from different, potentially untrus...
120. AdaKoop: Efficient Modeling of Nonlinear Dynamics from Nonstationary Data Streams with Koopman Operator Regression
Author: Naoki Chihara, Ren Fujiwara, Yasuko Matsubara, Yasushi Sakurai
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, stat.ML
arXiv:2606.04930v1 Announce Type: new Abstract: Real-time data analysis requires the ability to accurately and adaptively address nonlinear dynamics in a nonstationary data stream while preserving computational efficiency. However, nonlinear dynamics are so complex that capturing dynamically changin...
121. Mean-based algorithms: A lower bound and regret
Author: Julius Durmann, Amelie Kleber
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.GT
arXiv:2606.04931v1 Announce Type: new Abstract: Mean-based algorithms are a class of online learning algorithms that assign low probability to actions with low average rewards. Recent work indicates these algorithms converge favorably to serially undominated actions, which approximate Nash equilibri...
122. STaR-Quant: State-Time Consistent Post-Training Quantization for Diffusion Large Language Models
Author: Xin Yan, Aqiang Wang, Zhenglin Wan, Xingrui Yuand Ivor Tsang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.04945v1 Announce Type: new Abstract: Diffusion large language models (DLLMs) have recently emerged as a promising alternative to autoregressive LLMs by generating text through iterative masked denoising with bidirectional context. However, their large model sizes and iterative denoising p...
123. Be Fair! Can Machine Learning Engineering Agents Adhere to Fairness Constraints?
Author: Anna Richter, Julia Stoyanovich, Sebastian Schelter
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.DB
arXiv:2606.04971v1 Announce Type: new Abstract: Machine learning engineering (MLE) agents promise to automate end-to-end ML pipeline development from raw data and natural language instructions, potentially making ML accessible to non-technical domain experts. However, in sensitive and regulated doma...
124. AlphaQ: Calibration-Free Bit Allocation for Mixture-of-Experts Quantization
Author: Wanqi Yang, Yuexiao Ma, Alexander Conzelmann, Xiawu Zheng, Michael W. Mahoney, T. Konstantin Rusch, Shiwei Liu
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.04980v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) architectures scale model capacity through sparse expert activation, but their deployment remains memory-bound because all expert weights must reside in memory. Mixed-precision quantization can substantially reduce this footpri...
125. New Benchmarking Shows Limited Generalization Power of TCR Antigenic Epitope Prediction Models
Author: Yiming Liao, Yiheng Li, Ning Jiang, Bo Li, Keke Chen
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, q-bio.QM
arXiv:2606.04994v1 Announce Type: new Abstract: Accurate computational prediction of T cell receptor (TCR) antigen specificity would transform the study of T cell biology and enable scalable immune engineering, yet existing models lack sufficient sensitivity and specificity for broad applications. A...
126. Enhancing the MADDPG Algorithm for Multi-Agent Learning via Action Inference and Importance Sampling
Author: Marc Walden, Jason Liu, Shaashwath Sivakumar, Ryan Liu, Hamza Khan
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.05021v1 Announce Type: new Abstract: We investigate multi-agent deep reinforcement learning and propose two enhancements to the Multi-Agent Deep Deterministic Policy Gradient (MADDPG) algorithm. First, we introduce a novel Action Inference mechanism that enables each agent to predict othe...
127. Invariant Gradient Alignment for Robust Reasoning Distillation
Author: Zehua Cheng, Wei Dai, Jiahao Sun
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.05025v1 Announce Type: new Abstract: Large language models (LLMs) suffer from shortcut learning: they systematically fail on out-of-distribution (OOD) inputs whose semantic surface differs from training data, even when the logical structure is identical. This undermines knowledge distilla...
128. Validity Threats for Foundation Model Research
Author: Gunnar K"onig, Martin Pawelczyk, Ulrike von Luxburg, Sebastian Bordt
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.CL
arXiv:2606.05029v1 Announce Type: new Abstract: Controlled experiments are the backbone of machine learning research, but at the scale of modern foundation models, they have become prohibitively expensive. Instead, the community increasingly relies on research strategies that approximate the ideal e...
129. In-Context Graphical Inference
Author: Zehua Cheng, Wei Dai, Jiahao Sun
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.CL, cs.SC
arXiv:2606.05042v1 Announce Type: new Abstract: Marginal inference in discrete graphical models forces a choice between exactness and scalability: exact algorithms are intractable for high-treewidth graphs, while iterative approximations (Belief Propagation, variational methods) sacrifice convergenc...
130. Graph Cascades: Contagion-Based Mesoscopic Rewiring for Structure-Aware Graph Machine Learning
Author: Meher Chaitanya, My Le, Luana Ruiz
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2606.05046v1 Announce Type: new Abstract: We introduce Graph Cascades, a mesoscopic rewiring strategy for Graph Neural Networks (GNNs) and Graph Transformers (GTs) that captures intermediate-scale graph structure beyond purely local edges or fully global attention. Using contagion-based diffus...
131. FLAGG: Flexible Autoregressive Graph Generation
Author: Samuel Cognolato, Alessandro Sperduti, Luciano Serafini
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.05067v1 Announce Type: new Abstract: The Deep Graph Generation's panorama spans two extremes: one-shot and sequential models. The former generates nodes and edges jointly, while the latter samples them autoregressively. Each method performs better in different graph domains depending on s...
132. RIDE: An Open Dataset and Benchmark for Train Delay Prediction
Author: Cl'ement Elliker, Mathis Le Bail, Cl'ement Mantoux, Jesse Read, Sonia Vanier
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.05070v1 Announce Type: new Abstract: Train delay prediction is an important problem for both passengers and railway operators, yet progress in the field remains difficult to assess due to the lack of standardized datasets, prediction targets, and evaluation protocols. To address this gap,...
133. Learning What Not to Impute: An Uncertainty-Aware Diffusion Framework for Meaningful Missingness
Author: Lixing Zhang, Yidong Ouyang, Weifu Li, Shixiang Zhu, Guang Cheng, Liyan Xie
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.05073v1 Announce Type: new Abstract: Missing value imputation is a fundamental task in machine learning, with most existing methods assuming that all missing entries correspond to unobserved regular values. In many real-world datasets, however, missingness may arise from two distinct sour...
134. Identifying Gems from Roman RAPIDly
Author: Karan Gandhi, Ashish A. Mahabal, Jacob E. Jencson, Russ R. Laher, Ben Rusholme, Lin Yan, Ryan M. Lau, Schuyler D. Van Dyk, Mansi M. Kasliwal
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, astro-ph.IM, cs.CV, stat.ML
arXiv:2606.05103v1 Announce Type: new Abstract: The Nancy Grace Roman Space Telescope (Roman), set for launch as early as September 2026, will conduct wide-field infrared imaging surveys with unprecedented spatial resolution and cadence, enabling the discovery of millions of astronomical transients....
135. RePercENT: Scaling Disentangled Representation Learning Beyond Two Modalities
Author: Vasiliki Rizou, Pascal Frossard, Dorina Thanou
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.05109v1 Announce Type: new Abstract: To leverage the full potential of multimodal data, we need representations that go beyond the state-of-the-art alignment and fusion approaches and exploit all cross-modal interactions without sacrificing modality-specific information. Learning disentan...
136. Graph Set Transformer
Author: Jose E. Escrig Molina, Baoquan Chen, Daniel Probst
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.05116v1 Announce Type: new Abstract: We introduce the Graph Set Transformer (GST), a neural network architecture for learning on sets of graphs, designed for tasks in which per-element predictions depend on set-wide context as well as local structure. Existing architectures, including Dee...
137. Towards Efficient and Evidence-grounded Mobility Prediction with LLM-Driven Agent
Author: Linyao Chen, Qinlao Zhao, Zechen Li, Mingming Li, Likun Ni, Jinyu Chen, Yuhao Yao, Xuan Song, Noboru Koshizuka, Hiroki Kobayashi
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.05130v1 Announce Type: new Abstract: Individual-level mobility prediction is central to urban simulation, transportation planning, and policy analysis. Supervised sequence models achieve strong accuracy but require task-specific training and offer limited decision-level transparency. Rece...
138. Deep Embedded Multiplicative DMD for Algebra-Preserving Koopman Learning
Author: Kelan Gray, Finlay Brown, Nicolas Boull'e, Matthew J. Colbrook
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.NA, math.DS, math.NA, math.OC, math.SP
arXiv:2606.05131v1 Announce Type: new Abstract: Koopman theory turns nonlinear dynamics into a linear spectral problem. In computation, however, everything depends on a hard finite-dimensional choice: the observables must be expressive, nearly invariant under the dynamics, and, ideally, compatible w...
139. Generating Financial Time Series by Matching Random Convolutional Features
Author: Konrad J. Mueller, Nikita Zozoulenko, Ben Wood, Thomas Cass, Lukas Gonon
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, q-fin.ST
arXiv:2606.05138v1 Announce Type: new Abstract: Generating realistic financial time series is challenging as training data is often limited to a single historical path. With such scarce data, overfitting is hard to avoid, especially under adversarial training where a trained discriminator can memori...
140. BBOmix: A Tabular Benchmark for Hyperparameter Optimization of Unsupervised Biological Representation Learning
Author: Luca Thale-Bombien, Jan Ewald, Ralf K"onig, Aaron Klein
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.05139v1 Announce Type: new Abstract: The rapid advancement of high-throughput sequencing has led to large, high-dimensional omics datasets. Deep unsupervised learning architectures, particularly Autoencoders (AEs), are increasingly used for dimensionality reduction and representation lear...
141. Failed Reasoning Traces Tell You What Is Fixable (But Not by Reading Them)
Author: Nizar Islah, Istabrak Abbes, Irina Rish, Sarath Chandar, Eilif B. Muller
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL
arXiv:2606.05145v1 Announce Type: new Abstract: When post-trained language models fail on reasoning problems, the common test-time-scaling response is to spend more compute on additional attempts, and the failed traces play no further role. We argue this discards a crucial signal; some failures come...
142. Reinforcement Learning from Rich Feedback with Distributional DAgger
Author: Rishabh Agrawal, Jacob Fein-Ashley, Paria Rashidinejad
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL
arXiv:2606.05152v1 Announce Type: new Abstract: Reasoning models have advanced rapidly, but the dominant reinforcement learning from verifiable rewards (RLVR) recipe remains surprisingly narrow: sample many responses and reward each with a single bit indicating whether the final answer is correct. Y...
143. STRIDE: Training Data Attribution via Sparse Recovery from Subset Perturbations
Author: Rishit Dagli, Abir Harrasse, Luke Zhang, Florent Draye, Amirali Abdullah, Bernhard Sch"olkopf, Zhijing Jin
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.CL
arXiv:2606.05165v1 Announce Type: new Abstract: Training Data Attribution (TDA) seeks to trace a model's predictions back to its training data. The gold standard for TDA relies on causal interventions, observing how a model changes when data is added or removed, but repeated retraining is computatio...
144. AI from concrete to abstract: demystifying artificial intelligence to the general public
Author: Rubens Lacerda Queiroz, F'abio Ferrentini Sampaio, Cabral Lima, Priscila Machado Vieira Lima
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CY, cs.AI, cs.LG
arXiv:2006.04013v6 Announce Type: cross Abstract: Artificial Intelligence (AI) has been adopted in a wide range of domains. This shows the imperative need to develop means to endow common people with a minimum understanding of what AI means. Combining visual programming and WiSARD weightless artific...
145. How do machines learn? Evaluating the AIcon2abs method
Author: Rubens Lacerda Queiroz, Cabral Lima, Fabio Ferrentini Sampaio, Priscila Machado Vieira Lima
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CY, cs.AI, cs.LG
arXiv:2401.07386v5 Announce Type: cross Abstract: This study expands on previous work that introduced the AIcon2abs method (AI from Concrete to Abstract: Demystifying Artificial Intelligence to the general public), an innovative approach designed to increase public understanding of machine learning ...
146. SpurAudio: A Benchmark for Studying Shortcut Learning in Few-Shot Audio Classification
Author: Giries Abu Ayoub, Morad Tukan, Loay Mualem
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CV, cs.AI, cs.LG
arXiv:2605.13672v1 Announce Type: cross Abstract: Few-shot classification (FSC) is widely used for learning from limited labeled data, yet most evaluations implicitly assume that target concepts are independent of contextual cues. In real-world settings, however, examples often appear within rich co...
147. PointAction: 3D Points as Universal Action Representations for Robot Control
Author: Mutian Tong, Han Jiang, Qiao Feng, Lingjie Liu, Jiatao Gu
Published: 6/5/2026, 4:00:00 AM
Categories: cs.RO, cs.CV, cs.LG
arXiv:2606.03943v1 Announce Type: cross Abstract: Video-Action Models (VAMs) leverage the broad visual dynamics captured by pre-trained video diffusion models, offering a promising path toward generalizable robot manipulation. However, RGB-only video rollouts are not directly actionable: they leave ...
148. SPLIT-PINN: Separable Probability Learning Technique via Physics-Informed Neural Networks for High-Dimensional Probabilistic Modeling
Author: Pouria Behnoudfar, Deekshith Naidu Ponnana, Noah J. Schmelzer, Janith Wanni, George T. Gray III, Dan J. Thoma, Curt A. Bronkhorst, Nan Chen, Wenxiao Pan
Published: 6/5/2026, 4:00:00 AM
Categories: cond-mat.mtrl-sci, cs.LG
arXiv:2606.04000v1 Announce Type: cross Abstract: We present a probabilistic modeling framework for incorporating small-scale spatial heterogeneity into macroscopic descriptions of material behavior for polycrystalline metallic materials. Spatially heterogeneous material state fields are represented...
149. Counterfactual Explanations for Deep Two-Sample Testing
Author: Wei-Cheng Lai, Marco Simnacher, Christoph Lippert
Published: 6/5/2026, 4:00:00 AM
Categories: stat.ML, cs.AI, cs.LG
arXiv:2606.04009v1 Announce Type: cross Abstract: Two-sample testing is a fundamental tool for detecting distributional differences across scientific domains, but classical tests (including kernel-based tests) can be ineffective on high-dimensional structured data such as images. Recent deep two-sam...
150. SpliceBind: Isoform-Aware Prediction of Binding Pocket Druggability
Author: Bryan Cheng, Austin Jin, Joshua Chang
Published: 6/5/2026, 4:00:00 AM
Categories: q-bio.QM, cs.LG
arXiv:2606.04020v1 Announce Type: cross Abstract: Splice-mediated drug resistance occurs in up to 40% of patients on targeted kinase inhibitors, yet state-of-the-art druggability tools operate on single structures and cannot compare across isoforms. We introduce SpliceBind, a graph neural network fr...
151. Structure-Aware Prediction of PROTAC-Mediated Protein Degradability via Graph Neural Networks
Author: Bryan Cheng, Austin Jin
Published: 6/5/2026, 4:00:00 AM
Categories: q-bio.QM, cs.LG
arXiv:2606.04021v1 Announce Type: cross Abstract: Proteolysis-targeting chimeras (PROTACs) can selectively degrade disease-causing proteins, yet predicting which targets are amenable to degradation remains a critical bottleneck: existing computational methods require the complete PROTAC molecular st...
152. Unpredictable Safety: Domain-Dependent Compliance and the Transparency Gap in Open-Weight LLMs
Author: Zacharie Bugaud
Published: 6/5/2026, 4:00:00 AM
Categories: cs.SE, cs.AI, cs.LG
arXiv:2606.04035v1 Announce Type: cross Abstract: We present a systematic study of domain-dependent safety behavior in open-weight LLMs: 7 standardized experiments across 7 ethical domains, testing 5 models (12B--70B) in 4,200 interactions with dual-judge validation. Using a dual-condition methodolo...
153. Toward Pre-Deployment Assurance for Enterprise AI Agents: Ontology-Grounded Simulation and Trust Certification
Author: Thanh Luong Tuan, Abhijit Sanyal
Published: 6/5/2026, 4:00:00 AM
Categories: cs.AI, cs.LG, cs.SE
arXiv:2606.04037v2 Announce Type: cross Abstract: Pre-deployment verification of enterprise artificial intelligence (AI) agents remains a critical gap between large language model (LLM) capability benchmarking and production deployment. Post-deployment monitoring, human-in-the-loop controls, and pro...
154. Beyond Static Priors: Dynamic Neural Guidance for Large-Scale Ant Colony Optimization
Author: Dat Thanh Tran, Van Khu Vu, Yining Ma
Published: 6/5/2026, 4:00:00 AM
Categories: cs.NE, cs.AI, cs.LG
arXiv:2606.04039v1 Announce Type: cross Abstract: Neural-guided Ant Colony Optimization (ACO) suffers from a fundamental training-inference misalignment: policies are typically trained to generate static priors (e.g., heatmaps), yet deployed to guide iterative, long-horizon search processes. In this...
155. Dive into the Scene: Breaking the Perceptual Bottleneck in Vision-Language Decision Making via Focus Plan Generation
Author: Boyuan Xiao, Bohong Chen, Yumeng Li, Ji Feng, Yao-Xiang Ding, Kun Zhou
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CV, cs.AI, cs.CL, cs.LG, cs.RO
arXiv:2606.04046v1 Announce Type: cross Abstract: In embodied vision-language decision making tasks such as robotic manipulation and navigation, Vision-Language and Vision-Language-Action Models (VLMs & VLAs) are powerful tools with different benefits: VLMs are better at long-term planning, while VL...
156. The Invisible Lottery: How Subtle Cues Steer Algorithm Choice in LLM Code Generation
Author: Akanksha Narula, Mofasshara Binte Rafique, Laurent Bindschaedler
Published: 6/5/2026, 4:00:00 AM
Categories: cs.SE, cs.AI, cs.LG
arXiv:2606.04057v1 Announce Type: cross Abstract: Large language models (LLMs) now generate substantial production code, often for tasks with multiple valid algorithmic solutions. Incidental prompt cues, meaning contextual words or metadata outside the task specification, can steer which algorithm t...
157. Finite-Iteration Local Dynamics and Warm Starts for Alternating Power Iteration in Spiked Tensor PCA
Author: Yanjin Xiang, Zhihua Zhang
Published: 6/5/2026, 4:00:00 AM
Categories: stat.ML, cs.LG, math.ST, stat.TH
arXiv:2606.04065v1 Announce Type: cross Abstract: We study simultaneous alternating power iteration for fixed-order asymmetric rank-one spiked tensor models. Our main contribution is a finite-iteration local theory that is independent of any particular initialization. Once the iterates enter a suffi...
158. SC-TauPath: A Structural Connectivity Attribution Framework for Mapping Tau Propagation Pathways in Alzheimer's Disease
Author: Jing Zhang, Norman Scheel, Minheng Chen, Tong Chen, Yanjun Lyu, David C. Zhu, Rong Zhang, Dajiang Zhu
Published: 6/5/2026, 4:00:00 AM
Categories: q-bio.NC, cs.LG
arXiv:2606.04066v1 Announce Type: cross Abstract: Understanding how structural connections are associated with tau propagation in Alzheimer's disease (AD) remains a central open question, yet existing computational models either rely heavily on biophysical assumptions or lack neurobiologically inter...
159. Bayesian Membership Privacy for Graph Neural Networks
Author: Sinan Y{\i}ld{\i}r{\i}m, Megha Khosla
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CR, cs.LG
arXiv:2606.04069v1 Announce Type: cross Abstract: Existing privacy analyses for Graph Neural Networks (GNNs) largely inherit assumptions from non-graph settings, overlooking structural correlations and stochastic training-graph sampling. In particular, node-dependent priors make type-I and type-II e...
160. Covert Influence Between Language Models
Author: Avidan Shah, Jay Chooi, Jinghua Ou, Shi Feng
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CR, cs.CL, cs.LG
arXiv:2606.04071v1 Announce Type: cross Abstract: As language models increasingly consume one another's outputs, covert influence -- a phenomenon where a sender's payload (the behavioral disposition it is conditioned to propagate) transfers to a receiver through carriers undetectable by humans -- be...
161. CADET: A Modular Platform for Evaluating Distributed Cooperative Autonomy in Connected Autonomous Vehicles
Author: Pragya Sharma, Brian Wang, Mani Srivastava
Published: 6/5/2026, 4:00:00 AM
Categories: cs.RO, cs.DC, cs.LG, cs.SY, eess.SY
arXiv:2606.04072v1 Announce Type: cross Abstract: Deep learning models are increasingly central to autonomous vehicle (AV) pipelines, yet their integration has traditionally followed a monolithic design where perception, planning, and control execute on a single onboard computer. This design overloo...
162. Optimal Transport Flow Matching by Design
Author: Shimon Malnick, Matan Rusanovsky, Ohad Fried, Shai Avidan
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2606.04092v1 Announce Type: cross Abstract: Flow matching models learn to transport samples from a simple prior distribution to a complex data distribution. When prior-data pairs are coupled via optimal transport (OT), the learned trajectories are straight and non-crossing, enabling fast, even...
163. UltraEP: Unleash MoE Training and Inference on Rack-Scale Nodes with Near-Optimal Load Balancing
Author: Xinming Wei, Chao Jin, Tuo Dai, Yinmin Zhong, Shan Yu, Chengxu Yang, Bingyang Wu, Zili Zhang, Jing Mai, Qianchao Zhu, Zhouyang Li, Yuliang Liu, Guojie Luo
Published: 6/5/2026, 4:00:00 AM
Categories: cs.DC, cs.LG
arXiv:2606.04101v1 Announce Type: cross Abstract: Large-scale expert parallelism (EP) is becoming pivotal for training and serving frontier MoE models, but it also amplifies device-level expert load imbalance into compute stragglers, token all-to-all bottlenecks, and activation-memory spikes. Existi...
164. The Differentiable Auditory Loop (DAL): An ML Framework for Hyper-Personalized Hearing Aids
Author: Alejandro Ballesta Rosen, Jason Mikiel-Hunter, Julian Maclaren, Jack Collins, Richard F. Lyon, Simon Carlile
Published: 6/5/2026, 4:00:00 AM
Categories: cs.SD, cs.AI, cs.LG, eess.AS
arXiv:2606.04103v1 Announce Type: cross Abstract: Conventional hearing aids rely on fixed, frequency-dependent amplification and compression to manage reduced sensitivity, which often fails to provide sufficient listening support in complex environments, such as situations with multiple speakers (th...
165. SymTRELLIS: Symmetry-Enforced Voxel Latents for 3D Generation
Author: Guangda Ji, Qimin Chen, Qinchan Li, Mingrui Zhao, Kai Wang, Hao Zhang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.GR, cs.AI, cs.CV, cs.LG
arXiv:2606.04108v1 Announce Type: cross Abstract: Single-view 3D generative models have achieved impressive visual quality, yet they are not designed to satisfy structural or functional requirements, and in practice, often fall short. Symmetry is one such requirement: violations, even subtle ones, o...
166. veriFIRE: an Industrial Case Study in Verifying Consistency Properties for a DNN-Based Wildfire Detection System
Author: Idan Refaeli, Maya Swisa, Itay Buchnik, Alon Zada, Guy Amir, Elad Mandelbaum, Ziv Freund, Guy Katz
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LO, cs.LG, cs.SE
arXiv:2606.04121v1 Announce Type: cross Abstract: We present our ongoing work on the veriFIRE project: a collaboration between industry and academia, aimed at applying verification to increase the reliability of a real-world, safety-critical system. Specifically, we target an airborne platform for w...
167. EpiFormer: Learning Antigen-Antibody Interactions for Epitope Prediction via Geometric Deep Learning
Author: Mansoor Ahmed, Huirong Chai, Haoxin Wang, Hemanth Venkateswara, Murray Patterson
Published: 6/5/2026, 4:00:00 AM
Categories: q-bio.QM, cs.LG
arXiv:2606.04154v1 Announce Type: cross Abstract: Antibodies neutralize foreign antigens by binding to specific surface regions called epitopes. Computational epitope prediction is critical for understanding immune recognition and guiding antibody engineering. However, existing methods face three fu...
168. Expert-Aware Refusal Steering
Author: Anna C. Marbut, Daniel R. Olson, Travis J. Wheeler
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CL, cs.LG
arXiv:2606.04160v1 Announce Type: cross Abstract: Safety alignment in instruction-tuned large language models (LLMs) depends on a model's ability to reliably refuse to respond to harmful or disallowed requests. Recent work has shown that a steering vector can be applied to a dense LLM during inferen...
169. CaloTrilogy: Toward a Breakthrough in One-Step, End-to-End, Physics-Guided Shower Generation for Modern Calorimeters
Author: Cheng Jiang, Sitian Qian, Kevin Pedro, Oz Amram, Huilin Qu, Maggie Voetberg
Published: 6/5/2026, 4:00:00 AM
Categories: hep-ex, cs.LG, hep-ph, physics.ins-det
arXiv:2606.04165v1 Announce Type: cross Abstract: High-precision calorimeter simulation at current and future colliders imposes rapidly growing computational demands, motivating the development of machine-learning surrogates for traditional Monte Carlo tools such as Geant4. Flow matching and diffusi...
170. MimeLens: Position-Agnostic Content-Type Detection for Binary Fragments
Author: Michael J. Bommarito II
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CR, cs.AI, cs.LG
arXiv:2606.04171v1 Announce Type: cross Abstract: File-type classification underlies many workflows like malware triage, forensic carving, packet inspection, and storage indexing. Learned systems such as Google's Magika assume whole-file access at a known offset, so they break on the inputs many of ...
171. Cross-Prompt Generalization in Detecting AI-Generated Fake News Using Interpretable Linguistic Features
Author: Aya Vera-Jimenez, Samuel Jaeger, Calvin Ibenye, Dhrubajyoti Ghosh
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CL, cs.LG
arXiv:2606.04199v1 Announce Type: cross Abstract: The increasing use of large language models has raised concerns about the spread of AI-generated fake news, particularly under varying prompting strategies. Most existing detection models are trained and evaluated under a single generation setting, l...
172. DetectZoo: A Unified Toolkit for AI-Generated Content Detection Across Text, Audio, and Image Modalities
Author: Sajad Ebrahimi, Nima Jamali, Bardia Shirsalimian, Kelly McConvey, Wentao Zhang, Jalehsadat Mahdavimoghaddam, Maksym Taranukhin, Maura Grossman, Vered Shwartz, Yuntian Deng, Ebrahim Bagheri
Published: 6/5/2026, 4:00:00 AM
Categories: cs.MM, cs.AI, cs.CL, cs.CV, cs.LG, cs.SD
arXiv:2606.04205v1 Announce Type: cross Abstract: The growing popularity and capacity of generative models have eroded the distinction between human and machine-generated content, motivating a growing body of work on detection across text, images, and audio. Most available detectors are either comme...
173. Representation Matters in Randomized Smoothing for Audio Classification
Author: Jong-Ik Park, Shreyas Chaudhari, Jos'e M. F. Moura, Carlee Joe-Wong
Published: 6/5/2026, 4:00:00 AM
Categories: eess.AS, cs.LG, cs.SD
arXiv:2606.04210v1 Announce Type: cross Abstract: Randomized smoothing (RS) certifies robustness in the vector space where Gaussian noise is added. In audio classification, this space is often not uniquely defined as standard pipelines normalize, range-control, and transform waveforms into log-mel o...
174. Supportive Token Revealing for Fast Diffusion Language Model Decoding
Author: Giries Abu Ayoub, Mario Barbara, Llu'is Pastor-P'erez, Tanja Bien, Aneesh Barthakur, Alaa Maalouf, Loay Mualem
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG
arXiv:2606.04236v1 Announce Type: cross Abstract: Discrete diffusion language models can generate text efficiently by updating multiple masked positions in parallel, but this parallelism introduces a quality-latency trade-off. Aggressive decoding may commit mutually dependent tokens too early, while...
175. VAMPS: Visual-Assisted Mathematical Problem Solving Benchmark
Author: Amirhossein Dabiriaghdam, Shayan Vassef, Mohammadreza Bakhtiari, Yasamin Medghalchi, Ilker Hacihaliloglu, Mesrob Ohannessian, Lele Wang, Giuseppe Carenini
Published: 6/5/2026, 4:00:00 AM
Categories: cs.AI, cs.CL, cs.CV, cs.LG
arXiv:2606.04244v1 Announce Type: cross Abstract: Multimodal large language models are increasingly capable of complex reasoning, yet their performance often degrades when they must externalize a problem through a tool and then reason over the tool's output, specifically when they rely on visual aid...
176. Can Generalist Agents Automate Data Curation?
Author: Feiyang Kang, Hanze Li, Adam Nguyen, Mahavir Dabas, Jiaqi W. Ma, Frederic Sala, Dawn Song, Ruoxi Jia
Published: 6/5/2026, 4:00:00 AM
Categories: cs.AI, cs.CL, cs.CV, cs.ET, cs.LG
arXiv:2606.04261v1 Announce Type: cross Abstract: Curating training data is among the most consequential yet labor-intensive parts of modern AI development: practitioners iteratively propose, implement, evaluate, and revise data policies against noisy benchmark feedback. We ask whether generalist co...
177. Nonlocal Mean Field Schr\"{o}dinger Bridge with Learned Interactions
Author: Daisuke Inoue, Mathieu Lauri`ere, Dante Kalise
Published: 6/5/2026, 4:00:00 AM
Categories: math.OC, cs.LG, cs.NA, math.NA
arXiv:2606.04265v1 Announce Type: cross Abstract: The Schr"odinger Bridge Problem constructs a stochastic process that connects an initial distribution to a terminal distribution with minimum energy. This work considers its mean-field extension, the Mean-Field Schr"odinger Bridge, for interacting ...
178. Long-Term and Short-Term Transistor Aging in Deep Neural Networks: Impact and Mitigation
Author: Alireza Sarmadi, Virinchi Roy Surabhi, Prashanth Krishnamurthy, Hussam Amrouch, Ramesh Karri, Farshad Khorrami
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CR, cs.LG
arXiv:2606.04266v1 Announce Type: cross Abstract: Deep neural networks (DNNs) are used in a variety of real-world applications including, for example, image classification and speech recognition. The inference accuracy of DNN implemented on hardware in integrated circuits (ICs) degrades under phenom...
179. Efficient and Training-Free Single-Image Diffusion Models
Author: Haojun Qiu, Kiriakos N. Kutulakos, David B. Lindell
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2606.04299v1 Announce Type: cross Abstract: We consider the problem of generating images whose internal structure -- defined by the distribution of patches across multiple scales -- matches that of a single reference image. Recent approaches address this problem by training a diffusion model o...
180. LazyAttention: Efficient Retrieval-Augmented Generation with Deferred Positional Encoding
Author: Haocheng Xia, Mihir Pamnani, Hanxi Fang, Supawit Chockchowwat, Yongjoo Park
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CL, cs.LG
arXiv:2606.04302v1 Announce Type: cross Abstract: Key-value (KV) caching accelerates inference of large language models (LLMs) by reusing past computations for generated tokens. Its importance becomes even greater in long-context applications such as retrieval-augmented generation (RAG) and in-conte...
181. Toward a Generalized Defense Across Sparse, Continuous, and Structured Parameter Attacks
Author: Bin Duan, Zeyu Bai, Guowei Yang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CR, cs.LG, cs.SE
arXiv:2606.04317v1 Announce Type: cross Abstract: Deep neural networks are increasingly deployed across heterogeneous and partially untrusted environments, where models are distributed through cloud storage, CI/CD pipelines, containerized services, and edge execution platforms. This broad deployment...
182. HYolo: An Intelligent IoT-Based Object Detection System Using Hypergraph Learning
Author: Isha Abid, Fawad Khan, Muhammad Khuram Shahzad
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CV, cs.AI, cs.LG
arXiv:2606.04345v1 Announce Type: cross Abstract: This paper presents HYolo, an intelligent IoT-based object detection framework that integrates hypergraph learning into the YOLO architecture. Traditional YOLO-based object detection models primarily capture pairwise feature interactions and may fail...
183. Deliberate Evolution: Agentic Reasoning for Sample-Efficient Symbolic Regression with LLMs
Author: Xinyu Pang, Zhanke Zhou, Xuan Li, Fangrui Lv, Shanshan Wei, Sen Cui, Bo Han, Changshui Zhang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CL, cs.LG
arXiv:2606.04360v1 Announce Type: cross Abstract: Symbolic regression (SR) discovers compact mathematical expressions from data, yet recent LLM-based evolutionary methods remain sample-inefficient because they rely mainly on scalar feedback such as MSE. We identify a core limitation: existing method...
184. Spatially Grounded Concept Bottleneck Models via Part-Factorized Attention
Author: Dhanesh Ramachandram
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2606.04364v1 Announce Type: cross Abstract: Concept bottleneck models (CBMs) predict a layer of human-named attributes before predicting a class, which makes their decisions auditable. On fine-grained recognition tasks the concept heads are usually free to attend anywhere in the image, so a he...
185. REGAIN: REconciliation GAIN-driven Auxiliary Direction Learning
Author: Weijia Li, Shun Hu, Yanfei Kang
Published: 6/5/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:2606.04380v1 Announce Type: cross Abstract: Forecast reconciliation usually starts from a fixed measurement system and asks how forecasts should be projected onto a coherent space. We ask a different question: which additional linear measurements should be forecast and included in the reconcil...
186. TITAN-FedAnil+: Trust-Based Adaptive Blockchain Federated Learning for Resource-Constrained Intelligent Enterprises
Author: Muhammad Hadi, Muhammad Jahangir, Talha Shafique, Muhammad Khuram Shahzad
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CR, cs.AI, cs.LG
arXiv:2606.04388v1 Announce Type: cross Abstract: Federated Learning (FL) has emerged as an effective paradigm for collaborative intelligence while preserving data privacy. However, data heterogeneity arising from non-IID distributions and decentralized security threats remain significant challenges...
187. Knockoffs-based False Discovery Rate Control and Simplification for Deep Neural Networks
Author: Huiqi Zhang, Wenyu Liao, Yiqing Shi, Xiaobo Huang, Fang Xie
Published: 6/5/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:2606.04404v1 Announce Type: cross Abstract: The deep neural network is a widely used framework in machine learning that has been widely applied in various fields. However, deep neural networks often involve a large number of parameters and inputs, many of which may be irrelevant to the goal or...
188. An Empirical Study of Data Scale, Model Complexity, and Input Modalities in Visual Generalization
Author: Luoyidi Zhou
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CV, cs.AI, cs.LG
arXiv:2606.04409v1 Announce Type: cross Abstract: Modern deep neural networks usually have large parameter scales and nonlinear hierarchical structures, and they have achieved strong performance in computer vision. However, the source of their generalization performance remains difficult to explain ...
189. Trivium: Temporal Regret as a First-Class Objective for Causal-Memory Controllers
Author: Edward Y. Chang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.AI, cs.LG
arXiv:2606.04421v1 Announce Type: cross Abstract: Many current agentic systems and LLM pipelines correct mistakes by optimizing outcome reward. This addresses only the what of failure: when an outcome diverges from prediction, the why and when of the mismatch are not systematically logged, reviewed,...
190. Flatness and Generalization: Learning Multi-Index Models with Homogeneous Neural Networks
Author: Harsh Vardhan, Hossein Taheri, Arya Mazumdar
Published: 6/5/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:2606.04429v1 Announce Type: cross Abstract: A common heuristic used to explain the generalization of first-order gradient methods on non-convex neural networks is that "flat interpolators generalize well" (Hochreiter and Schmidhuber, 1994; Keskar et al., 2017), where flatness can be measured b...
191. Stateful Visual Encoders for Vision-Language Models
Author: Zirui Wang, Junwei Yu, Adam Yala, David M. Chan, Joseph E. Gonzalez, Trevor Darrell
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CV, cs.CL, cs.LG
arXiv:2606.04433v1 Announce Type: cross Abstract: Vision-language models (VLMs) are increasingly used in multi-image, multi-turn agentic settings where decisions depend on visual changes. However, in existing open-weight VLMs, visual comparisons happen only inside the language model, while the visua...
192. Hyper-ICL: Attention Calibration with Hyperbolic Anchor Distillation for Multimodal In-Context Learning
Author: Niloufar Alipour Talemi, Hossein Kashiani, Fatemeh Afghah
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2606.04434v1 Announce Type: cross Abstract: Multimodal In-Context Learning (ICL) has emerged as a practical inference paradigm for Multimodal Large Language Models, where a small set of interleaved image-text In-Context Demonstrations (ICDs) conditions the model to solve new tasks. Despite its...
193. Scaling Datasets for Multi-Sensor, Multi-Agent, and Multi-Domain Learning in Autonomous Systems
Author: R. Spencer Hallyburton, David Hunt, Miroslav Pajic
Published: 6/5/2026, 4:00:00 AM
Categories: eess.IV, cs.LG
arXiv:2606.04444v1 Announce Type: cross Abstract: Existing datasets cannot support large-scale learning in multi-agent, multi-sensor, or multi-domain autonomy, where diversity and coordination are essential. We present a modular dataset generation pipeline that creates terabyte-scale, ground-truth-l...
194. D^2SD: Accelerating Speculative Decoding with Dual Diffusion Draft Models
Author: Liyuan Zhang, Jiarui Zhang, Jinwei Yao, Ran Yan, Yuchen Yang, Jiahao Zhang, Tongkai Yang, Yi Wu, Binhang Yuan
Published: 6/5/2026, 4:00:00 AM
Categories: cs.DC, cs.LG
arXiv:2606.04446v1 Announce Type: cross Abstract: Speculative decoding accelerates autoregressive large language model inference by drafting multiple tokens and verifying them in a single target-model forward pass. Recent diffusion-based drafters generate an entire block of tokens in parallel but us...
195. Radiomic Feature Selection Using Gradient Loss of Deep Neural Network for Lung Cancer Stage Detection
Author: Hina Shakir, Mohammad Mohatram, Javeed Hussain, Syed Rizwan Ali, Muhammad Irfan Memon
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2606.04453v1 Announce Type: cross Abstract: Radiomics enables extraction of quantitative imaging biomarkers from medical images and has become an important tool for computer-aided cancer diagnosis. However, radiomics datasets are typically high-dimensional with limited samples, making feature ...
196. CyberGym-E2E: Scalable Real-World Benchmark for AI Agents' End-to-End Cybersecurity Capabilities
Author: Tianneng Shi, Robin Rheem, Dongwei Jiang, Mona Wang, Francisco De La Riega, Zhun Wang, Jingzhi Jiang, Alexander Cheung, Sean Tai, Jonah Cha, Jianhong Tu, Gabriel Han, Chenguang Wang, Jingxuan He, Wenbo Guo, Dawn Song
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CR, cs.AI, cs.LG
arXiv:2606.04460v1 Announce Type: cross Abstract: AI has the potential to transform cybersecurity by enabling systems that can autonomously detect, analyze, and remediate software vulnerabilities. However, existing cybersecurity evaluations of AI systems are limited in scale or scope, and fail to ca...
197. AgentJet: A Flexible Swarm Training Framework for Agentic Reinforcement Learning
Author: Qingxu Fu, Boyin Liu, Shuchang Tao, Zhaoyang Liu, Bolin Ding
Published: 6/5/2026, 4:00:00 AM
Categories: cs.AI, cs.LG, cs.MA
arXiv:2606.04484v1 Announce Type: cross Abstract: We present AgentJet, a distributed swarm training framework for large language model (LLM) agent reinforcement learning. Unlike centralized frameworks that tightly couple agent rollouts with model optimization, AgentJet adopts a decoupled multi-node ...
198. Global Sketch-Based Watermarking for Diffusion Language Models
Author: Daniel Zhao
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CR, cs.CL, cs.LG, stat.ML
arXiv:2606.04486v1 Announce Type: cross Abstract: Watermarking methods for language models have been studied extensively in the autoregressive setting, where tokens are generated sequentially. These works largely focus on local-context schemes that perturb the next token's distribution as a function...
199. Modeling and Interpreting Teamwork Dynamics in Cancer Care Outcome Prediction
Author: Yuhua Huang, Hsiao-Ying Lu, Kwan-Liu Ma
Published: 6/5/2026, 4:00:00 AM
Categories: cs.SI, cs.LG
arXiv:2606.04499v1 Announce Type: cross Abstract: Cancer care requires a longitudinal approach in which treatments are planned and delivered over time according to the needs of each individual patient. While prior research has thoroughly explored how clinical and demographic factors, such as comorbi...
200. SparDA: Sparse Decoupled Attention for Efficient Long-Context LLM Inference
Author: Yaosheng Fu, Guangxuan Xiao, Xin Dong, Song Han, Oreste Villa
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CL, cs.LG
arXiv:2606.04511v1 Announce Type: cross Abstract: Sparse attention reduces compute and memory bandwidth for long-context LLM inference. However, two key challenges remain: (1) KV cache capacity still grows with sequence length, and offloading to CPU memory introduces a PCIe transfer bottleneck; (2) ...
201. ANN Search: Recall What Matters
Author: Dimitris Dimitropoulos, Nikos Mamoulis
Published: 6/5/2026, 4:00:00 AM
Categories: cs.IR, cs.AI, cs.DB, cs.LG
arXiv:2606.04522v1 Announce Type: cross Abstract: Approximate nearest neighbor (ANN) search has become a core primitive in information retrieval and modern machine learning tasks, from classification to retrieval-augmented generation. The community evaluates and tunes ANN algorithms primarily on the...
202. GENEB: Why Genomic Models Are Hard to Compare
Author: Daria Ledneva, Mikhail Nuridinov, Denis Kuznetsov
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CL, cs.LG, q-bio.GN
arXiv:2606.04525v1 Announce Type: cross Abstract: Progress in genomic foundation models is difficult to assess due to fragmented benchmarks, incompatible evaluation protocols, and task-specific reporting. As a result, claims of superiority or generality across models are often not directly comparabl...
203. Cartridges at Scale: Training Modular KV Caches over Large Document Collections
Author: Momchil Hardalov, Gonzalo Iglesias, Adri`a de Gispert
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CL, cs.IR, cs.LG
arXiv:2606.04557v1 Announce Type: cross Abstract: Large Language Models can reason over long contexts, yet prefilling millions of tokens is wasteful as much of the content remains static across queries. Cartridges address this by distilling document collections into reusable key-value (KV) caches th...
204. Neetyabhas: A Framework for Uncertainty-Aware Public Policy Optimization in Rational Agent-Based Models
Author: Janani Venugopalan, Gaurav Deshkar, Rishabh Gaur, Harshal Hayatnagarkar, Jayanta Kshirsagar
Published: 6/5/2026, 4:00:00 AM
Categories: cs.AI, cs.LG, cs.SI
arXiv:2606.04562v1 Announce Type: cross Abstract: Purpose The WHO's COVID-19 non-pharmaceutical interventions (e.g., lockdowns, vaccinations) effectively curb transmission but impose heavy economic strains. Existing research often neglects individual behaviors and falsely assumes perfect infection t...
205. ReSGA: A Large Tail Risk Model for Learning Value-at-Risk and Expected Shortfall
Author: Yichi Zhang, Ke Zhu, Zhoufan Zhu
Published: 6/5/2026, 4:00:00 AM
Categories: stat.ML, cs.LG, econ.EM, q-fin.RM
arXiv:2606.04576v1 Announce Type: cross Abstract: Learning Value-at-Risk (VaR) and Expected Shortfall (ES) is important for managing financial risks effectively. Existing approaches with limited parameters are vulnerable to model misspecification in the era of big data. To address this limitation, w...
206. Reconstructing Unobservable Temperature Fields via Simulation-Aided Intelligent Sensing
Author: Monika Stipsitz, H`elios Sanchis-Alepuz, Jacob Reynvaan, Silvester Sabathiel
Published: 6/5/2026, 4:00:00 AM
Categories: physics.comp-ph, cs.LG, physics.app-ph
arXiv:2606.04582v1 Announce Type: cross Abstract: Real-time monitoring of the temperature distribution within components and sub-structures is a challenging topic in many systems due to restrictions on feasible sensor locations. While machine learning (ML) proves a versatile tool in many application...
207. Distributional Approximate Nearest Neighbour Search for Uncertainty-Aware Retrieval
Author: Olivier Jeunen
Published: 6/5/2026, 4:00:00 AM
Categories: cs.IR, cs.LG, stat.ML
arXiv:2606.04603v1 Announce Type: cross Abstract: Approximate Nearest Neighbour search indices form the backbone of real-world recommender systems, enabling real-time candidate retrieval over million-item catalogues. Typically, a single point estimate embedding is learnt for every user and every ite...
208. Beyond Symmetric Alignment: Spectral Diagnostics of Modality Imbalance in Vision-Language Models in the Medical Domain
Author: Alessandro Gambetti, Qiwei Han, Cl'audia Soares, Hong Shen
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2606.04613v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) struggle when applied to medical image-text data, yet the tools available to diagnose this failure remain limited. Existing representation alignment metrics are symmetric, collapsing both modalities into a single score a...
209. U-Net-Accelerated Quality-Diversity Optimization for Climate-Adaptive Urban Layouts
Author: Alexander Hagg, Tania Guerrero, Dirk Reith
Published: 6/5/2026, 4:00:00 AM
Categories: cs.NE, cs.LG
arXiv:2606.04658v1 Announce Type: cross Abstract: Optimizing urban layouts for climate adaptation requires balancing building density with cold-air ventilation. Because physics-based climate simulations are computationally expensive, planners typically evaluate fewer than ten manual designs. \gls{qd...
210. CRAFT: Cost-aware Refinement And Front-aware Tuning of Prompts
Author: Shanu Kumar, Shubhanshu Khandelwal, Akhila Yesantarao Venkata, Parag Agrawal, Yova Kementchedjhieva, Manish Gupta
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CL, cs.LG
arXiv:2606.04661v1 Announce Type: cross Abstract: Prompts tuned for accuracy often grow long, raising inference cost on every model call. The best accuracy-cost trade-off depends on the task and the budget, so prompt optimization is a search over the Pareto front of accuracy and prompt-token cost ra...
211. Fitting scattered data with optional monotonicity constraints on GPU: LipFit package
Author: Gleb Beliakov
Published: 6/5/2026, 4:00:00 AM
Categories: math.NA, cs.LG, cs.MS, cs.NA
arXiv:2606.04670v1 Announce Type: cross Abstract: This paper presents a method of multivariate scattered data interpolation and approximation that produces optimal Lipschitz-continuous approximation, subject to the desired monotonicity constraints. This method relies on tight upper and lower approxi...
212. QPredSGG: Hybrid Quantum Predicate Learning for Long-Tailed Scene Graph Generation
Author: Prerana Ramkumar, Nouhaila Innan, Muhammad Shafique
Published: 6/5/2026, 4:00:00 AM
Categories: quant-ph, cs.LG
arXiv:2606.04689v1 Announce Type: cross Abstract: Scene Graph Generation (SGG) requires relational reasoning over objects and their interactions, but performance is often limited by severe long-tail predicate imbalance. Classical SGG models frequently rely on dataset statistics, leading to biased pr...
213. Rethinking Continual Experience Internalization for Self-Evolving LLM Agents
Author: Jingwen Chen, Wenkai Yang, Shengda Fan, Wenbo Nie, Chenxing Sun, Shaodong Zheng, Yangen Hu, Lu Pan, Ke Zeng, Yankai Lin
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CL, cs.LG
arXiv:2606.04703v1 Announce Type: cross Abstract: Experience internalization converts contextual experience from past interactions into reusable parametric capability, offering a promising path toward continual learning in large language models (LLMs). While prior work has predominantly focused on s...
214. TIDE: Proactive Multi-Problem Discovery via Template-Guided Iteration
Author: Soyeong Jeong, Jinheon Baek, Minki Kang, Sung Ju Hwang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG
arXiv:2606.04743v1 Announce Type: cross Abstract: Agents are widely deployed as assistants over documents, tools, and code. However, they typically act only on explicit user requests, which surface only the problems the user has noticed, while many other important problems coexist, hidden in plain s...
215. COP-Q: Safety-First Reinforcement Learning for Robot Control via Cholesky-Ordered Projection
Author: Guopeng Li, Moritz A. Zanger, Matthijs T. J. Spaan, Julian F. P. Kooij
Published: 6/5/2026, 4:00:00 AM
Categories: cs.RO, cs.LG
arXiv:2606.04749v1 Announce Type: cross Abstract: Safe robot control requires maximizing return while satisfying safety constraints. In off-policy safe reinforcement learning, reward and safety Q-values are commonly learned by separate critic ensembles, with uncertainty handled independently for eac...
216. Fog of Love: Engineering Virtuous Agent Behavior with Affinity-based Reinforcement Learning in a Game Environment
Author: Ajay Vishwanath, Christian Omlin
Published: 6/5/2026, 4:00:00 AM
Categories: cs.AI, cs.CY, cs.LG
arXiv:2606.04750v1 Announce Type: cross Abstract: Instilling virtuous behavior in artificial intelligence has seen increasing interest. One of the techniques proposed is known as affinity-based reinforcement learning, which uses policy regularization on the objective function to incentivize virtuous...
217. Near-Optimal Decentralized Stochastic Convex Optimization over Networks
Author: Nitai Kluger, Amit Attia, Tomer Koren
Published: 6/5/2026, 4:00:00 AM
Categories: math.OC, cs.LG
arXiv:2606.04757v1 Announce Type: cross Abstract: We study decentralized stochastic smooth convex optimization, where $M$ workers minimize an average objective using local stochastic gradients and neighbor-only communication over a fixed gossip network. A central question in this setting is to deter...
218. Inference-Time Vulnerability Beyond Shallow Safety: Alignment Along Generation Trajectories
Author: Kyungmin Park, Taesup Kim
Published: 6/5/2026, 4:00:00 AM
Categories: cs.AI, cs.CL, cs.LG
arXiv:2606.04778v1 Announce Type: cross Abstract: Safety-aligned Large Language Models (LLMs) remain vulnerable to interventions during inference that redirect generation toward harmful outputs. Recent work attributes this to shallow safety, where alignment concentrates in the first few output token...
219. AIP: A Graph Representation for Learning and Governing Agent Skills
Author: Zachary Blumenfeld, Jim Webber
Published: 6/5/2026, 4:00:00 AM
Categories: cs.AI, cs.LG
arXiv:2606.04781v1 Announce Type: cross Abstract: Agent Skills today consist largely of free-form prose requiring the agent to read, interpret, and re-derive how to act in every session. This imposes two compounding costs: reduced reliability on implementation-heavy tasks, and difficulty in skill cr...
220. Crafting Your Evolving Dreams: Concept-Incremental Versatile Customization
Author: Jiahua Dong, Wenqi Liang, Hongliu Li, Yang Cong, Duzhen Zhang, Hanbin Zhao, Henghui Ding, Yulun Zhang, Salman Khan, Fahad Shahbaz Khan
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2606.04797v1 Announce Type: cross Abstract: Custom diffusion models (CDMs) have garnered significant interest owing to their remarkable capacity for generating personalized concepts. However, the majority of CDMs unrealistically presume that the user's collection of personalized concepts is st...
221. BiasGRPO: Stabilizing Bias Mitigation in High-Variance Reward Landscapes via Group-Relative Policy Optimization
Author: Saket Reddy, Ke Yang, ChengXiang Zhai
Published: 6/5/2026, 4:00:00 AM
Categories: cs.AI, cs.CL, cs.CY, cs.LG
arXiv:2606.04807v1 Announce Type: cross Abstract: Mitigating social bias in Large Language Models (LLMs) presents a distinct alignment challenge: unlike verifiable tasks, bias lacks a single ground truth, creating a high-variance, subjective reward landscape. Previous preference-based fine-tuning me...
222. Beyond Objective Equivalence: Constraint Injection for LLM-Based Optimization Modeling on Vehicle Routing Problems
Author: Xizi Luo, Changhong He, Dongdong Geng, Chenggong Shi, Yu Mei
Published: 6/5/2026, 4:00:00 AM
Categories: cs.AI, cs.LG
arXiv:2606.04816v1 Announce Type: cross Abstract: Large language models (LLMs) increasingly translate natural-language optimization problems into executable solver code. Yet for constraint-dense operations research (OR) problems, existing data-filtering and training pipelines largely rely on objecti...
223. OA-CutMix: Correcting the Label Bias of CutMix
Author: Tobias Christian Nauen, Stanislav Frolov, Federico Raue, Brian B. Moser, Andreas Dengel
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CV, cs.AI, cs.LG
arXiv:2606.04820v1 Announce Type: cross Abstract: CutMix has become the de facto standard mixing augmentation, yet its label assignment rests on a flawed assumption: The area of the pasted patch faithfully reflects its semantic contribution to the mixed image. In practice, however, patches frequentl...
224. Bayesian learning for the stochastic shortest path problem
Author: Chon Wai Ho, Sumeetpal S. Singh, Jiaqi Guo
Published: 6/5/2026, 4:00:00 AM
Categories: stat.ML, cs.LG, math.ST, stat.CO, stat.TH
arXiv:2606.04845v1 Announce Type: cross Abstract: Sequential decision-making problems are often modelled as a Markov decision process (MDP). We focus on the stochastic shortest path (SSP) problem, which is an infinite-horizon undiscounted MDP with absorbing terminal states. We develop a Bayesian fra...
225. MusaCoder: Native GPU Kernel Generation with Full-Stack Training on Moore Threads GPU
Author: Kun Cheng, Songshuo Lu, Sicong Liao, Tankun Li, Yafei Zhang, Dong Yang, Qiheng Lv, Hua Wang, Zhi Chen, Yaohua Tang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CV, cs.CL, cs.LG
arXiv:2606.04847v1 Announce Type: cross Abstract: Native GPU kernel generation turns high-level tensor programs into executable, efficient low-level code. Existing Large Language Models (LLMs) struggle with this task, while execution-based reinforcement learning suffers from sparse rewards, reward h...
226. Geometry-Aware Distillation for Prompt Tuning Biomedical Vision-Language Models
Author: Tran Dinh Tien, Zhiqiang Shen
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CV, cs.AI, cs.LG
arXiv:2606.04922v1 Announce Type: cross Abstract: Current prompt-based and adapter-based tuning of vision-language models (VLMs) is attractive for medical imaging, where clinical data sensitivity favors frozen backbones and annotations are limited. However, these methods typically optimize only the ...
227. A General Framework for Dynamic Consistent Submodular Maximization
Author: Paul D"utting, Federico Fusco, Silvio Lattanzi, Ashkan Norouzi-Fard, Ola Svensson, Morteza Zadimoghaddam
Published: 6/5/2026, 4:00:00 AM
Categories: cs.DS, cs.LG, stat.ML
arXiv:2606.04946v1 Announce Type: cross Abstract: Consistency is an important property in dynamic submodular maximization and entails maintaining a near-optimal solution at all times, making only a small number of adjustments to the solution in each step. Prior work has explored this question for th...
228. NLLog: Lightweight, Explainable SOC Anomaly Detection via Log-to-Language Rewriting
Author: Samuel Ndichu, Tao Ban, Seiichi Ozawa, Takeshi Takahashi, Daisuke Inoue
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CR, cs.IR, cs.LG
arXiv:2606.04957v1 Announce Type: cross Abstract: System-generated logs underpin security monitoring, yet their rigid template-based format hinders both automated analysis and human comprehension. We present NLLog (Natural-Language Log), a lightweight pipeline that deterministically rewrites parsed ...
229. Learning Control-Affine Reduced-Order Models via Autoencoders
Author: Ali Mjalled, Martin M"onnigmann
Published: 6/5/2026, 4:00:00 AM
Categories: math.DS, cs.LG
arXiv:2606.05045v1 Announce Type: cross Abstract: We present in this paper a framework for the identification of control-affine reduced-order models (ROMs). The proposed method utilizes autoencoders (AEs) to transform the high-dimensional states, and potentially the high-dimensional inputs, into red...
230. Fast & Faithful Function Vectors
Author: Minh An Pham, Anton Segeler, Thomas Wiegand, Wojciech Samek, Sebastian Lapuschkin, Patrick Kahardipraja, Reduan Achtibat
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CL, cs.LG
arXiv:2606.05079v1 Announce Type: cross Abstract: Function vectors (FVs) are task representations elicited during in-context learning that can be used to steer Large Language Models (LLMs). However, design choices in their formulation remain underexplored. In this work, we study the impact of varyin...
231. AutoLab: Can Frontier Models Solve Long-Horizon Auto Research and Engineering Tasks?
Author: Zhangchen Xu, Junda Chen, Yue Huang, Dongfu Jiang, Jiefeng Chen, Hang Hua, Zijian Wu, Zheyuan Liu, Zexue He, Lichi Li, Shizhe Diao, Jiaxin Pei, Jinsung Yoon, Hao Zhang, Mengdi Wang, Radha Poovendran, Misha Sra, Alex Pentland, Zichen Chen
Published: 6/5/2026, 4:00:00 AM
Categories: cs.AI, cs.LG
arXiv:2606.05080v1 Announce Type: cross Abstract: Scientific and engineering progress is fundamentally a long-horizon iterative process: proposing changes, running experiments, measuring outcomes, and continuously refining artifacts. Yet existing benchmarks for frontier models primarily evaluate eit...
232. FoeGlass: Simple In-Context Learning Is Enough for Red Teaming Audio Deepfake Detectors
Author: Sepehr Dehdashtian, Jacob H Seidman, Vishnu N Boddeti, Gaurav Bharaj
Published: 6/5/2026, 4:00:00 AM
Categories: cs.SD, cs.LG
arXiv:2606.05101v1 Announce Type: cross Abstract: Audio deepfake detection (ADD) models are critical for countering the malicious use of text-to-speech (TTS) models. Evaluating and strengthening ADD models requires developing datasets that span the space of generated audio and highlight high-error r...
233. Geometry Gaussians: Decoupling Appearance and Geometry in Gaussian Splatting
Author: Hongyu Zhou, Zorah L"ahner
Published: 6/5/2026, 4:00:00 AM
Categories: cs.GR, cs.CV, cs.LG
arXiv:2606.05124v1 Announce Type: cross Abstract: After the success of 3D Gaussian Splatting (3DGS) for novel view synthesis, many works have explored how to also use it for geometric surface representation. However, extracting accurate geometric information directly from 3DGS remains challenging an...
234. Preserving Data Privacy in Learning Causal Structure with Fully Homomorphic Encryption
Author: Jian Yang, Yuan Tong, Qinbin Li, Zeyi Wen, Xiaofang Zhou
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CR, cs.LG
arXiv:2606.05129v1 Announce Type: cross Abstract: Preserving data privacy is an important topic in structural data management and data mining. However, the issue of privacy leakage in distributed causal structure learning is a persistent challenge, especially in cases where data transmission and com...
235. Activation-Based Active Learning for In-Context Learning: Challenges and Insights
Author: Yaseen M. Osman, Geoff V. Merrett, Stuart E. Middleton
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CL, cs.LG
arXiv:2606.05134v1 Announce Type: cross Abstract: Deep active learning has previously been explored for LLM in-context sample selection, but not with methods that utilise recent advances in understanding of transformer activations. In this paper, we test the hypothesis that model activations could p...
236. An Open-Source Two-Stage Computer Vision Pipeline for Fine-Grained Vehicle Classification using Vision Transformers
Author: Gandhimathi Padmanaban, Fred Feng
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CV, cs.LG, eess.IV
arXiv:2606.05149v1 Announce Type: cross Abstract: Vehicle body type is a significant determinant of cyclist injury severity in overtaking crashes, yet automated tools for classifying vehicles into injury-risk-relevant categories from naturalistic roadway video do not exist in the open literature. St...
237. Blessing from Human-AI Interaction: Super Reinforcement Learning in Confounded Environments
Author: Jiayi Wang, Zhengling Qi, Chengchun Shi
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, math.ST, stat.ME, stat.TH
arXiv:2209.15448v3 Announce Type: replace Abstract: As AI becomes more prevalent throughout society, effective methods of integrating humans and AI systems that leverage their respective strengths and mitigate risk have become an important priority. In this paper, we introduce the paradigm of super ...
238. Transformer-Based Autonomous Driving Models and Deployment-Oriented Compression: A Survey
Author: Juan Zhong, Yuhang Shi, Zukang Xu, Xi Chen
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CV, cs.RO, cs.SY, eess.SY
arXiv:2304.10891v3 Announce Type: replace Abstract: Transformer-based models are becoming a central paradigm in autonomous driving because they can capture long-range spatial dependencies, multi-agent interactions, and multimodal context across perception, prediction, and planning. At the same time,...
239. Kernel Neural Operators (KNOs) for Scalable, Memory-efficient, Geometrically-flexible Operator Learning
Author: Matthew Lowery, John Turnage, Zachary Morrow, John D. Jakeman, Akil Narayan, Shandian Zhe, Varun Shankar
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.NA, math.NA
arXiv:2407.00809v4 Announce Type: replace Abstract: This paper introduces the Kernel Neural Operator (KNO), a provably convergent operator-learning architecture that utilizes compositions of deep kernel-based integral operators for function-space approximation of operators (maps from functions to fu...
240. Explaining a probabilistic prediction on the simplex with Shapley compositions
Author: Paul-Gauthier No'e, Miquel Perell'o-Nieto, Jean-Fran\c{c}ois Bonastre, Peter Flach
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.GT
arXiv:2408.01382v3 Announce Type: replace Abstract: Originating in game theory, Shapley values are widely used for explaining a machine learning model's prediction by quantifying the contribution of each feature's value to the prediction. This requires a scalar prediction as in binary classification...
241. Learning Randomized Reductions
Author: Ferhat Erata, Orr Paradise, Thanos Typaldos, Timos Antonopoulos, ThanhVu Nguyen, Shafi Goldwasser, Ruzica Piskac
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.CC, cs.PL, cs.SE
arXiv:2412.18134v5 Announce Type: replace Abstract: Randomized self-reductions (RSRs) express $f(x)$ using $f$ evaluated at random correlated points, enabling self-correcting programs, instance-hiding protocols, and applications in complexity theory and cryptography. Yet discovering RSRs has require...
242. When and why randomised exploration works (in linear bandits)
Author: Marc Abeille, David Janz, Ciara Pike-Burke
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2502.08870v2 Announce Type: replace Abstract: We provide an approach for the analysis of randomised exploration algorithms like Thompson sampling that does not rely on forced optimism or posterior inflation. With this, we demonstrate that in the $d$-dimensional linear bandit setting, when the ...
243. Post-Training Corrections for Improved Time-Series Forecasting
Author: Hamza Cherkaoui, Malik Tiomoko, Giuseppe Paolo, Zhang Yili, Yu Meng, Zhang Keli, Hafiz Tiomoko Ali
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2505.15354v3 Announce Type: replace Abstract: Time-series forecasting is a critical task in various business domains, but it remains inherently challenging. Typically, large forecasting models are trained in a single, resource-intensive run. Once training is completed, a natural question arise...
244. Certified Neural Approximations of Nonlinear Dynamics
Author: Frederik Baymler Mathiesen, Nikolaus Vertovec, Francesco Fabiano, Luca Laurenti, Alessandro Abate
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.SY, eess.SY
arXiv:2505.15497v3 Announce Type: replace Abstract: Neural networks hold great potential to act as approximate models of nonlinear dynamical systems, with the resulting neural approximations enabling verification and control of such systems. However, in safety-critical contexts, the use of neural ap...
245. Model-Preserving Adaptive Rounding
Author: Albert Tseng, Zhaofeng Sun, Christopher De Sa
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2505.22988v3 Announce Type: replace Abstract: The goal of quantization is to produce a compressed model whose output distribution is as close to the original model's as possible. To do this tractably, most quantization algorithms minimize the immediate activation error of each layer as a proxy...
246. Neural Variance-aware Dueling Bandits with Deep Representation and Shallow Exploration
Author: Youngmin Oh, Jinje Park, Taejin Paik
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2506.01250v3 Announce Type: replace Abstract: We introduce the first variance-aware algorithms for contextual dueling bandits that leverage shallow exploration strategies with neural networks for nonlinear utility approximation. A key theoretical challenge is the absence of a closed-form estim...
247. Uncovering Insights of Compound Flooding with Data-Driven AI
Author: Xu Zheng, Chaohao Lin, Sipeng Chen, Zhuomin Chen, Jimeng Shi, Jayantha Obeysekera, Jingchao Ni, Wei Cheng, Jason Liu, Dongsheng Luo
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2506.04281v2 Announce Type: replace Abstract: Compound flooding, driven by nonlinear interactions between multiple hydrometeorological factors, poses a significant challenge to hazard prevention. Existing forecasting approaches, whether physics-based or data-driven, often emphasize temporal pa...
248. MesaNet: Sequence Modeling by Locally Optimal Test-Time Training
Author: Johannes von Oswald, Nino Scherrer, Seijin Kobayashi, Luca Versari, Songlin Yang, Sarthak Mittal, Maximilian Schlegel, Kaitlin Maile, Yanick Schimpf, Oliver Sieberling, Alexander Meulemans, Rif A. Saurous, Guillaume Lajoie, Charlotte Frenkel, Razvan Pascanu, Blaise Ag"uera y Arcas, Jo~ao Sacramento
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL
arXiv:2506.05233v2 Announce Type: replace Abstract: Sequence modeling is currently dominated by causal transformer architectures that use softmax self-attention. Although widely adopted, transformers require scaling memory and compute linearly during inference. A recent stream of work linearized the...
249. Reusing Trajectories in Policy Gradients Enables Fast Convergence
Author: Alessandro Montenegro, Federico Mansutti, Marco Mussi, Matteo Papini, Alberto Maria Metelli
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2506.06178v3 Announce Type: replace Abstract: Policy gradient (PG) methods are a class of effective reinforcement learning algorithms, particularly when dealing with continuous control problems. They rely on fresh on-policy data, making them sample-inefficient and requiring $O(\epsilon^{-2})$ ...
250. Time Series Forecasting as Reasoning: A Slow-Thinking Approach with Reinforced LLMs
Author: Yitong Zhou, Yucong Luo, Mingyue Cheng, Qi Liu, Jiahao Wang, Daoyu Wang, Enhong Chen
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2506.10630v3 Announce Type: replace Abstract: To advance time series forecasting (TSF), various methods have been proposed to improve prediction accuracy, evolving from statistical techniques to data-driven deep learning architectures. Despite their effectiveness, most existing methods still a...
251. Customizing the Inductive Biases of Softmax Attention using Structured Matrices
Author: Yilun Kuang, Noah Amsel, Sanae Lotfi, Shikai Qiu, Andres Potapczynski, Andrew Gordon Wilson
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2509.07963v2 Announce Type: replace Abstract: The core component of attention is the scoring function, which transforms the inputs into low-dimensional queries and keys and takes the dot product of each pair. While the low-dimensional projection improves efficiency, it causes information loss ...
252. Uncertainty Estimation using Variance-Gated Distributions
Author: H. Martin Gillis, Isaac Xu, Thomas Trappenberg
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, stat.ML
arXiv:2509.08846v2 Announce Type: replace Abstract: Evaluation of per-sample uncertainty quantification from neural networks is essential for decision-making involving high-risk applications. A common approach is to use the predictive distribution from Bayesian or approximation models and decompose ...
253. KITE: Kernelized and Information Theoretic Exemplars for In-Context Learning
Author: Vaibhav Singh, Soumya Suvra Ghosal, Kapu Nirmal Joshua, Soumyabrata Pal, Sayak Ray Chowdhury
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL
arXiv:2509.15676v2 Announce Type: replace Abstract: In-context learning (ICL) has emerged as a powerful paradigm for adapting large language models (LLMs) to new and data-scarce tasks using only a few carefully selected task-specific examples presented in the prompt. However, given the limited conte...
254. Overclocking Electrostatic Generative Models
Author: Daniil Shlenskii, Alexander Korotin
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2509.22454v2 Announce Type: replace Abstract: Electrostatic generative models such as PFGM++ have recently emerged as a powerful framework, achieving competitive performance in image synthesis. PFGM++ operates in an extended data space with auxiliary dimensionality $D$, recovering the diffusio...
255. ClustRecNet: A Novel End-to-End Deep Learning Framework for Clustering Algorithm Recommendation
Author: Mohammadreza Bakhtyari, Bogdan Mazoure, Renato Cordeiro de Amorim, Guillaume Rabusseau, Vladimir Makarenkov
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2509.25289v4 Announce Type: replace Abstract: Identifying an effective clustering algorithm for a given dataset remains a fundamental unsupervised learning issue. We introduce ClustRecNet, a novel end-to-end deep learning framework that recommends suitable clustering algorithm(s) by directly l...
256. Bypassing Prompt Guards in Production with Controlled-Release Prompting
Author: Jaiden Fairoze, Sanjam Garg, Keewoo Lee, Mingyuan Wang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.CR
arXiv:2510.01529v3 Announce Type: replace Abstract: Ball et al. recently established that prompt filtering for AI alignment faces a fundamental barrier: under standard cryptographic assumptions, no filter running significantly faster than the protected model can universally distinguish adversarial p...
257. Transmuting prompts into weights
Author: Hanna Mazzawi, Benoit Dherin, Michael Munn, Adrian Goldwaser, Michael Wunder, Javier Gonzalvo
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2510.08734v3 Announce Type: replace Abstract: A growing body of research has demonstrated that the behavior of large language models can be effectively controlled at inference time by directly modifying their internal states, either through vector additions to their activations or through upda...
258. Simplicial Embeddings Improve Sample Efficiency in Actor-Critic Agents
Author: Johan Obando-Ceron, Walter Mayor, Samuel Lavoie, Scott Fujimoto, Aaron Courville, Pablo Samuel Castro
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.RO
arXiv:2510.13704v2 Announce Type: replace Abstract: Recent works have proposed accelerating the wall-clock training time of actor-critic methods via the use of large-scale environment parallelization; unfortunately, these can sometimes still require large number of environment interactions to achiev...
259. Test-time reward-guided alignment of language models by importance sampling on pre-logit space
Author: Sekitoshi Kanai, Tsukasa Yoshida, Hiroshi Takahashi, Haru Kuroki, Kazumune Hashimoto
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2510.26219v3 Announce Type: replace Abstract: Test-time alignment of large language models (LLMs) attracts attention because fine-tuning of LLMs requires high computational costs. In this paper, we propose a new test-time reward-guided alignment method called adaptive importance sampling on pr...
260. Extending Fair Null-Space Projections for Continuous Attributes to Kernel Methods
Author: Felix St"orck, Fabian Hinder, Barbara Hammer
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2511.03304v2 Announce Type: replace Abstract: With the on-going integration of machine learning systems into the everyday social life of millions the notion of fairness becomes an ever increasing priority in their development. Fairness notions commonly rely on protected attributes to assess po...
261. DiScoFormer: Plug-In Density and Score Estimation with Transformers
Author: Vasily Ilin, Peter Sushko, Ranjay Krishna
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2511.05924v4 Announce Type: replace Abstract: Estimating probability density and its score from samples remains a core problem in generative modeling, Bayesian inference, and kinetic theory. Existing methods are bifurcated: classical kernel density estimators (KDE) generalize across distributi...
262. LMM-IR: Large-Scale Netlist-Aware Multimodal Framework for Static IR-Drop Prediction
Author: Kai Ma, Zhen Wang, Hongquan He, Qi Xu, Tinghuan Chen, Hao Geng
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2511.12581v2 Announce Type: replace Abstract: Static IR drop analysis is a fundamental and critical task in the field of chip design. Nevertheless, this process can be quite time-consuming, potentially requiring several hours. Moreover, addressing IR drop violations frequently demands iterativ...
263. RAVQ-HoloNet: Rate-Adaptive Vector-Quantized Hologram Compression
Author: Shima Rafiei, Zahra Nabizadeh Shahr-Babak, Soroush Khoubyarian, Alexandre Cooper, Shadrokh Samavi, Shahram Shirani
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2511.21035v2 Announce Type: replace Abstract: Holography offers significant potential for AR/VR applications. However, its adoption is limited by the high demand for data compression. Existing deep learning approaches generally lack rate adaptivity within a single network and often require mul...
264. You Only Train Once: Differentiable Subset Selection for Omics Data
Author: Daphn'e Chopard, Jorge da Silva Gon\c{c}alves, Irene Cannistraci, Thomas M. Sutter, Julia E. Vogt
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2512.17678v2 Announce Type: replace Abstract: Selecting compact and informative gene subsets from single-cell transcriptomic data is essential for biomarker discovery, improving interpretability, and cost-effective profiling. However, most existing feature selection approaches either operate a...
265. Semiparametric Preference Optimization: Your Language Model is Secretly a Single-Index Model
Author: Nathan Kallus
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, econ.EM, stat.ML
arXiv:2512.21917v3 Announce Type: replace Abstract: Policy alignment to preference data typically assumes a known link function between observed preferences and latent rewards (e.g., Bradley-Terry model / logistic link). Misspecification of this link can bias inferred rewards and misalign learned po...
266. Local Intrinsic Dimensionality of Ground Motion Data for Early Detection of Catastrophic Slope Failure
Author: Yuansan Liu, James Bailey, Antoinette Tordesillas
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, stat.AP
arXiv:2601.03569v3 Announce Type: replace Abstract: Local Intrinsic Dimensionality (LID) has shown strong potential for anomaly detection in high-dimensional data, including landslide failure detection in granular media, where early and accurate identification of failure zones is crucial for effecti...
267. Symbolic Regression for Shared Expressions: Introducing Partial Parameter Sharing
Author: Viktor Martinek, Roland Herzog
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2601.04051v3 Announce Type: replace Abstract: Symbolic regression aims to find symbolic expressions that describe datasets. Due to its inherent interpretability, symbolic regression (SR) is a powerful paradigm for scientific discovery. Recent advances have expanded SR to describe related pheno...
268. Geometry-Aware Hallucination Detection in Large Language Models
Author: Bodla Krishna Vamshi, Rohan Bhatnagar, Haizhao Yang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL
arXiv:2601.06196v3 Announce Type: replace Abstract: Large language models (LLMs) frequently generate factually incorrect or unsupported content, commonly referred to as hallucinations. Prior work has explored decoding strategies, retrieval augmentation, and supervised fine-tuning for hallucination d...
269. Outcome-Based RL Provably Leads Transformers to Reason, but Only With the Right Data
Author: Yuval Ran-Milo, Yotam Alexander, Shahar Mendel, Nadav Cohen
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2601.15158v4 Announce Type: replace Abstract: Transformers trained via Reinforcement Learning (RL) with outcome-based supervision can spontaneously develop the ability to generate intermediate reasoning steps (Chain-of-Thought). Yet the mechanism by which sparse rewards drive policy gradient t...
270. Identifying and Correcting Label Noise for Robust GNNs via Influence Contradiction
Author: Wei Ju, Wei Zhang, Siyu Yi, Zhengyang Mao, Yifan Wang, Jingyang Yuan, Zhiping Xiao, Ziyue Qiao, Ming Zhang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2601.17469v2 Announce Type: replace Abstract: Graph Neural Networks (GNNs) have shown remarkable capabilities in learning from graph-structured data with various applications such as social analysis and bioinformatics. However, the presence of label noise in real scenarios poses a significant ...
271. Fixed Aggregation Features Can Rival GNNs
Author: Celia Rubio-Madrigal, Rebekka Burkholz
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2601.19449v2 Announce Type: replace Abstract: Graph neural networks (GNNs) are widely believed to excel at node representation learning through trainable neighborhood aggregations. We challenge this view by introducing Fixed Aggregation Features (FAFs), a training-free approach that transforms...
272. Conditional PED-ANOVA: Hyperparameter Importance in Hierarchical & Dynamic Search Spaces
Author: Kaito Baba, Yoshihiko Ozaki, Shuhei Watanabe
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2601.20800v3 Announce Type: replace Abstract: We propose conditional PED-ANOVA (condPED-ANOVA), a principled framework for estimating hyperparameter importance (HPI) in conditional search spaces, where the presence or domain of a hyperparameter can depend on other hyperparameters. Although the...
273. L$^3$: Large Lookup Layers
Author: Albert Tseng, Christopher De Sa
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2601.21461v3 Announce Type: replace Abstract: Modern sparse language models typically achieve sparsity through Mixture-of-Experts (MoE) layers, which dynamically route tokens to dense MLP "experts." However, dynamic hard routing has a number of drawbacks, such as potentially poor hardware effi...
274. Tuning the Implicit Regularizer of Masked Diffusion Language Models: Enhancing Generalization via Insights from $k$-Parity
Author: Jianhao Huang, Baharan Mirzasoleiman
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2601.22450v2 Announce Type: replace Abstract: Masked Diffusion Language Models have recently emerged as a powerful generative paradigm, yet their generalization properties remain understudied compared to their auto-regressive counterparts. In this work, we investigate these properties within t...
275. \textsc{Lethe}: Principled Dual-Stream Update for Persistent Knowledge Erasure in Federated Unlearning
Author: Wentai Wu, Hanwei Tan, Yijun Quan, Haixia Peng, Ligang He, Bin Yang, C. L. Philip Chen
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2601.22601v3 Announce Type: replace Abstract: Federated unlearning (FU) aims to erase knowledge from a global model. Existing studies commonly assume that federated collaboration terminates after unlearning, overlooking a deployment-realistic scenario where training continues on the remaining ...
276. SFMP: Fine-Grained, Hardware-Friendly and Search-Free Mixed-Precision Quantization for Large Language Models
Author: Xin Nie, Haicheng Zhang, Liang Dong, Beining Feng, Jinhong Weng, Guiling Sun
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2602.01027v2 Announce Type: replace Abstract: Mixed-precision quantization is a promising approach for compressing large language models under tight memory budgets. However, existing mixed-precision methods typically suffer from one of two limitations: they either rely on expensive discrete op...
277. On the Expressive Power of Permutation-Equivariant Weight-Space Networks
Author: Adir Dayan, Yam Eitan, Haggai Maron
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2602.01083v2 Announce Type: replace Abstract: Weight-space learning studies neural architectures that operate directly on the parameters of other neural networks. Motivated by the growing availability of pretrained models, recent work has demonstrated the effectiveness of weight-space networks...
278. SUSD: Structured Unsupervised Skill Discovery through State Factorization
Author: Seyed Mohammad Hadi Hosseini, Mahdieh Soleymani Baghshah
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2602.01619v2 Announce Type: replace Abstract: Unsupervised Skill Discovery (USD) aims to autonomously learn a diverse set of skills without relying on extrinsic rewards. One of the most common USD approaches is to maximize the Mutual Information (MI) between skill latent variables and states. ...
279. Efficient Adversarial Attacks on High-dimensional Offline Bandits
Author: Seyed Mohammad Hadi Hosseini, Amir Najafi, Mahdieh Soleymani Baghshah
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2602.01658v2 Announce Type: replace Abstract: Bandit algorithms have recently emerged as a powerful tool for evaluating machine learning models, including generative image models and large language models, by efficiently identifying top-performing candidates without exhaustive comparisons. The...
280. Making Expert Reasoning Learnable with Self-Distillation
Author: Ethan Mendes, Jungsoo Park, Alan Ritter
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2602.02405v2 Announce Type: replace Abstract: Improving the reasoning capabilities of large language models (LLMs) typically relies either on the model's ability to sample a correct solution to be reinforced or the existence of a stronger model able to solve the problem. However, many difficul...
281. What Structural Inductive Bias Helps Transformers Reason Over Knowledge Graphs? A Study with Tabula RASA
Author: Jonas Petersen, Camilla Mazzoleni, Gian-Alessandro Lombardi, Federico Martelli, Riccardo Maggioni
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2602.02834v4 Announce Type: replace Abstract: What structural inductive bias helps transformers reason over knowledge graphs? Through controlled ablations of a minimal transformer modification with four independently removable components (sparse adjacency masking, edge-type biases, query scali...
282. Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization
Author: Aleksandar Armacki, Dragana Bajovi'c, Du\v{s}an Jakoveti'c, Soummya Kar, Ali H. Sayed
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, math.OC
arXiv:2602.05657v2 Announce Type: replace Abstract: The study of tail behaviour of SGD-induced processes has been attracting a lot of interest, due to offering strong guarantees with respect to individual runs of an algorithm. While many works provide high-probability guarantees, quantifying the err...
283. Muon in Associative Memory Learning: Training Dynamics and Scaling Laws
Author: Binghui Li, Kaifei Wang, Han Zhong, Pinyan Lu, Liwei Wang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, math.OC, stat.ML
arXiv:2602.05725v3 Announce Type: replace Abstract: Muon updates matrix parameters via the matrix sign of the gradient and has shown strong empirical gains, yet its dynamics and scaling behavior remain unclear in theory. We study Muon in a linear associative memory model with softmax retrieval and a...
284. Vision Transformer Finetuning Benefits from Non-Smooth Components
Author: Ambroise Odonnat, Laetitia Chapel, Romain Tavenard, Ievgen Redko
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.CV, stat.ML
arXiv:2602.06883v3 Announce Type: replace Abstract: The smoothness of the transformer architecture has been extensively studied in the context of generalization, training stability, and adversarial robustness. However, its role in transfer learning remains poorly understood. In this paper, we analyz...
285. Variance-Gated Ensembles: An Epistemic-Aware Framework for Uncertainty Estimation
Author: H. Martin Gillis, Isaac Xu, Thomas Trappenberg
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2602.08142v2 Announce Type: replace Abstract: Machine learning applications require fast and reliable per-sample uncertainty estimation. A common approach is to use predictive distributions from Bayesian or approximation methods and additively decompose uncertainty into aleatoric (i.e., data-r...
286. Learning to Remember, Learn, and Forget in Attention-Based Models
Author: Djohan Bonnet, Jamie Lohoff, Jan Finkbeiner, Elidona Shiqerukaj, Emre Neftci
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2602.09075v4 Announce Type: replace Abstract: In-Context Learning (ICL) in transformers acts as an online associative memory and is believed to underpin their high performance on complex sequence processing tasks. However, in gated linear attention models, this memory has a fixed capacity and ...
287. It's TIME: Towards the Next Generation of Time Series Forecasting Benchmarks
Author: Zhongzheng Qiao, Sheng Pan, Anni Wang, Viktoriya Zhukova, Yong Liu, Xudong Jiang, Qingsong Wen, Mingsheng Long, Ming Jin, Chenghao Liu
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2602.12147v4 Announce Type: replace Abstract: Time series foundation models (TSFMs) are revolutionizing the forecasting landscape from specific dataset modeling to generalizable task evaluation. However, we contend that existing benchmarks exhibit common limitations in four dimensions: constra...
288. Unifying Model-Free Efficiency and Model-Based Representations via Latent Dynamics
Author: Jashaswimalya Acharjee, Balaraman Ravindran
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, stat.ML
arXiv:2602.12643v2 Announce Type: replace Abstract: We present Unified Latent Dynamics (ULD), a novel reinforcement learning algorithm that unifies the efficiency of model-free methods with the representational strengths of model-based approaches, without incurring planning overhead. By embedding st...
289. A Unified Framework for Locality in Scalable MARL
Author: Sourav Chakraborty, Amit Kiran Rege, Claire Monteleoni, Lijun Chen
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2602.16966v2 Announce Type: replace Abstract: Scalable methods for networked multi-agent reinforcement learning let each agent plan using only a small neighborhood of the agent graph. This works only when the system is value-local, meaning a perturbation at one agent affects the long-run value...
290. Sparse Bayesian Deep Functional Learning with Structured Region Selection
Author: Xiaoxian Zhu, Yingmeng Li, Shuangge Ma, Mengyun Wu
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, stat.AP, stat.ML
arXiv:2602.20651v3 Announce Type: replace Abstract: In modern applications such as ECG monitoring, neuroimaging, wearable sensing, and industrial equipment diagnostics, complex and continuously structured data are ubiquitous, presenting both challenges and opportunities for functional data analysis....
291. Does Order Matter : Connecting The Law of Robustness to Robust Generalization
Author: Mihir More, Aritra Das, Jaee Ponde, Himadri Mandal, Vishnu Varadarajan, Debayan Gupta
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2602.20971v3 Announce Type: replace Abstract: Bubeck and Selke (2021) propose the connection between the Law of Robustness and robust generalization error as an open problem. The Law of Robustness states that overparameterization is necessary for models to interpolate robustly, i.e., the inter...
292. Breaking the Scale Barrier: One-Shot Knowledge Transfer via Frequency Transform
Author: Jianlu Shen, Fu Feng, Yucheng Xie, Jiaqi Lv, Xin Geng
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2603.07523v3 Announce Type: replace Abstract: Transferring knowledge by fine-tuning large-scale pre-trained networks has become a standard paradigm for downstream tasks, yet the knowledge of a pre-trained model is tightly coupled with monolithic architecture, which restricts flexible reuse acr...
293. Good Reasoning Makes Good Demonstrations: Implicit Reasoning Quality Supervision via In-Context Reinforcement Learning
Author: Tiehua Mei, Minxuan Lv, Leiyu Pan, Zhenpeng Su, Hongru Hou, Hengrui Chen, Ao Xu, Deqing Yang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2603.09803v2 Announce Type: replace Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) improves reasoning in large language models but treats all correct solutions equally, potentially reinforcing flawed traces that arrive at correct answers by chance. We observe that \emph{better...
294. Efficient Reasoning on the Edge
Author: Yelysei Bondarenko, Thomas Hehn, Rob Hesselink, Romain Lepert, Fabio Valerio Massoli, Evgeny Mironov, Leyla Mirvakhabova, Tribhuvanesh Orekondy, Spyridon Stasis, Andrey Kuzmin, Anna Kuzina, Markus Nagel, Ankita Nayak, Corrado Rainone, Ork de Rooij, Paul N Whatmough, Arash Behboodi, Babak Ehteshami Bejnordi
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.CL
arXiv:2603.16867v2 Announce Type: replace Abstract: Large language models (LLMs) with chain-of-thought reasoning achieve state-of-the-art performance across complex problem-solving tasks, but their verbose reasoning traces and large context requirements make them impractical for edge deployment. The...
295. AgentDS Technical Report: Benchmarking the Future of Human-AI Collaboration in Domain-Specific Data Science
Author: An Luo, Jin Du, Xun Xian, Robert Specht, Fangqiao Tian, Ganghua Wang, Xuan Bi, Charles Fleming, Ashish Kundu, Jayanth Srinivasa, Mingyi Hong, Rui Zhang, Tianxi Li, Galin Jones, Jie Ding
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, stat.ME
arXiv:2603.19005v3 Announce Type: replace Abstract: Data science plays a critical role in transforming complex data into actionable insights across numerous domains. Recent developments in large language models (LLMs) and artificial intelligence (AI) agents have significantly automated data science ...
296. ALMAB-DC: Active Learning, Multi-Armed Bandits, and Distributed Computing for Sequential Experimental Design and Black-Box Optimization
Author: Foo Hui-Mean, Yuan-chin I Chang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, stat.CO, stat.ME, stat.ML
arXiv:2603.21180v4 Announce Type: replace Abstract: Sequential experimental design under expensive, gradient-free objectives is a central challenge in computational statistics: evaluation budgets are tightly constrained and information must be extracted efficiently from each observation. We propose ...
297. Policy Improvement Reinforcement Learning
Author: Huaiyang Wang, Xiaojie Li, Deqing Wang, Haoyi Zhou, Zixuan Huang, Yaodong Yang, Jianxin Li, Yikun Ban
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2604.00860v3 Announce Type: replace Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) has become a central post-training paradigm for improving the reasoning capabilities of large language models. Yet existing methods share a common blind spot: they optimize policies based on ins...
298. Orthogonal Learner for Estimating Heterogeneous Long-Term Treatment Effects
Author: Haorui Ma, Dennis Frauen, Valentyn Melnychuk, Stefan Feuerriegel
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, stat.ML
arXiv:2604.00915v2 Announce Type: replace Abstract: Estimation of heterogeneous long-term treatment effects (HLTEs) is relevant for personalized decision-making in marketing, economics, and medicine, where short-term observational datasets are often combined with long-term observational datasets. Ho...
299. Reasoning Shift: How Context Silently Shortens LLM Reasoning
Author: Gleb Rodionov, Roman Garipov, George Yakushev
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2604.01161v2 Announce Type: replace Abstract: Large language models (LLMs) exhibiting test-time scaling behavior, such as extended reasoning traces and self-verification, have demonstrated remarkable performance on complex, long-term reasoning tasks. However, the robustness of these reasoning ...
300. Adalina: Adaptive Linear Approximation for the Shapley Value and Beyond
Author: Weida Li, Yaoliang Yu, Bryan Kian Hsiang Low
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2604.08438v2 Announce Type: replace Abstract: The Shapley value, and its broader family of semi-values, has received much attention in various attribution problems. A fundamental and long-standing challenge is their efficient approximation, since exact computation generally requires an exponen...
301. Generative Augmented Inference
Author: Cheng Lu, Mengxin Wang, Dennis J. Zhang, Heng Zhang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, stat.ME, stat.ML
arXiv:2604.14575v2 Announce Type: replace Abstract: Large language models enable inexpensive AI-generated annotations, but using them reliably for causal inference remains challenging. Naively pooling AI and human data induces bias, while existing methods such as Prediction-Powered Inference (PPI; A...
302. Adaptive Head Budgeting for Efficient Multi-Head Attention
Author: Bilal Faye, Abdoulaye Mbaye, Hanane Azzag, Mustapha Lebbah
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2604.22583v3 Announce Type: replace Abstract: Multi-head attention enables Transformers to capture diverse representations, but all attention heads are typically activated for every input, regardless of task complexity. For coarse-grained tasks such as text classification, where relevant infor...
303. Towards interpretable AI with quantum annealing feature selection
Author: Francesco Aldo Venturelli, Emanuele Costa, Sikha O K, Bruno Juli'a-D'iaz, Miguel A. Gonz'alez Ballester, Alba Cervera-Lierta
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2604.25649v2 Announce Type: replace Abstract: Deep learning models are used in critical applications, in which mistakes can have serious consequences. Therefore, it is crucial to understand how and why models generate predictions. This understanding provides useful information to check whether...
304. Towards A Generative Protein Evolution Machine with DPLM-Evo
Author: Xinyou Wang, Liang Hong, Jiasheng Ye, Zaixiang Zheng, Yu Li, Shujian Huang, Quanquan Gu
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.00182v3 Announce Type: replace Abstract: Proteins are shaped by gradual evolution under biophysical and functional constraints. Protein language models learn rich evolutionary constraints from large-scale sequences, and discrete diffusion-based protein language models~(\eg, DPLMs) are pro...
305. Stochastic Sparse Attention for Memory-Bound Inference
Author: Kyle Lee, Corentin Delacour, Kevin Callahan-Coray, Kyle Jiang, Can Yaras, Samet Oymak, Tathagata Srimani, Kerem Y. Camsari
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.DC
arXiv:2605.01910v2 Announce Type: replace Abstract: Autoregressive decoding becomes bandwidth-limited at long contexts, as generating each token requires reading all $n_k$ key and value vectors from KV cache. We present Stochastic Additive No-mulT Attention (SANTA), a method that sparsifies value-ca...
306. Efficiently Aligning Language Models with Online Natural Language Feedback
Author: Christine Ye, Joe Benton
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.04356v2 Announce Type: replace Abstract: Reinforcement learning with verifiable rewards has been used to elicit impressive performance from language models in many domains. But, broadly beneficial deployments of AI may require us to train models with strong capabilities in "fuzzy", hard-t...
307. A Systematic Investigation of RL-Jailbreaking in LLMs
Author: Montaser Mohammedalamen, Kevin Roice, Reginald McLean, Alyssa Lefaivre \v{S}kopac
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.07032v2 Announce Type: replace Abstract: The evolution of generative models from next-token predictors to autonomous engines of complex systems necessitates rigorous safety hardening. Adversarial jailbreaking, the strategic manipulation of models to elicit harmful output, remains a primar...
308. Curated Synthetic Data Doesn't Have to Collapse: A Theoretical Study of Generative Retraining with Pluralistic Preferences
Author: Ali Falahati, Mohammad Mohammadi Amiri, Kate Larson, Lukasz Golab
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.07724v2 Announce Type: replace Abstract: Recursive retraining of generative models poses a critical representation challenge: when synthetic outputs are curated based on a fixed reward signal, the model tends to collapse onto a narrow set of outputs that over-optimize that objective. Prio...
309. FactoryNet: A Large-Scale Dataset toward Industrial Time-Series Foundation Models
Author: Karim Othman, Jonas Petersen, Matei Ignuta-Ciuncanu, Camilla Mazzoleni, Federico Martelli, Alessandro Lombardi, Riccardo Maggioni, Philipp Petersen
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.09081v4 Announce Type: replace Abstract: We introduce the first universal pretraining corpus for industrial time-series data: FactoryNet. 51M datapoints across 23k end-to-end task executions (13.3k real, 9.8k synthetic) on six embodiments, unified by a shared schema that enables robust ze...
310. HEPA: A Self-Supervised Horizon-Conditioned Event Predictive Architecture for Time Series
Author: Jonas Petersen, Gian-Alessandro Lombardi, Riccardo Maggioni, Camilla Mazzoleni, Federico Martelli, Philipp Petersen
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.11130v4 Announce Type: replace Abstract: Critical events in multivariate time series, from turbine failures to cardiac arrhythmias, demand accurate prediction, yet labeled data is scarce because such events are rare and costly to annotate. We introduce HEPA (Horizon-conditioned Event Pred...
311. Widening the Gap: Exploiting LLM Quantization via Outlier Injection
Author: Xiaohua Zhan, Kazuki Egashira, Robin Staab, Mark Vero, Martin Vechev
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.15152v2 Announce Type: replace Abstract: LLM quantization has become essential for memory-efficient deployment. Recent work has shown that quantization schemes can pose critical security risks: an adversary may release a model that appears benign in full precision but exhibits malicious b...
312. Position: State-of-the-Art Claims Require State-of-the-Art Evidence
Author: YongKyung Oh
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.17273v3 Announce Type: replace Abstract: State-of-the-Art (SOTA) claims pervade Artificial Intelligence (AI) and Machine Learning (ML) research. These claims rest on benchmark evaluations, where models are ranked by aggregate scores across tasks. Public benchmarks or leaderboards are the ...
313. ZeroUnlearn: Few-Shot Knowledge Unlearning in Large Language Models
Author: Yujie Lin, Chengyi Yang, Zhishang Xiang, Yiping Song, Jinsong Su
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CL
arXiv:2605.18879v3 Announce Type: replace Abstract: Large language models inevitably retain sensitive information, defined as inputs that may induce harmful generations, due to training on massive web corpora, raising concerns for privacy and safety. Existing machine unlearning methods primarily rel...
314. FedMental: Evaluating Federated Learning for Mental Health Detection from Social Media Data
Author: Nuredin Ali Abdelkadir, Anjali Ratnam, Zeerak Talat, Stevie Chancellor
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.CL
arXiv:2605.18936v2 Announce Type: replace Abstract: Social media text data are often used to train Machine Learning (ML) models to identify users exhibiting high-risk mental health behaviors. However, sharing this sensitive data poses privacy risks and limits the growth of benchmark datasets. We com...
315. CASCADE Conformal Prediction: Uncertainty-Adaptive Prediction Intervals for Two-Stage Clinical Decision Support
Author: Ricardo Diaz-Rincon, Muxuan Liang, Adolfo Ramirez-Zamora, Benjamin Shickel
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, stat.ME, stat.ML
arXiv:2605.20468v2 Announce Type: replace Abstract: Effective medication management in Parkinson's Disease (PD) is challenging due to heterogeneous disease progression, variable patient response, and medication side effects. While AI models can forecast levodopa equivalent daily dose (LEDD) as a mea...
316. REFLECTOR: Internalizing Step-wise Reflection against Indirect Jailbreak
Author: Jiachen Ma, Jiawen Zhang, Xiangtian Li, Bo Zou, Chaochao Lu, Chao Yang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.20654v2 Announce Type: replace Abstract: While Large Language Models (LLMs) demonstrate remarkable capabilities, they remain susceptible to sophisticated, multi-step jailbreak attacks that circumvent conventional surface-level safety alignment by exploiting the internal generation process...
317. Ternary Decision Trees with Locally-Adaptive Uncertainty Zones
Author: William Smits
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.22740v2 Announce Type: replace Abstract: Decision trees assign identical confidence to instances near and far from each split threshold. We introduce ternary decision trees, which augment each split node with an uncertainty zone of half-width delta. A decision-theoretic framework characte...
318. Learning to Evaluate: Cost-Effective Model Evaluation on Unlabeled Data with Meta-Learning
Author: Trinh Pham, Viet Huynh, Hongzhi Yin, Quoc Viet Hung Nguyen, Thanh Tam Nguyen
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CV, cs.ET, cs.PF
arXiv:2605.23595v2 Announce Type: replace Abstract: The rapid advancement of machine learning has led to an unprecedented expansion of model ecosystems, making it increasingly difficult to assess the reliability of newly released models on unseen and unlabeled data. Existing evaluation pipelines typ...
319. Treatment Effect Estimation with Differentiated Networked Effect on Graph Data
Author: Xiaofeng Lin, Han Bao, Hisashi Kashima
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2605.24358v4 Announce Type: replace Abstract: Estimating individual treatment effect (ITE) from observational graph data is crucial for decision-making in the fields such as commerce and medicine. This task is challenging due to interference, where individual outcomes can be influenced by the ...
320. The Perception-Physics Paradox: Probing Scientific Alignment with TC-Bench
Author: Dingling Yao, Andrea Polesello, Adeel Pervez, Caroline Muller, Francesco Locatello
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2605.24782v2 Announce Type: replace Abstract: While Vision Foundation Models (VFMs) excel at predictive tasks on satellite imagery, their performance can arise from visual correlations rather than underlying structural invariants, making even perception-based out-of-distribution accuracy a poo...
321. LoopFM: Learning frOm HistOrical RePresentations of Foundation Model for Recommendation
Author: Shali Jiang, Hua Zheng, Boyang Liu, Laming Chen, Kenny Lov, Chuanqi Xu, Lisang Ding, Qinghai Zhou, Can Cui, Xiaolong Liu, Xiaoyi Liu, Yasmine Badr, Xin Xu, Jiyan Yang, Ellie Dingqiao Wen, Gerard Jonathan Mugisha Akkerhuis, Chenxiao Guan, Rong Jin, Ruichao Qiu, Xian Chen, Shifu Xu, Zhehui Zhou, Ping Chen, Rui Yang, Haicheng Chen, Xiangge Meng, Song Zhou, Dharak Kharod, Shuyu Xu, Qiang Jin, Qiao Yang, Wankun Zhu, Qin Huang, Yuzhen Huang, Darren Liu, Parish Aggarwal, Hui Zhou, Erzhuo Wang, Shuo Chang, Xiaorui Gan, Wenlin Chen, Santanu Kolay, Huayu Li
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.IR
arXiv:2605.29280v2 Announce Type: replace Abstract: Knowledge distillation (KD) transfers a single scalar prediction from a large foundation model (FM) to compact vertical models (VMs), suffering from diminishing transfer ratio -- the fraction of FM improvement captured by the VM -- as a single scal...
322. Trust Region On-Policy Distillation
Author: Xingrun Xing, Haoqing Wang, Boyan Gao, Ziheng Li, Yehui Tang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.CL
arXiv:2606.01249v2 Announce Type: replace Abstract: On-Policy Distillation (OPD) is a fundamental technique for efficient post-training of large language models (LLMs), with broad applications in agent learning, multi-task enhancement, and model compression. However, OPD training becomes unstable wh...
323. CART: Context-Anchored Recurrent Transformer -- A Parameter-Efficient Architecture with Learned Stability
Author: Chad A. Capps
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.CL
arXiv:2606.01495v2 Announce Type: replace Abstract: We present CART (Context-Anchored Recurrent Transformer), a parameter-efficient language model that reuses a single shared core block R times across depth. Unlike prior looped transformers that recompute key-value tensors at every iteration, CART c...
324. Adaptive Auto-Harness: Sustained Self-Improvement for Agentic System Deployment on Open-Ended Task Streams
Author: Zewen Liu, Zhan Shi, Yisi Sang, Bing He, Minhua Lin, Tianxin Wei, Dakuo Wang, Benoit Dumoulin, Wei Jin, Hanqing Lu
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.01770v2 Announce Type: replace Abstract: Auto-harness systems such as A-Evolve, GEPA, and Meta-Harness improve LLM agents by optimizing prompts, skills, tools, memories, and supporting infrastructure from execution feedback, but they are typically evaluated on fixed offline benchmarks. Re...
325. EEG-FuseFormer: A Transformer-Driven Feature Fusion Framework for Seizure Onset Prediction
Author: Vigneshwar Hariharan, Chithra Reghuvaran, Arlene John, Nhat Pham, Omer Rana, Deepu John, Ganesh Neelakanta Iyer
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.02166v2 Announce Type: replace Abstract: Epilepsy is one of the most common neurological disorders globally, characterized by recurring seizures and significantly impacting the quality of life. Despite advancements in diagnostic techniques, the mitigation of risks faced by epilepsy patien...
326. Drifting Preference Optimization for One-Step Generative Models
Author: Zhou Jiang, Yandong Wen, Zhen Liu
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.CV
arXiv:2606.02521v3 Announce Type: replace Abstract: One-step text-to-image generators are attractive for deployment because they generate an image with a single forward pass, but preference finetuning them remains difficult: standard alignment methods often rely on policy likelihoods, denoising traj...
327. Anomalies in Multivariate Time Series Benchmarks Are Mostly Univariate
Author: Marc Pinet, Julien Cumin, Samuel Berlemont, Dominique Vaufreydaz
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.02670v2 Announce Type: replace Abstract: Many recent multivariate time series anomaly detection (MTSAD) models incorporate cross-channel modeling, under the implicit assumption that the structure of anomalies may be spread across multiple channels. We evaluate this assumption on eight wid...
328. Scalable Uncertainty Quantification for Extreme Weather Forecasting via Empirical Neural Tangent Kernels
Author: Jose Marie Antonio Mi~noza, Rex Gregor Laylo, Sebastian C. Iba~nez
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI, cs.CE, math.PR, physics.ao-ph
arXiv:2606.02886v2 Announce Type: replace Abstract: Deep learning weather models now match numerical weather prediction accuracy while running orders of magnitude faster, but produce deterministic forecasts without uncertainty estimates, a critical gap for high-stakes decisions during extreme weathe...
329. Flicker-DDPM: Accelerating Denoising Diffusion via 1/f Colored Noise Injection
Author: KeXiang Mao, FanCheng Li
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.03393v2 Announce Type: replace Abstract: We propose a novel diffusion model, Flicker-DDPM, which incorporates flicker (1/f) noise inspired by self-organized criticality (SOC), a widely observed phenomenon in natural systems. Unlike denoising diffusion probabilistic models (DDPMs), which e...
330. AnchorMoE: Interpretable Time Series Classification via Anchor-Routed MoE
Author: Tao Xie, Zexi Tan, Haoyi Xiao, Mengke Li, Yiqun Zhang, Yang Lu, Cuie Yang, Yiu-ming Cheung
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.03631v2 Announce Type: replace Abstract: Multivariate time series classification (MTSC) is pivotal in high-stakes domains, such as clinical diagnosis and industrial fault detection, where safe deployment necessitates transparent decision-making. However, isolating the temporal segments th...
331. Denoise First, Orthogonalize Later: Understanding Momentum in Muon via Spectral Filtering
Author: Xianliang Li, Zihan Zhang, Weiyang Liu, Han Bao
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG
arXiv:2606.03899v2 Announce Type: replace Abstract: Muon has recently demonstrated strong empirical performance in large language model training, but the theoretical role of momentum in Muon remains unclear. Existing analyses of Muon either remove momentum to study spectral updates in isolation, or ...
332. q0: Primitives for Hyper-Epoch Pretraining
Author: Bishwas Mandal, Shmuel Berman, Akshay Vegesna, Samip Dahal
Published: 6/5/2026, 4:00:00 AM
Categories: cs.LG, cs.AI
arXiv:2606.03938v2 Announce Type: replace Abstract: Multi-epoch training is becoming the standard now that compute is growing faster than the supply of high-quality text. But pretraining a single model saturates within a few passes, long before the compute budget is exhausted. We argue this calls fo...
333. Reducing the Filtering Effect in Public School Admissions: A Bias-aware Analysis for Targeted Interventions
Author: Yuri Faenza, Swati Gupta, Aapeli Vuorinen, Xuan Zhang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CY, cs.LG
arXiv:2004.10846v5 Announce Type: replace-cross Abstract: Problem definition: Traditionally, New York City's top 8 public schools have selected candidates solely based on their scores in the Specialized High School Admissions Test (SHSAT). These scores are known to be impacted by socioeconomic statu...
334. From Live to Recording: Consumer Demand and Response to Price Across the Livestreaming Lifecycle
Author: Ziwei Cong, Jia Liu, Puneet Manchanda
Published: 6/5/2026, 4:00:00 AM
Categories: stat.ML, cs.LG, econ.GN, q-fin.EC, stat.AP
arXiv:2107.01629v3 Announce Type: replace-cross Abstract: Livestreaming has evolved into a thriving industry where creators can directly monetize and engage with their audiences and followers. In practice, creators and platforms typically concentrate their marketing efforts on the period leading up ...
335. Bagged Polynomial Regression and Neural Networks
Author: Sylvia Klosin, Jaume Vives-i-Bastida
Published: 6/5/2026, 4:00:00 AM
Categories: stat.ML, cs.LG, stat.ME
arXiv:2205.08609v3 Announce Type: replace-cross Abstract: Climate and environmental applications increasingly rely on high-dimensional prediction from remote sensing and other scientific data. Neural networks (NN) can deliver strong accuracy in these settings, but they are often hard to audit and ha...
336. AutoNumerics-Zero: Automated Discovery of State-of-the-Art Mathematical Functions
Author: Esteban Real, Mirko Rossini, Connal de Souza, Manav Garg, Moritz Firsching, Quoc V. Le, Yao Chen, Akhil Verghese, Ekin Dogus Cubuk, David H. Park
Published: 6/5/2026, 4:00:00 AM
Categories: cs.NE, cs.LG, cs.NA, math.NA
arXiv:2312.08472v2 Announce Type: replace-cross Abstract: Transcendental functions, such as the exponential, are central to scientific computing, yet they cannot be natively calculated by digital hardware. Instead, computers must approximate these functions by combining basic operations, such as ${...
337. CounterFace: A Synthetic Face Dataset for Fine-Grained Counterfactual Evaluation of Face Recognition Systems
Author: Guruprasad Viswanathan Ramesh, Ashish Hooda, Shimaa Ahmed, Harrison J Rosenberg, Ramya Korlakai Vinayak, Kassem Fawaz
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CV, cs.AI, cs.LG
arXiv:2407.13922v3 Announce Type: replace-cross Abstract: Face recognition (FR) systems are widely deployed in critical applications, making their reliability and robustness across diverse populations and conditions essential. Standard evaluation of FR systems typically relies on datasets such as LF...
338. Decentralized EM Algorithm for Gaussian Mixtures under Data Heterogeneity and Partial Labeling
Author: Xuetong Li, Shuyuan Wu, Bin Du, Hansheng Wang
Published: 6/5/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:2411.05591v2 Announce Type: replace-cross Abstract: We systematically study several network-based Expectation-Maximization (EM) algorithms for the Gaussian mixture model within decentralized federated learning (DFL). Our theoretical investigation shows that directly extending the classic EM al...
339. SSSD: Simply-Scalable Speculative Decoding
Author: Michele Marzollo, Jiawei Zhuang, Niklas Roemer, Niklas Zwingenberger, Lorenz K. M"uller, Lukas Cavigelli
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG
arXiv:2411.05894v3 Announce Type: replace-cross Abstract: Speculative Decoding has emerged as a popular technique for accelerating inference in Large Language Models. However, most existing approaches yield only modest improvements in production serving systems. Methods that achieve substantial spee...
340. LaVIDE: Language-Prompted Satellite Change Detection via Map-Image Alignment
Author: Shuguo Jiang, Fang Xu, Chuandong Liu, Hong Tan, Shengyang Li, Lei Yu, Wen Yang, Sen Jia, Gui-Song Xia
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CV, cs.AI, cs.LG
arXiv:2411.19758v2 Announce Type: replace-cross Abstract: Remote sensing change detection based on a map reference and an up-to-date image boosts timely observation of the Earth's surface when earlier images are lacking for comparison. However, the semantic gap between high-level map categories and ...
341. Local Clustering on Complex Graphs and Complex Hypergraphs
Author: Zihao Li, Dongqi Fu, Hengyu Liu, Jingrui He
Published: 6/5/2026, 4:00:00 AM
Categories: cs.SI, cs.DS, cs.LG
arXiv:2412.03008v2 Announce Type: replace-cross Abstract: Local/seeded clustering aims to find a compact cluster near the given starting instances. While most existing studies on graph clustering assume a discrete graph setting (i.e., unweighted, undirected graphs without self-loops), real-world gra...
342. Geometry-Preserving Encoder/Decoder in Latent Generative Models
Author: Wonjun Lee, Riley C. W. O'Neill, Dongmian Zou, Jeff Calder, Gilad Lerman
Published: 6/5/2026, 4:00:00 AM
Categories: math.NA, cs.LG, cs.NA
arXiv:2501.09876v3 Announce Type: replace-cross Abstract: Generative modeling aims to generate new data samples that resemble a given dataset. When using diffusion models for this task, one of the main challenges is solving the problem in the input space, which tends to be very high-dimensional. To ...
343. On the Relationship Between CoCoA and ADMM for Distributed Empirical Risk Minimization
Author: Runxiong Wu, Andi Wang
Published: 6/5/2026, 4:00:00 AM
Categories: math.OC, cs.LG, stat.ML
arXiv:2502.00470v3 Announce Type: replace-cross Abstract: Distributed empirical risk minimization (ERM) is often studied through two influential yet seemingly separate families of methods: CoCoA-type algorithms, derived from distributed dual coordinate ascent, and ADMM-type algorithms, derived from ...
344. Contextual Scenario Generation for Two-Stage Stochastic Programming
Author: David Islip, Roy H. Kwon, Sanghyeon Bae, Woo Chang Kim
Published: 6/5/2026, 4:00:00 AM
Categories: math.OC, cs.LG
arXiv:2502.05349v2 Announce Type: replace-cross Abstract: Two-stage stochastic programs (2SPs) are widely used for decision-making under uncertainty, but their practical deployment is often limited by the large number of scenarios needed to approximate the conditional distribution of uncertain outco...
345. Differentially Private Joint Independence Test
Author: Xingwei Liu, Yuexin Chen, Jin-Ting Zhang, Wangli Xu
Published: 6/5/2026, 4:00:00 AM
Categories: math.ST, cs.CR, cs.LG, stat.ME, stat.ML, stat.TH
arXiv:2503.18721v3 Announce Type: replace-cross Abstract: Identification of joint dependence among several random vectors plays an important role in many statistical applications, where the data may contain sensitive or confidential information. In this paper, we consider the $d$-variable Hilbert-Sc...
346. Longer Context, Deeper Thinking: Uncovering the Role of Long-Context Ability in Reasoning
Author: Wang Yang, Zirui Liu, Hongye Jin, Qingyu Yin, Vipin Chaudhary, Xiaotian Han
Published: 6/5/2026, 4:00:00 AM
Categories: cs.AI, cs.CL, cs.LG
arXiv:2505.17315v2 Announce Type: replace-cross Abstract: Recent language models exhibit strong reasoning capabilities, yet the influence of long-context capacity on reasoning remains underexplored. In this work, we hypothesize that current limitations in reasoning stem, in part, from insufficient l...
347. 100-LongBench: Are de facto Long-Context Benchmarks Literally Evaluating Long-Context Ability?
Author: Wang Yang, Hongye Jin, Shaochen Zhong, Song Jiang, Qifan Wang, Vipin Chaudhary, Xiaotian Han
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG
arXiv:2505.19293v2 Announce Type: replace-cross Abstract: Long-context capability is considered one of the most important abilities of LLMs, as a truly long context-capable LLM enables users to effortlessly process many originally exhausting tasks -- e.g., digesting a long-form document to find answ...
348. Scheduling in Queueing Systems with Uncertain and Evolving Holding Costs
Author: Caner Gocmen, Thodoris Lykouris, Deeksha Sinha, Wentao Weng
Published: 6/5/2026, 4:00:00 AM
Categories: cs.DS, cs.GT, cs.LG, cs.PF, math.PR
arXiv:2505.21331v2 Announce Type: replace-cross Abstract: In content moderation for social media platforms, the cost of delaying the review of a content is proportional to its view trajectory, which fluctuates and is apriori unknown. Motivated by such uncertain and evolving holding costs, we conside...
349. Geospatial Foundation Models to Enable Progress on Sustainable Development Goals
Author: Pedram Ghamisi, Weikang Yu, Xiaokang Zhang, Aldino Rizaldy, Jian Wang, Chufeng Zhou, Richard Gloaguen, Gustau Camps-Valls
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2505.24528v3 Announce Type: replace-cross Abstract: Foundation Models (FMs) are large-scale, pre-trained artificial intelligence (AI) systems that have revolutionized natural language processing and computer vision, and are now advancing geospatial analysis and Earth Observation (EO). They pro...
350. Neural Langevin Machine: a local asymmetric learning rule can be creative
Author: Zhendong Yu, Weizhong Huang, Haiping Huang
Published: 6/5/2026, 4:00:00 AM
Categories: q-bio.NC, cond-mat.dis-nn, cs.LG, cs.NE
arXiv:2506.23546v2 Announce Type: replace-cross Abstract: Fixed points of recurrent neural networks can be leveraged to store and generate information. These fixed points can be captured by the Boltzmann-Gibbs measure, which leads to neural Langevin dynamics that can be used to find them for generat...
351. Causal Multi-fidelity Surrogate Forward and Inverse Models for ICF Implosions
Author: Tyler E. Maltba, Ben S. Southworth, Jeffrey R. Haack, Marc L. Klasky
Published: 6/5/2026, 4:00:00 AM
Categories: physics.comp-ph, cs.LG
arXiv:2509.05510v3 Announce Type: replace-cross Abstract: Continued progress in inertial confinement fusion (ICF) requires solving inverse problems relating experimental observations to simulation input parameters, followed by design optimization. However, such high-dimensional dynamic PDE-constrain...
352. Flow Matching Calibration for Simulation-Based Inference under Model Misspecification
Author: Pierre-Louis Ruhlmann, Michael Arbel, Florence Forbes, Pedro L. C. Rodrigues
Published: 6/5/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:2509.23385v5 Announce Type: replace-cross Abstract: Simulation-based inference (SBI) is transforming experimental sciences by enabling parameter estimation in complex non-linear models from simulated data. A persistent challenge, however, is model misspecification. In a Bayesian setting, targe...
353. Constrained Adaptive Rejection Sampling
Author: Pawe{\l} Parys, Sairam Vaidya, Taylor Berg-Kirkpatrick, Loris D'Antoni
Published: 6/5/2026, 4:00:00 AM
Categories: cs.AI, cs.CL, cs.LG
arXiv:2510.01902v2 Announce Type: replace-cross Abstract: Language Models (LMs) are increasingly used in applications where generated outputs must satisfy strict semantic or syntactic constraints. Existing approaches to constrained generation fall along a spectrum: greedy constrained decoding method...
354. Platonic Transformers: A Solid Choice For Equivariance
Author: Mohammad Mohaiminul Islam, Rishabh Anand, David R. Wessels, Friso de Kruiff, Thijs P. Kuipers, Rex Ying, Clara I. S'anchez, Sharvaree Vadgama, Georg B"okman, Erik J. Bekkers
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CV, cs.AI, cs.LG, eess.IV
arXiv:2510.03511v3 Announce Type: replace-cross Abstract: While widespread, Transformers lack inductive biases for geometric symmetries common in science and computer vision. Existing equivariant methods often sacrifice the efficiency and flexibility that make Transformers so effective through compl...
355. Unifying Information-Theoretic and Pair-Counting Clustering Similarity
Author: Alexander J. Gates
Published: 6/5/2026, 4:00:00 AM
Categories: stat.ML, cs.IT, cs.LG, math.IT
arXiv:2511.03000v2 Announce Type: replace-cross Abstract: Comparing clusterings is central to evaluating unsupervised models, yet the many existing similarity measures can produce widely divergent, sometimes contradictory, evaluations. Clustering similarity measures are typically organized into two ...
356. Associating Healthcare Teamwork with Patient Outcomes for Predictive Analysis
Author: Hsiao-Ying Lu, Kwan-Liu Ma
Published: 6/5/2026, 4:00:00 AM
Categories: cs.SI, cs.CY, cs.LG
arXiv:2512.03296v2 Announce Type: replace-cross Abstract: Cancer treatment outcomes are influenced not only by clinical and demographic factors but also by the collaboration of healthcare teams. However, prior work has largely overlooked the potential role of human collaboration in shaping patient s...
357. A Latent Variable Framework for Scaling Laws in Large Language Models
Author: Peiyao Cai, Chengyu Cui, Felipe Maia Polo, Seamus Somerstep, Leshem Choshen, Mikhail Yurochkin, Yuekai Sun, Kean Ming Tan, Gongjun Xu
Published: 6/5/2026, 4:00:00 AM
Categories: stat.AP, cs.LG
arXiv:2512.06553v2 Announce Type: replace-cross Abstract: We propose a statistical framework built on latent variable modeling for scaling laws of large language models (LLMs). Our work is motivated by the rapid emergence of numerous new LLM families with distinct architectures and training strategi...
358. Design Space Exploration of DMA based Finer-Grain Compute Communication Overlap
Author: Shagnik Pal, Shaizeen Aga, Suchita Pati, Mahzabeen Islam, Lizy K. John
Published: 6/5/2026, 4:00:00 AM
Categories: cs.DC, cs.AR, cs.LG
arXiv:2512.10236v3 Announce Type: replace-cross Abstract: Modern ML workloads demand distributing training and inference across multiple GPUs. However, these parallelization techniques often suffer from exposed critical-path communication, leaving a potential 1.7x speedup on the table through comput...
359. Mid-Think: Training-Free Intermediate-Budget Reasoning via Token-Level Triggers
Author: Wang Yang, Debargha Ganguly, Xinpeng Li, Chaoda Song, Shouren Wang, Vikash Singh, Vipin Chaudhary, Xiaotian Han
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG
arXiv:2601.07036v2 Announce Type: replace-cross Abstract: Hybrid reasoning language models are commonly controlled through high-level Think/No-think instructions to regulate reasoning behavior, yet we found that such mode switching is largely driven by a small set of trigger tokens rather than the i...
360. Optimal Transport under Group Fairness Constraints
Author: Linus Bleistein, Mathieu Dagr'eou, Francisco Andrade, Thomas Boudou, Aur'elien Bellet
Published: 6/5/2026, 4:00:00 AM
Categories: stat.ML, cs.LG, math.ST, stat.TH
arXiv:2601.07144v3 Announce Type: replace-cross Abstract: Ensuring fairness in matching algorithms is a key challenge in allocating scarce resources and positions. Focusing on Optimal Transport (OT), we introduce a novel notion of group fairness requiring that the probability of matching two individ...
361. Outcome-Grounded Advantage Reshaping for Fine-Grained Credit Assignment in Mathematical Reasoning
Author: Ziheng Li, Liu Kang, Feng Xiao, Luxi Xing, Qingyi Si, Zhuoran Li, Weikang Gong, Deqing Yang, Yanghua Xiao, Hongcheng Guo
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CL, cs.LG
arXiv:2601.07408v2 Announce Type: replace-cross Abstract: Group Relative Policy Optimization (GRPO) has emerged as a promising critic-free reinforcement learning paradigm for reasoning tasks. However, standard GRPO employs a coarse-grained credit assignment mechanism that propagates group-level rewa...
362. Learning collision operators from plasma phase space data using differentiable simulators
Author: Diogo D. Carvalho, Pablo J. Bilbao, Warren B. Mori, Luis O. Silva, E. Paulo Alves
Published: 6/5/2026, 4:00:00 AM
Categories: physics.plasm-ph, cs.LG, physics.comp-ph
arXiv:2601.10885v2 Announce Type: replace-cross Abstract: We propose a methodology to infer collision operators from phase space data of plasma dynamics. Our approach combines a differentiable kinetic simulator, whose core component in this work is a differentiable Fokker-Planck solver, with a gradi...
363. Success Conditioning as Policy Improvement: The Optimization Problem Solved by Imitating Success
Author: Daniel Russo
Published: 6/5/2026, 4:00:00 AM
Categories: cs.AI, cs.LG, cs.SY, eess.SY, stat.ML
arXiv:2601.18175v2 Announce Type: replace-cross Abstract: A widely used technique for improving policies is success conditioning, in which one collects trajectories, identifies those that achieve a desired outcome, and updates the policy to imitate the actions taken along successful trajectories. Th...
364. On Forgetting and Stability of Score-based Generative models
Author: Stanislas Strasman, Gabriel Cardoso, Sylvain Le Corff, Vincent Lemaire, Antonio Ocello
Published: 6/5/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:2601.21868v2 Announce Type: replace-cross Abstract: Understanding the stability and long-time behavior of generative models is a fundamental problem in modern machine learning. This paper provides quantitative bounds on the sampling error of score-based generative models by leveraging stabilit...
365. Can Large Language Models Generalize Procedures Across Representations?
Author: Fangru Lin, Valentin Hofmann, Xingchen Wan, Weixing Wang, Zifeng Ding, Anthony G. Cohn, Janet B. Pierrehumbert
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CL, cs.LG
arXiv:2602.03542v2 Announce Type: replace-cross Abstract: Large language models (LLMs) are trained and tested extensively on symbolic representations such as code and graphs, yet real-world user tasks are often specified in natural language. To what extent can LLMs generalize across these representa...
366. The Cost of Learning Under Multiple Change Points
Author: Tomer Gafni, Garud Iyengar, Assaf Zeevi
Published: 6/5/2026, 4:00:00 AM
Categories: stat.ML, cs.LG
arXiv:2602.11406v2 Announce Type: replace-cross Abstract: We consider an online learning problem in environments with multiple change points. In contrast to the single change point problem that is widely studied using classical "high confidence" detection schemes, the multiple change point environme...
367. Drift-Diffusion Matching: Embedding dynamics in latent manifolds of asymmetric neural networks
Author: Ram'on Nartallo-Kaluarachchi, Renaud Lambiotte, Alain Goriely
Published: 6/5/2026, 4:00:00 AM
Categories: cond-mat.dis-nn, cond-mat.stat-mech, cs.LG, q-bio.NC
arXiv:2602.14885v2 Announce Type: replace-cross Abstract: Recurrent neural networks (RNNs) provide a theoretical framework for understanding computation in biological neural circuits, yet classical results, such as Hopfield's model of associative memory, rely on symmetric connectivity that restricts...
368. Path-conditioned training: a principled way to rescale ReLU neural networks
Author: Arthur Lebeurrier, Titouan Vayer, R'emi Gribonval
Published: 6/5/2026, 4:00:00 AM
Categories: stat.ML, cs.LG, math.OC
arXiv:2602.19799v2 Announce Type: replace-cross Abstract: Despite recent algorithmic advances, we still lack principled ways to leverage the well-documented rescaling symmetries in ReLU neural network parameters. While two properly rescaled weights implement the same function, the training dynamics ...
369. Plug-and-Play Diffusion Meets ADMM: Dual-Variable Coupling for Robust Medical Image Reconstruction
Author: Chenhe Du, Xuanyu Tian, Qing Wu, Muyu Liu, Jingyi Yu, Hongjiang Wei, Yuyao Zhang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CV, cs.LG, eess.IV
arXiv:2602.23214v2 Announce Type: replace-cross Abstract: Plug-and-Play diffusion prior (PnPDP) frameworks have emerged as a powerful paradigm for solving imaging inverse problems by treating pretrained generative models as modular priors. However, we identify a critical flaw in prevailing PnP solve...
370. Evaluating Zero-Shot and One-Shot Adaptation of Small Language Models in Leader-Follower Interaction
Author: Rafael R. Baptista, Andr'e de Lima Salgado, Ricardo V. Godoy, Marcelo Becker, Thiago Boaventura, Gustavo J. G. Lahr
Published: 6/5/2026, 4:00:00 AM
Categories: cs.HC, cs.AI, cs.LG, cs.RO, cs.SY, eess.SY
arXiv:2602.23312v3 Announce Type: replace-cross Abstract: Leader-follower interaction is an important paradigm in human-robot interaction (HRI). Yet, assigning roles in real time remains challenging for resource-constrained mobile and assistive robots. While large language models (LLMs) have shown p...
371. Beyond Pixel Histories: World Models with Persistent 3D State
Author: Samuel Garcin, Thomas Walker, Steven McDonagh, Tim Pearce, Hakan Bilen, Tianyu He, Kaixin Wang, Jiang Bian
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CV, cs.AI, cs.LG
arXiv:2603.03482v2 Announce Type: replace-cross Abstract: Interactive world models continually generate video by responding to a user's actions, enabling open-ended generation capabilities. However, existing models typically lack a 3D representation of the environment, meaning 3D consistency must be...
372. Few Tokens, Big Leverage: Preserving Safety Alignment by Constraining Safety Tokens during Fine-tuning
Author: Guoli Wang, Haonan Shi, Tu Ouyang, An Wang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CL, cs.LG
arXiv:2603.07445v2 Announce Type: replace-cross Abstract: Large language models (LLMs) often require fine-tuning (FT) to perform well on downstream tasks, but FT can induce safety-alignment drift even when the training dataset contains only benign data. Prior work shows that introducing a small frac...
373. Analysis-Driven Procedural Generation of an Engine Sound Dataset with Embedded Control Annotations
Author: Robin Doerfler, Lonce Wyse
Published: 6/5/2026, 4:00:00 AM
Categories: cs.SD, cs.LG, eess.AS
arXiv:2603.07584v2 Announce Type: replace-cross Abstract: Computational engine sound modeling is central to the automotive audio industry, particularly for active sound design applications and virtual prototyping. Emerging data-driven engine sound synthesis methods require large volumes of standardi...
374. Safety Under Scaffolding: How Evaluation Conditions Shape Measured Safety
Author: David Gringras
Published: 6/5/2026, 4:00:00 AM
Categories: cs.SE, cs.AI, cs.CL, cs.LG
arXiv:2603.10044v2 Announce Type: replace-cross Abstract: A safety score earned on a benchmark need not predict how the same model behaves once it is wrapped in an agentic scaffold the benchmark never tested. We ran six frontier models through four deployment configurations (direct API, ReAct, multi...
375. Quantum entanglement provides a competitive advantage in adversarial games
Author: Peiyong Wang, Kieran Hymas, James Quach
Published: 6/5/2026, 4:00:00 AM
Categories: quant-ph, cs.AI, cs.LG
arXiv:2603.10289v2 Announce Type: replace-cross Abstract: Whether uniquely quantum resources confer advantages in fully classical, competitive environments remains an open question. Competitive zero-sum reinforcement learning is particularly challenging, as success requires modelling dynamic interac...
376. Revisiting Model Stitching In the Foundation Model Era
Author: Zheda Mai, Ke Zhang, Fu-En Wang, Zixiao Ken Wang, Albert Y. C. Chen, Lu Xia, Min Sun, Wei-Lun Chao, Cheng-Hao Kuo
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CV, cs.AI, cs.LG
arXiv:2603.12433v3 Announce Type: replace-cross Abstract: Model stitching, connecting early layers of one model (source) to later layers of another (target) via a light stitch layer, has served as a probe of representational compatibility. Prior work finds that models trained on the same dataset rem...
377. On-the-fly Repulsion in the Contextual Space for Rich Diversity in Diffusion Transformers
Author: Omer Dahary, Benaya Koren, Daniel Garibi, Daniel Cohen-Or
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CV, cs.AI, cs.GR, cs.LG
arXiv:2603.28762v2 Announce Type: replace-cross Abstract: Modern Text-to-Image (T2I) diffusion models have achieved remarkable semantic alignment, yet they often suffer from a significant lack of variety, converging on a narrow set of visual solutions for any given prompt. This typicality bias prese...
378. Gradient estimators for parameter inference in discrete stochastic kinetic models
Author: Ludwig Burger, Annalena Kofler, Lukas Heinrich, Ulrich Gerland
Published: 6/5/2026, 4:00:00 AM
Categories: physics.comp-ph, cond-mat.stat-mech, cs.LG, physics.bio-ph, physics.chem-ph
arXiv:2604.02121v2 Announce Type: replace-cross Abstract: Stochastic kinetic models are ubiquitous in physics, yet inferring their parameters from experimental data remains challenging. For deterministic models, parameter inference often relies on gradients, which can be obtained efficiently through...
379. Attention-Based Sampler for Diffusion Language Models
Author: Yuyan Zhou, Kai Syun Hou, Weiyu Chen, James Kwok
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CL, cs.LG
arXiv:2604.08564v2 Announce Type: replace-cross Abstract: Auto-regressive models (ARMs) have established a dominant paradigm in language modeling. However, their strictly sequential sampling paradigm imposes fundamental constraints on both inference efficiency and modeling flexibility. To address th...
380. Policy Split: Incentivizing Dual-Mode Exploration in LLM Reinforcement with Dual-Mode Entropy Regularization
Author: Jiashu Yao, Heyan Huang, Daiqing Wu, Zeming Liu, Yuhang Guo
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG
arXiv:2604.11510v2 Announce Type: replace-cross Abstract: To encourage diverse exploration in reinforcement learning (RL) for large language models (LLMs) without compromising accuracy, we propose Policy Split, a novel paradigm that bifurcates the policy into normal and high-entropy modes with a hig...
381. Do LLMs Hold Their Values? MANTA: A Multi-Turn Adversarial Benchmark for Animal Welfare Reasoning
Author: Isabella Luong, Joyee Chen, Arturs Kanepajs, Jasmine Brazilek, Sankalpa Ghose, David Williams-King, Linh Le, Allen Lu
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CY, cs.AI, cs.LG
arXiv:2605.16301v2 Announce Type: replace-cross Abstract: Evaluating animal welfare reasoning in LLMs remains an open challenge despite rapid deployment in consumer and professional contexts where welfare considerations appear implicitly in everyday queries. Existing benchmarks such as AnimalHarmBen...
382. Markov Chain Decoders Overcome the Heavy-Tail Limitations of Lipschitz Generative Models
Author: Abdelhakim Ziani, Andras Horvath, Paolo Ballarini
Published: 6/5/2026, 4:00:00 AM
Categories: stat.ML, cs.AI, cs.LG
arXiv:2605.18931v2 Announce Type: replace-cross Abstract: Heavy-tailed distributions are prevalent in performance evaluation, network traffic, and risk modeling. This behavior poses a fundamental challenge for modern deep generative models. Standard Variational Autoencoders (VAEs) employ Gaussian de...
383. Neural Autoregressive Control Variates for the Quantum Monte Carlo Sign Problem
Author: Bei Qiao, Lei Wang
Published: 6/5/2026, 4:00:00 AM
Categories: cond-mat.str-el, cs.LG, physics.comp-ph
arXiv:2605.26814v2 Announce Type: replace-cross Abstract: We train a pair of autoregressive models to construct zero-mean control variates to mitigate the sign problem in quantum Monte Carlo simulations. The two autoregressive networks are confined to the positive- and negative-sign sectors with str...
384. Structured Prompt Optimization Meets Reinforcement Learning for Global and Local Interpretability over Complex Text
Author: Tianyang Zhou, Wenbo Chen, Pierre Jinghong Liang, Leman Akoglu
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG
arXiv:2605.29076v2 Announce Type: replace-cross Abstract: LLMs have advanced text classification, yet existing paradigms face a trade-off: supervised (label only) fine-tuning is scalable but offers limited reasoning on complex text and lacks broader model transparency, while discrete prompt optimiza...
385. No More K-means: Single-Stage Sparse Coding for Efficient Multi-Vector Retrieval
Author: Lixuan Guo, Yifei Wang, Tiansheng Wen, Aosong Feng, Stefanie Jegelka, Chenyu You
Published: 6/5/2026, 4:00:00 AM
Categories: cs.IR, cs.AI, cs.LG
arXiv:2605.30120v3 Announce Type: replace-cross Abstract: Multi-vector retrieval (MVR) models, exemplified by ColBERT, have established new benchmarks in retrieval accuracy by preserving fine-grained token-level interactions. However, this granularity imposes prohibitive storage and retrieval effici...
386. Equivariant Latent Alignment via Flow Matching under Group Symmetries
Author: Sunghyun Kim, Jaehoon Hahm, Jeongwoo Shin, Joonseok Lee
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2605.30705v2 Announce Type: replace-cross Abstract: Geometry-aware generative models and novel view synthesis approaches have shown strong potential in visual fidelity and consistency. In parallel, equivariant representation learning has emerged as a powerful framework for constructing latent ...
387. LastAct: Trajectory-Guided Latest-Activity Localization for Real-Time Smart-Home Activity Recognition
Author: Zishuai Liu, Ruili Fang, Jin Lu, Fei Dou
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2606.00260v2 Announce Type: replace-cross Abstract: Human Activity Recognition (HAR) from ambient sensors enables smart-home applications such as health monitoring and assisted living. In realistic deployments, however, sensor events arrive as a continuous stream and activity boundaries are un...
388. SHARP: Sleep-based Hierarchical Accelerated Replay for Long Range Non-Stationary Temporal Pattern Recognition
Author: Jayanta Dey, Shikhar Srivastava, Itamar Lerner, Christopher Kanan, Dhireesha Kudithipudi
Published: 6/5/2026, 4:00:00 AM
Categories: cs.AI, cs.LG
arXiv:2606.00732v2 Announce Type: replace-cross Abstract: Learning long-range non-stationary temporal patterns remains a core challenge for modern sequence models, particularly in strict streaming settings. In these settings, data arrive sequentially and must be processed in a single pass without si...
389. PaCX-MAE: Physiology-Augmented Chest X-Ray Masked Autoencoder
Author: Yancheng Liu, Kenichi Maeda, Manan Pancholy
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2606.01537v2 Announce Type: replace-cross Abstract: Clinical diagnosis often requires combining imaging with physiological measurements, yet deployed models typically operate on unimodal data. We present PaCX-MAE, a cross-modal distillation framework that injects physiological priors into ches...
390. ProtoAda: Prototype-Guided Adaptive Adapter Expansion and Geometric Consolidation for Multimodal Continual Instruction Tuning
Author: Yu-Cheng Shi, Zhen-Hao Xie, Jun-Tao Tang, Da-Wei Zhou
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CV, cs.LG
arXiv:2606.02576v2 Announce Type: replace-cross Abstract: Multimodal Large Language Models (MLLMs) achieve strong performance through instruction tuning, but real-world deployment requires them to continually acquire new vision-language capabilities, making Multimodal Continual Instruction Tuning (M...
391. P$^2$-DPO: Grounding Hallucination in Perceptual Processing via Calibration Direct Preference Optimization
Author: Ruipeng Zhang, Zhihao Li, Haozhang Yuan, C. L. Philip Chen, Tong Zhang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CV, cs.AI, cs.CL, cs.LG
arXiv:2606.03376v2 Announce Type: replace-cross Abstract: Hallucination has recently garnered significant research attention in Large Vision-Language Models (LVLMs). Direct Preference Optimization (DPO) aims to learn directly from the corrected preferences provided by humans, thereby addressing the ...
392. PerchRL: Vision-Based Agile Perching on Inclined Platforms under Rapid and Irregular Motion
Author: Zihong Lu, Zongzhuo Liu, Huaxu Li, Jinqiang Cui, Jie Mei, Youmin Gong, U Kei Cheang, Boyu Zhou
Published: 6/5/2026, 4:00:00 AM
Categories: cs.RO, cs.LG
arXiv:2606.03441v2 Announce Type: replace-cross Abstract: Autonomous vision-based perching of quadrotors on moving inclined platforms is critical for air-ground collaboration but remains challenging due to the limited field of view (FOV). In this paper, we propose PerchRL, a reinforcement learning (...
393. A 3D Isovist World Model -- Revealing a City's Unseen Geometry and Its Emergent Cross-City Signature
Author: Xuhui Lin, Stephen Law, Nanjiang Chen, Kunyao Li, Tao Yang
Published: 6/5/2026, 4:00:00 AM
Categories: cs.RO, cs.LG
arXiv:2606.03609v2 Announce Type: replace-cross Abstract: Embodied agents that navigate cities rely on world models that predict how their surroundings will change as they move. But for navigation, what matters is not what the buildings look like; it is where the agent can go. Most world models none...
394. Qwen-Image-Flash: Beyond Objective Design
Author: Tianhe Wu, Kun Yan, Zikai Zhou, Lihan Jiang, Jiahao Li, Jie Zhang, Kaiyuan Gao, Ningyuan Tang, Shengming Yin, Xiaoyue Chen, Xiao Xu, Yilei Chen, Yuxiang Chen, Yan Shu, Yixian Xu, Yanran Zhang, Zihao Liu, Zhendong Wang, Zekai Zhang, Deqing Li, Liang Peng, Yi Wang, Jingren Zhou, Chenfei Wu
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CV, cs.AI, cs.GR, cs.LG
arXiv:2606.03746v2 Announce Type: replace-cross Abstract: Few-step distillation has become an effective strategy for accelerating advanced visual generative models, yet prior work has largely focused on distillation objectives. In this work, we revisit few-step distillation from a complementary pers...
395. Synthesize and Reward -- Reinforcement Learning for Multi-Step Tool Use in Live Environments
Author: Ibrahim Abdelaziz, Asim Munawar, Kinjal Basu, Maxwell Crouse, Chulaka Gunasekara, Suneet Katrekar, Pavan Kapanipathi
Published: 6/5/2026, 4:00:00 AM
Categories: cs.CL, cs.AI, cs.LG
arXiv:2606.03892v2 Announce Type: replace-cross Abstract: Training LLMs to orchestrate multi-step tool calls is held back by three coupled obstacles: realistic stateful execution environments are costly to build, synthetic training queries are often detached from the server's actual state (so the ge...