arXiv cs.LG - 2026-07-09

271 items collected.

1. TriRoute: Unified Learned Routing for Joint Adaptive Attention, Experts, and KV-Cache Allocation

Author: Andrii Balashov, Olena Ponomarova
Published: 7/9/2026, 4:00:00 AM
Categories: cs.LG, cs.AI

arXiv:2607.06601v1 Announce Type: new Abstract: Conditional computation can decouple language model quality from per-token inference cost, yet leading techniques act on a single axis in isolation: Mixture-of-Experts (MoE) sparsifies the FFN, Mixture-of-Depths (MoD) skips whole transformer blocks, an...

arXiv cs.LG - 2026-07-09 ​

1. TriRoute: Unified Learned Routing for Joint Adaptive Attention, Experts, and KV-Cache Allocation ​

2. A Quiet Failure in Calibrated Virtual Screening: Marginal Conformal Prediction Under-Covers the Minority Class, and a Class-Conditional Fix Recovers It ​

3. NEST: Tackling Dataset-Level Distribution Shifts via Regime-Oriented Mixture-of-Experts ​

4. D2PO: Optimizing Diffusion Samplers via Dynamic Preference ​

5. Deep Reinforcement Learning for Reliability Based Bi-Objective Portfolio Optimization ​

6. STAGformer: A Spatio-temporal Agent Graph Transformer for Micro Mobility Demand Forecasting ​

7. WHERE to Generate Matters: Budget-Aware Synthetic Augmentation for Label Skewed Federated Learning ​

8. Inertia-1: An Open Exploration of Wearable Motion Foundation Models ​

9. Fingerprint, Not Blueprint: How Positional Schemes Set the Default Spectral Algebra of Attention ​

10. LLM-Guided Task-Semantic Field Factorization for Industrial Process Forecasting ​

11. Open-Ended Scenario Reasoning for Specialist Model Adaptation ​

12. Reward Valuation in Vision Language Models: Causal Mechanisms Underlying Anhedonia ​

13. Cross-Trajectory Chimera Interventions Reveal Dissociable Roles of Weight Magnitude and Direction in Grokking ​

14. STST-JEPA: Shallow-Target Spatio-Temporal Joint Embedding Prediction Architecture For EEG Self-Supervised Learning ​

15. When Certificates Fail: A Unified Safety Framework for Embedded Neural Interface Models ​

16. Does Demand Response Increase Vulnerability to Cyber Attacks by Adversarial Data Modifications? ​

17. When Do Geometric Algebra Layers Beat Scalarization? A Controlled Study on SO(3)-Equivariant Vector Laws ​

18. Optimized Instance Alteration for Explaining and Assessing Robustness of Classifiers ​

19. UASPL: Uncertainty-Aware Self-Paced Learning with Evidential Neural Networks ​

20. At-Grok Is Not Converged:A Measurement-Validity Audit for Grokking Representation Metrics ​

21. The Rank-One Corner: How Much Value Equivalence Does a Task Need from a World Model? ​

22. The Approximation Ratio for the Risk of Myopic Bayesian Active Learning for Linear Regression ​

23. Diffusion enabled Optimal Transport distances for graph matching ​

24. Final Checkpoints Are Not Enough: Analyzing Latent Reasoning Faithfulness Along Training Trajectories ​

25. Entropy-Guided Tensor Compression for Multimodal Federated Learning on Edge Devices ​

26. From Jumps to Signatures: a Generative Method for Temporal Point Processes ​

27. Dual Attention Heads for Personalized Federated Learning in ECG Classification ​

28. Robust Human-AI Complementarity under Uncertainty ​

29. Trees from Marginals: Autoregressive drafting with factorized priors ​

30. Efficient Long-Horizon Learning for Learned Optimization ​

31. Efficient Bayesian Deep Ensembles via Analytic Predictive Inference ​

32. On Explicit Super-Expressive Approximation for Neural Networks ​

33. Enhancing deep learning models for time series classification via knowledge distillation ​

34. What Predicts Correctness in Text-to-SQL? A Selective-Prediction Study ​

35. Generative Diffusion Models of Stochastic Graph Signals ​

36. LEMUR 2: Unlocking Neural Network Diversity for AI ​

37. A Gold-Standard Study of What Makes a Lightweight Game-Playing Agent Strong ​

38. Geometric Self-Distillation for Reasoning Generalization ​

39. Best-Arm Identification with Generative Proxy ​

40. Converge to Surprise: Evolutionary Self-supervised Image Clustering ​

41. Latency-Constrained DNN Architecture Learning for Edge Systems using Zerorized Batch Normalization ​

42. Intrinsic-Noise Consolidation: A Doob-Barrier-Conditioned Diffusion Turns Analog Device Noise into a Continual-Learning Resource ​

43. Imputation Meets Clustering: Exploiting Latent Subgroup Structure for Missing Data Recovery ​

44. Physical activities enable scalable foundation modelling for broad-spectrum health prediction ​

45. Rethinking Multimodal Time-Series Forecasting Evaluation ​

46. Hybrid Least Squares/Gradient Descent Methods for MIONets ​

47. Robust Federated Learning Under Real-World Client Churn ​

48. UP: Unbounded Positive Asymmetric Optimization for Breaking the Exploration-Stability Dilemma ​

49. Physics-guided spatiotemporal neural models for fuel density prediction ​

50. Dissociating the Internal Representations of Sycophancy in LLMs ​

51. Multimodal Spatiotemporal-Frequency Fusion with Peak Enhancement for Cellular Traffic Forecasting ​

52. Online Data Selection Is Implicit Alignment ​

53. Constrained Decoding for Diffusion Language Models via Efficient Inference over Finite Automata ​

54. Latent graph encoding of multimodal neuroimaging features with generative AI architectures ​

55. Gimitest: A Comprehensive Tool for Testing Reinforcement Learning Policies ​

56. Gauge-Invariant Learnable Spectral Positional Encodings for Directed Graphs via Hermitian Block Krylov Subspaces ​

57. Intrinsic Green's Learning: Supervised Learning on Manifolds via Inverse PDE ​

58. On the Principles of Deep Feedforward ReLU Networks ​

59. Complexity-Budgeted, Interaction-Aware Interpretable Model for Tabular Data ​

60. Multiplication Beyond Groups: Stratified Fourier Mechanisms in Transformer Circuits ​

61. An Hybrid Quantum-Classical Diffusion Model for Image Generation ​

62. Structural Adversarial Attacks on Relational Deep Learning under Integrity Constraints ​

63. A knowledge-augmented dataset of high-risk driving scenarios with LLM annotations for autonomous driving ​

64. Distributed Sparse Interventions in Language Models ​

65. Fractal KV-Cache Archives: Lossless Symbolic Storage with In-Place Retrieval for Long-Context LLM Inference ​

66. Prior-matched evaluation of operational Earth-observation classifiers: a three-number reporting method demonstrated on Sentinel-1 internal-wave detection ​

67. Information Allocation Dynamics in Neural Network Optimization ​

68. Entropy Pacing Policy Optimization for Multi-Task Agentic Reinforcement Learning ​

69. Predicting LLM Safety Before Release by Simulating Deployment ​

70. Geometric--Nongeometric Optimizer Calculus: A Modular Language for Reachable Gradient Methods ​

71. HPG-Diff: Hierarchical physics-guided diffusion with differentiable connectivity constraints for topology optimization ​

72. ORCAID: Oblique Rule-Based Continuous-Action Interpretation for Deep RL Policies ​

73. Safe Reinforcement Learning using Ideas from Model Predictive Control ​

74. FMMVCC: Fuzzy Mamba-based Multi-View Contrastive Clustering for Univariate Time Series ​

75. BubbleSH: A Dataset of Rising Bubbles with Deformable Interfaces ​

76. Nonlinear Bandit ​

77. FedCVESA: Taking Away Training Data in Federated Learning via Correlation Value Encoding and Segmented Aggregation ​

78. Mechanistic Interpretability for Neural Networks: Circuits, Sparse Features and Symbolic Reasoning ​

79. Hypergraph Neural Stochastic Diffusion: An SDE Framework for Uncertainty Estimation ​

arXiv cs.LG - 2026-07-09

1. TriRoute: Unified Learned Routing for Joint Adaptive Attention, Experts, and KV-Cache Allocation

2. A Quiet Failure in Calibrated Virtual Screening: Marginal Conformal Prediction Under-Covers the Minority Class, and a Class-Conditional Fix Recovers It

3. NEST: Tackling Dataset-Level Distribution Shifts via Regime-Oriented Mixture-of-Experts

4. D2PO: Optimizing Diffusion Samplers via Dynamic Preference

5. Deep Reinforcement Learning for Reliability Based Bi-Objective Portfolio Optimization

6. STAGformer: A Spatio-temporal Agent Graph Transformer for Micro Mobility Demand Forecasting

7. WHERE to Generate Matters: Budget-Aware Synthetic Augmentation for Label Skewed Federated Learning

8. Inertia-1: An Open Exploration of Wearable Motion Foundation Models

9. Fingerprint, Not Blueprint: How Positional Schemes Set the Default Spectral Algebra of Attention

10. LLM-Guided Task-Semantic Field Factorization for Industrial Process Forecasting

11. Open-Ended Scenario Reasoning for Specialist Model Adaptation

12. Reward Valuation in Vision Language Models: Causal Mechanisms Underlying Anhedonia

13. Cross-Trajectory Chimera Interventions Reveal Dissociable Roles of Weight Magnitude and Direction in Grokking

14. STST-JEPA: Shallow-Target Spatio-Temporal Joint Embedding Prediction Architecture For EEG Self-Supervised Learning

15. When Certificates Fail: A Unified Safety Framework for Embedded Neural Interface Models

16. Does Demand Response Increase Vulnerability to Cyber Attacks by Adversarial Data Modifications?

17. When Do Geometric Algebra Layers Beat Scalarization? A Controlled Study on SO(3)-Equivariant Vector Laws

18. Optimized Instance Alteration for Explaining and Assessing Robustness of Classifiers

19. UASPL: Uncertainty-Aware Self-Paced Learning with Evidential Neural Networks

20. At-Grok Is Not Converged:A Measurement-Validity Audit for Grokking Representation Metrics

21. The Rank-One Corner: How Much Value Equivalence Does a Task Need from a World Model?

22. The Approximation Ratio for the Risk of Myopic Bayesian Active Learning for Linear Regression

23. Diffusion enabled Optimal Transport distances for graph matching

24. Final Checkpoints Are Not Enough: Analyzing Latent Reasoning Faithfulness Along Training Trajectories

25. Entropy-Guided Tensor Compression for Multimodal Federated Learning on Edge Devices

26. From Jumps to Signatures: a Generative Method for Temporal Point Processes

27. Dual Attention Heads for Personalized Federated Learning in ECG Classification

28. Robust Human-AI Complementarity under Uncertainty

29. Trees from Marginals: Autoregressive drafting with factorized priors

30. Efficient Long-Horizon Learning for Learned Optimization

31. Efficient Bayesian Deep Ensembles via Analytic Predictive Inference

32. On Explicit Super-Expressive Approximation for Neural Networks

33. Enhancing deep learning models for time series classification via knowledge distillation

34. What Predicts Correctness in Text-to-SQL? A Selective-Prediction Study

35. Generative Diffusion Models of Stochastic Graph Signals

36. LEMUR 2: Unlocking Neural Network Diversity for AI

37. A Gold-Standard Study of What Makes a Lightweight Game-Playing Agent Strong

38. Geometric Self-Distillation for Reasoning Generalization

39. Best-Arm Identification with Generative Proxy

40. Converge to Surprise: Evolutionary Self-supervised Image Clustering

41. Latency-Constrained DNN Architecture Learning for Edge Systems using Zerorized Batch Normalization

42. Intrinsic-Noise Consolidation: A Doob-Barrier-Conditioned Diffusion Turns Analog Device Noise into a Continual-Learning Resource

43. Imputation Meets Clustering: Exploiting Latent Subgroup Structure for Missing Data Recovery

44. Physical activities enable scalable foundation modelling for broad-spectrum health prediction

45. Rethinking Multimodal Time-Series Forecasting Evaluation

46. Hybrid Least Squares/Gradient Descent Methods for MIONets

47. Robust Federated Learning Under Real-World Client Churn

48. UP: Unbounded Positive Asymmetric Optimization for Breaking the Exploration-Stability Dilemma

49. Physics-guided spatiotemporal neural models for fuel density prediction

50. Dissociating the Internal Representations of Sycophancy in LLMs

51. Multimodal Spatiotemporal-Frequency Fusion with Peak Enhancement for Cellular Traffic Forecasting

52. Online Data Selection Is Implicit Alignment

53. Constrained Decoding for Diffusion Language Models via Efficient Inference over Finite Automata

54. Latent graph encoding of multimodal neuroimaging features with generative AI architectures

55. Gimitest: A Comprehensive Tool for Testing Reinforcement Learning Policies

56. Gauge-Invariant Learnable Spectral Positional Encodings for Directed Graphs via Hermitian Block Krylov Subspaces

57. Intrinsic Green's Learning: Supervised Learning on Manifolds via Inverse PDE

58. On the Principles of Deep Feedforward ReLU Networks

59. Complexity-Budgeted, Interaction-Aware Interpretable Model for Tabular Data

60. Multiplication Beyond Groups: Stratified Fourier Mechanisms in Transformer Circuits

61. An Hybrid Quantum-Classical Diffusion Model for Image Generation

62. Structural Adversarial Attacks on Relational Deep Learning under Integrity Constraints

63. A knowledge-augmented dataset of high-risk driving scenarios with LLM annotations for autonomous driving

64. Distributed Sparse Interventions in Language Models

65. Fractal KV-Cache Archives: Lossless Symbolic Storage with In-Place Retrieval for Long-Context LLM Inference

66. Prior-matched evaluation of operational Earth-observation classifiers: a three-number reporting method demonstrated on Sentinel-1 internal-wave detection

67. Information Allocation Dynamics in Neural Network Optimization

68. Entropy Pacing Policy Optimization for Multi-Task Agentic Reinforcement Learning

69. Predicting LLM Safety Before Release by Simulating Deployment

70. Geometric--Nongeometric Optimizer Calculus: A Modular Language for Reachable Gradient Methods

71. HPG-Diff: Hierarchical physics-guided diffusion with differentiable connectivity constraints for topology optimization

72. ORCAID: Oblique Rule-Based Continuous-Action Interpretation for Deep RL Policies

73. Safe Reinforcement Learning using Ideas from Model Predictive Control

74. FMMVCC: Fuzzy Mamba-based Multi-View Contrastive Clustering for Univariate Time Series

75. BubbleSH: A Dataset of Rising Bubbles with Deformable Interfaces

76. Nonlinear Bandit

77. FedCVESA: Taking Away Training Data in Federated Learning via Correlation Value Encoding and Segmented Aggregation

78. Mechanistic Interpretability for Neural Networks: Circuits, Sparse Features and Symbolic Reasoning

79. Hypergraph Neural Stochastic Diffusion: An SDE Framework for Uncertainty Estimation