arXiv cs.LG - 2026-06-18

307 items collected.

1. Gaussian Mixture Attention: Linear-Time Sequence Mixing via Probabilistic Latent Routing

Author: Yongchao Huang, Hassan Raza
Published: 6/18/2026, 4:00:00 AM
Categories: cs.LG

arXiv:2606.18283v1 Announce Type: new Abstract: The dense token-to-token interaction pattern of standard dot-product attention remains a central bottleneck in scaling Transformer architectures to long contexts. We introduce \textbf{Gaussian Mixture Attention (GMA)}, a probabilistic attention-style s...

arXiv cs.LG - 2026-06-18 ​

1. Gaussian Mixture Attention: Linear-Time Sequence Mixing via Probabilistic Latent Routing ​

2. Breaking the Solver Bottleneck: Training Task Generators at the Learnable Frontier ​

3. CODEBLOCK: Learning to Supervise Code at the Right Granularity ​

4. Artemis: Anatomy-Resolved inTervention for Eliminating Multimodal NeuroImage confounderS ​

5. A Link between Shock-wave Theory and Symmetry-reduced Stochastic Gradient Descent for Artificial Neural Networks ​

6. Attribution-Guided and Coverage-Maximized Pruning for Structural MoE Compression ​

7. Fisher Width: A Geometric Measure of Complexity on Statistical Manifolds ​

8. DRIFT: Refining Instruction Data via On-Policy Data Attribution ​

9. TRIDENT: Breaking the Hybrid-Safety-Physics Coupling for Provably Safe Multi-Agent Reinforcement Learning ​

10. SAGE: Retain-Aware Post-Hoc Sanitization of Final Unlearning Vector ​

11. Ghost Attractor Networks: Basin-Structured Dynamical Decoders for Closed-Loop Sequential Generation ​

12. A Survey on Data-Driven Models for Soil Moisture Regression and Classification ​

13. Enhanced Graph Neural Networks using K-Hop Gaussian Diffusion ​

14. ASTRA: A Scalable Next-Generation ATCO Training Simulator with Autonomous Simpilots ​

15. SAE Interventions are Unreliable: Post-Intervention Recovery of Suppressed Behavior ​

16. Why SWAVE May Not Be All You Need:A Concept-Evolution Retrospective on Complex-Valued Recurrent Language Models ​

17. Neural Network Implementation of the Renormalization Group for Fault Diagnosis with Class Imbalance ​

18. Self-CTRL: Self-Consistency Training with Reinforcement Learning ​

19. ThousandWorlds: A benchmark for climate emulation of potentially habitable exoplanets ​

20. Do Time Series Foundation Model Benchmarks Hide Regime-Dependent Failures? Evidence from Traffic Speed Forecasting ​

21. From Sparse Features to Trustworthy Proxies: Certifying SAE-Based Interpretability ​

22. SCOPE-FL: A Strategy-proof Chain-based Optimal pareto efficient Federated Learning System ​

23. LLMZero: Discovering Adaptive Training Strategies for RL Post-Training via LLM Agents ​

24. MOLAR: Learning Multimodal Molecular Representations from Noisy Labels ​

25. P$^2$CE: Model-Agnostic Plausible Pareto-Optimal Counterfactual Explanations ​

26. Measurement noise limits the advantage of nonlinear models over linear models in biomedical prediction ​

27. Signature filtering: a lightweight enhancement for statistical watermark detection in large language models ​

28. Beyond Prediction: Tail-Aware Scheduling for LLM Inference ​

29. TMR-GGNN: Credit Card Fraud Detection based on Time-Aware Multi-Relational Guided Graph Neural Network ​

30. A Cross-Model VLM-Judge Protocol for Single-Image 3D Mesh Quality (and Why Cheap Proxies Fall Short) ​

31. Veriphi: Attack-Guided Neural Network Verification with Dataset-Dependent Training Methods ​

32. Task-Restricted Symmetries in Recurrent Weight Space ​

33. What Does the Weight Norm Control in Grokking? Logit-Scale Mediation under Cross-Entropy ​

34. Structured Representation Learning with Locally Linear Embeddings and Adaptive Feature Fusion ​

35. The Illusion of Improvement: Reject Inference Strategies in Credit Scoring ​

36. SFT Overtraining Predicts Rank Inversion via Entropy Collapse Under RLVR ​

37. Quantum Annealing Enhanced Reinforcement Learning for Accurate Remaining Useful Lifetime Prediction ​

38. Beyond AHI: An Interpretable Causal-Discovery-Guided Framework for Sleep Recovery in Connected Health ​

39. Concept Modulation Models: A Unified Framework for Identifiability and Extrapolation ​

40. PSyGenTAB: A Privacy-Preserving Framework for Synthetic Clinical Tabular Data Generation via Constrained Optimization ​

41. Sparsity Curse: Understanding RLVR Model Parameter Space from Model Merging ​

42. On the Residual Scaling of Looped Transformers: Stability and Transferability ​

43. Hierarchical Attention via Domain Decomposition ​

44. Do as the Romans Do: Learning Universal Behaviors from Heterogeneous Agents ​

45. Effects of sparsity and superposition on loss in simple autoencoders ​

46. TS-Fault: Benchmarking Time Series Forecasters Against Structural Faults ​

47. Correcting Sensor-Induced Distribution Drift with Wasserstein Adversarial Learning ​

48. Fair Cognitive Impairment Detection Through Unlearning ​

49. Towards Anomaly Detection on Relational Data ​

50. PACT: Preserving Anchored Cores in Task-vectors for Model Merging ​

51. MetaboNet-Bench: A Multi-modal Benchmark for Glucose Forecasting in Type 1 Diabetes ​

52. BLADE: Scalable Bi-level Adaptive Data Selection for LLM Training ​

53. scGTN: Deep Siamese Graph Transformer Network for Single-cell RNA Sequencing Clustering ​

54. InTrain: Intrinsic Trainability for Zero-Cost Neural Architecture Search ​

55. Bounded Context Management for Tabular Foundation Models on Stream Learning ​

56. Dual-Channel Grounded World Modeling (DCGWM): Structural Prevention of Objective Interference Collapse via Heterogeneous External Grounding with Inward-Only Gradient Flow ​

57. Robust and Interpretable Adaptation of Equivariant Materials Foundation Models via Sparsity-promoting Fine-tuning ​

58. Attention as Frustrated Synchronization ​

59. Stealthy World Model Manipulation via Data Poisoning ​

60. Contextualizing Biological Language Models across Modalities via Logit-Space Contrastive Alignment ​

61. Trainable Photonic Measurement for Physics-Informed PDE Learning ​

62. Graph Grounded Cross Attention Transformer Neural Network for Structurally Constrained Full Event Sequence Generation in Predictive Process Monitoring ​

63. Low-Cost Neuromorphic Fall Detection Using Synthetic Event Data and Hybrid SNNs ​

64. Private Learning with Public Feature Conditioning ​

65. RouteJudge: An Open Platform for Reproducible and Preference-Aware LLM Routing ​

66. Online Distributional Prediction via Latent Cluster Geometry Under Drift and Corruption ​

67. Bayesian Anytime Pareto Set Identification for Multi-Objective Multi-Armed Bandits ​

68. Learning from Own Solutions: Self-Conditioned Credit Assignment for Reinforcement Learning with Verifiable Rewards ​

69. Reinforcement Learning Foundation Models Should Already Be A Thing ​

70. Maturing Markov Decision Processes: Decision Making under Increasing Information and Shrinking Action Sets ​

71. GateMem: Benchmarking Memory Governance in Multi-Principal Shared-Memory Agents ​

72. Target-confidence Recourse Using tSeTlin machines: TRUST ​

73. Seed-Guided Semi-Supervised Clustering by A-Contrario Anomaly Detection ​

74. Identifying Structural Biases from Causal Mechanism Shifts ​

75. Semantic Robustness Certification for Vision-Language Models ​

76. Learning from Your Own Mistakes: Constructing Learnable Micro-Reflective Trajectories for Self-Distillation ​

77. Investigating Inductive Biases for Machine Learning Emulation of Sudden Stratospheric Warmings in Idealised Isca Simulations ​

78. Scaling Learning-based AEB with Massive Unlabeled Data ​

79. Strategic Feature Selection ​

arXiv cs.LG - 2026-06-18

1. Gaussian Mixture Attention: Linear-Time Sequence Mixing via Probabilistic Latent Routing

2. Breaking the Solver Bottleneck: Training Task Generators at the Learnable Frontier

3. CODEBLOCK: Learning to Supervise Code at the Right Granularity

4. Artemis: Anatomy-Resolved inTervention for Eliminating Multimodal NeuroImage confounderS

5. A Link between Shock-wave Theory and Symmetry-reduced Stochastic Gradient Descent for Artificial Neural Networks

6. Attribution-Guided and Coverage-Maximized Pruning for Structural MoE Compression

7. Fisher Width: A Geometric Measure of Complexity on Statistical Manifolds

8. DRIFT: Refining Instruction Data via On-Policy Data Attribution

9. TRIDENT: Breaking the Hybrid-Safety-Physics Coupling for Provably Safe Multi-Agent Reinforcement Learning

10. SAGE: Retain-Aware Post-Hoc Sanitization of Final Unlearning Vector

11. Ghost Attractor Networks: Basin-Structured Dynamical Decoders for Closed-Loop Sequential Generation

12. A Survey on Data-Driven Models for Soil Moisture Regression and Classification

13. Enhanced Graph Neural Networks using K-Hop Gaussian Diffusion

14. ASTRA: A Scalable Next-Generation ATCO Training Simulator with Autonomous Simpilots

15. SAE Interventions are Unreliable: Post-Intervention Recovery of Suppressed Behavior

16. Why SWAVE May Not Be All You Need:A Concept-Evolution Retrospective on Complex-Valued Recurrent Language Models

17. Neural Network Implementation of the Renormalization Group for Fault Diagnosis with Class Imbalance

18. Self-CTRL: Self-Consistency Training with Reinforcement Learning

19. ThousandWorlds: A benchmark for climate emulation of potentially habitable exoplanets

20. Do Time Series Foundation Model Benchmarks Hide Regime-Dependent Failures? Evidence from Traffic Speed Forecasting

21. From Sparse Features to Trustworthy Proxies: Certifying SAE-Based Interpretability

22. SCOPE-FL: A Strategy-proof Chain-based Optimal pareto efficient Federated Learning System

23. LLMZero: Discovering Adaptive Training Strategies for RL Post-Training via LLM Agents

24. MOLAR: Learning Multimodal Molecular Representations from Noisy Labels

25. P$^2$CE: Model-Agnostic Plausible Pareto-Optimal Counterfactual Explanations

26. Measurement noise limits the advantage of nonlinear models over linear models in biomedical prediction

27. Signature filtering: a lightweight enhancement for statistical watermark detection in large language models

28. Beyond Prediction: Tail-Aware Scheduling for LLM Inference

29. TMR-GGNN: Credit Card Fraud Detection based on Time-Aware Multi-Relational Guided Graph Neural Network

30. A Cross-Model VLM-Judge Protocol for Single-Image 3D Mesh Quality (and Why Cheap Proxies Fall Short)

31. Veriphi: Attack-Guided Neural Network Verification with Dataset-Dependent Training Methods

32. Task-Restricted Symmetries in Recurrent Weight Space

33. What Does the Weight Norm Control in Grokking? Logit-Scale Mediation under Cross-Entropy

34. Structured Representation Learning with Locally Linear Embeddings and Adaptive Feature Fusion

35. The Illusion of Improvement: Reject Inference Strategies in Credit Scoring

36. SFT Overtraining Predicts Rank Inversion via Entropy Collapse Under RLVR

37. Quantum Annealing Enhanced Reinforcement Learning for Accurate Remaining Useful Lifetime Prediction

38. Beyond AHI: An Interpretable Causal-Discovery-Guided Framework for Sleep Recovery in Connected Health

39. Concept Modulation Models: A Unified Framework for Identifiability and Extrapolation

40. PSyGenTAB: A Privacy-Preserving Framework for Synthetic Clinical Tabular Data Generation via Constrained Optimization

41. Sparsity Curse: Understanding RLVR Model Parameter Space from Model Merging

42. On the Residual Scaling of Looped Transformers: Stability and Transferability

43. Hierarchical Attention via Domain Decomposition

44. Do as the Romans Do: Learning Universal Behaviors from Heterogeneous Agents

45. Effects of sparsity and superposition on loss in simple autoencoders

46. TS-Fault: Benchmarking Time Series Forecasters Against Structural Faults

47. Correcting Sensor-Induced Distribution Drift with Wasserstein Adversarial Learning

48. Fair Cognitive Impairment Detection Through Unlearning

49. Towards Anomaly Detection on Relational Data

50. PACT: Preserving Anchored Cores in Task-vectors for Model Merging

51. MetaboNet-Bench: A Multi-modal Benchmark for Glucose Forecasting in Type 1 Diabetes

52. BLADE: Scalable Bi-level Adaptive Data Selection for LLM Training

53. scGTN: Deep Siamese Graph Transformer Network for Single-cell RNA Sequencing Clustering

54. InTrain: Intrinsic Trainability for Zero-Cost Neural Architecture Search

55. Bounded Context Management for Tabular Foundation Models on Stream Learning

56. Dual-Channel Grounded World Modeling (DCGWM): Structural Prevention of Objective Interference Collapse via Heterogeneous External Grounding with Inward-Only Gradient Flow

57. Robust and Interpretable Adaptation of Equivariant Materials Foundation Models via Sparsity-promoting Fine-tuning

58. Attention as Frustrated Synchronization

59. Stealthy World Model Manipulation via Data Poisoning

60. Contextualizing Biological Language Models across Modalities via Logit-Space Contrastive Alignment

61. Trainable Photonic Measurement for Physics-Informed PDE Learning

62. Graph Grounded Cross Attention Transformer Neural Network for Structurally Constrained Full Event Sequence Generation in Predictive Process Monitoring

63. Low-Cost Neuromorphic Fall Detection Using Synthetic Event Data and Hybrid SNNs

64. Private Learning with Public Feature Conditioning

65. RouteJudge: An Open Platform for Reproducible and Preference-Aware LLM Routing

66. Online Distributional Prediction via Latent Cluster Geometry Under Drift and Corruption

67. Bayesian Anytime Pareto Set Identification for Multi-Objective Multi-Armed Bandits

68. Learning from Own Solutions: Self-Conditioned Credit Assignment for Reinforcement Learning with Verifiable Rewards

69. Reinforcement Learning Foundation Models Should Already Be A Thing

70. Maturing Markov Decision Processes: Decision Making under Increasing Information and Shrinking Action Sets

71. GateMem: Benchmarking Memory Governance in Multi-Principal Shared-Memory Agents

72. Target-confidence Recourse Using tSeTlin machines: TRUST

73. Seed-Guided Semi-Supervised Clustering by A-Contrario Anomaly Detection

74. Identifying Structural Biases from Causal Mechanism Shifts

75. Semantic Robustness Certification for Vision-Language Models

76. Learning from Your Own Mistakes: Constructing Learnable Micro-Reflective Trajectories for Self-Distillation

77. Investigating Inductive Biases for Machine Learning Emulation of Sudden Stratospheric Warmings in Idealised Isca Simulations

78. Scaling Learning-based AEB with Massive Unlabeled Data

79. Strategic Feature Selection