arXiv cs.LG - 2026-06-02

936 items collected.

1. BitsMoE: Efficient Spectral Energy-Guided Bit Allocation for MoE LLM Quantization

Author: Jiayu Zhao, Zihan Teng, Minhao Fan, Tianrui Ma, Wentao Ren, Song Chen, Weichen Liu
Published: 6/2/2026, 4:00:00 AM
Categories: cs.LG, cs.AI

arXiv:2606.00079v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) large language models reduce per-token computation through sparse expert activation, but their deployment remains memory-intensive because all expert weights must be kept resident in memory. Existing MoE compression methods str...

arXiv cs.LG - 2026-06-02 ​

1. BitsMoE: Efficient Spectral Energy-Guided Bit Allocation for MoE LLM Quantization ​

2. DAStatFormer: A Hybrid Multibranch Transformer with Statistical Feature Integration for DAS-Based Pattern Recognitions ​

3. Hoeffding Concept Bottleneck Models with Applications to Overhead Images ​

4. From Demonstrations to Rewards: Test-Time Prompt Optimization for VLM Reward Models ​

5. A Shared Valence Axis Across Modern LLMs and Human EEG: The Saturation Regularity ​

6. Automatically Differentiable Nonlinear Tensor Networks (ADNTNs) for Exponential Compression of Deep Neural Networks ​

7. Foundation-Preserving Adaptation via Generalized Rayleigh-Quotient Optimization ​

8. World Models: A Comprehensive Survey of Architectures, Methodologies, Reasoning Paradigms, and Applications ​

9. On Effectiveness and Efficiency of Agentic Tool-calling and RL Training ​

10. Generative AI and Digital Ecosystem Resilience: A Proactive Lifecycle-Based Survey ​

11. Geometric Erasure by Contrastive Velocity Matching in Rectified Flows ​

12. Adaptive data selection improves wearable prediction under low baseline performance ​

13. BudgetDraft: Acceptance-Aware Multi-View Training for Sparse-KV Speculative Decoding ​

14. RAFT: Data Refinement and Adaptive Distillation for Domain Fine-Tuning with Alleviated Forgetting ​

15. Emergence of Exploration in Policy Gradient Reinforcement Learning via Retrying ​

16. ChurnNet: A Optimized Modern AI for Churn Prediction ​

17. Beyond Augmentation: Score-Guided Pathological Prior for EEG-based Depression Detection ​

18. Agentic Transformers Provably Learn to Search via Reinforcement Learning ​

19. AI-Guided Design and Optimization of Graphite-Based Anodes via Iterative Experimental Feedback ​

20. Learning to Construct Practical Agentic Systems ​

21. BAGEN: Are LLM Agents Budget-Aware? ​

22. From Rashomon Theory to PRAXIS: Efficient Decision Tree Rashomon Sets ​

23. Quantized Reasoning Models Think They Need to Think Longer, but They Do Not ​

24. LithoGRPO: Fast Inverse Lithography via GRPO Reinforced Flow Matching ​

25. A Pre-Training Analogue of Grokking in Language Models: Tracing Delayed Grammatical Generalization ​

26. InfoAtlas: A Foundation Model for Zero-Shot Statistical Dependence Estimate ​

27. ARCA: Adapter-Residual Credit Assignment When Token Signals Degenerate ​

28. When Softmax Fails at the Top: Extreme Value Corrections for InfoNCE ​

29. Inner Product Aware Quantization: Provably Fast, Accurate, and Adaptive Algorithms ​

30. Accurate Large-sample Uncertainty Quantification using Stochastic Gradient Markov Chain Monte Carlo ​

31. Adaptive Order Policies for Masked Diffusion ​

32. FLaG: Fine-Grained Latent Grouping for Hallucination Detection ​

33. Modeling Spectral Energy Shifts in Spatio-Temporal Graph Anomaly Detection ​

34. Rethinking the Role of Temperature in Large Language Model Distillation ​

35. Large-scale Uncertainty Quantification for Latent Variable Models Using Subsampling Markov Chain Monte Carlo ​

36. Adversarially Robust Control of Conditional Value-at-Risk via Rockafellar-Uryasev Conformal Inference ​

37. Perturbative methods for non-parametric instrumental variable ​

38. KG-Guard: Graph-Based Hallucination Detection for Knowledge Base Question Answering ​

39. CHAM-net: A Contrastive Hierarchical Adaptive Meta-network for Robust Global Methane Flux Prediction ​

40. Balancing Learning Rates Across Layers: Exact Two-Step Dynamics and Optimal Scaling in Linear Neural Networks ​

41. ROGUE: Misaligned Agent Behavior Arising from Ordinary Computer Use ​

42. PE-means: Improved Differentially Private $k$-means Clustering through Private Evolution ​

43. The role of class encoding in neural collapse ​

44. Longitudinal Multimodal Sensing of Physical Activity and Well-Being in Older Adults ​

45. (HB-ARFM) History-Bootstrapped Flow Matching for Inverse Boiling Reconstruction ​

46. Drift Q-Learning ​

47. GLENS: Global Search via Learning from Solver Iterates with Diffusion Models ​

48. Reinforcement Learning with Pairwise Preferences in Long-Term Decision Problems ​

49. How Much Orthogonalization Does Muon Need? ​

50. CRMA: A Spectrally-Bounded Backbone for Modular Continual Fine-Tuning of LLMs ​

51. Detector-Evasive LLM Paraphrasing via Constrained Policy Optimization ​

52. PR2: Predictive Routing Replay for MoE-Based LLM Reinforcement Learning ​

53. Multi-Objective Reference-Aligned Machine Unlearning ​

54. Dynamic Proxy-Mixing: Transferring Replay Controllers from Small to Large Models for Continual Instruction Tuning ​

55. Auditing Near-Optimal Policies Can Be Exponentially Hard: Conditional Query Lower Bounds via Occupancy Rashomon Capacity ​

56. Canonicalized Stable-List Replay for Private Federated Continual Learning over Language-Model Embeddings ​

57. Topology-Aware State Abstraction with Tangle Cores for Markov Decision Processes ​

58. Finer Parameter Steps for Low-Rank PEFT: A Controlled Study with CP Tensor Adapters ​

59. Variance-sensitive Thompson sampling for generalised linear bandits, revisited ​

60. Grounded Decoding: Retrieval-Anchored Probability Fusion for Faithful RAG ​

61. EST-PRM: Stress-Testing Process Reward Models Before They Become Load-Bearing ​

62. Exploiting weight-space symmetries for approximating curvature ​

63. ProjQ: Project-and-Quantize for Adapter-Aware LLM Compression ​

64. Torus Graphs for Large Scale Neural Phase Analysis ​

65. TabChange: Precise Attribute Changes in Tabular Data ​

66. Saliency-Aware Model Merging ​

67. Semi-Supervised Learning with Noisy Proxy Covariates: Generalization Bounds and Distribution Regression ​

68. Generate in Reconstruction Space, Match in Semantic Space: Transport Geometry for One-Step Generation ​

69. DREAM-S: Speculative Decoding with Searchable Drafting and Target-Aware Refinement for Multimodal Generation ​

70. GNMR: Runtime Stability Control for Low-Precision Large Language Model Training ​

71. Rethinking Bregman Divergences in Kronecker-Factored Optimizers ​

72. Escaping the Mode Lottery: Multi-Response Training Improves Language Model Generalization ​

73. The Assistant as a Privileged Persona: A canonical reference in cross-persona self-recognition ​

74. Normalized Relevance Measure as a Unifying Framework to Explain Neural Network Latent Structures ​

75. Semi-Supervised Noise Adaptation: Transferring Knowledge from Noise Domain ​

76. Richer Representations for Neural Algorithmic Reasoning via Auxiliary Reconstruction ​

77. Interpretable Policy Distillation for Power Grid Topology Control ​

78. A Practical Upper Bound on Selection Bias Effects in Medical Prediction Models ​

79. Same Payload, Different Channel: Measuring Trust Asymmetry in Tool-Using Language Models ​

arXiv cs.LG - 2026-06-02

1. BitsMoE: Efficient Spectral Energy-Guided Bit Allocation for MoE LLM Quantization

2. DAStatFormer: A Hybrid Multibranch Transformer with Statistical Feature Integration for DAS-Based Pattern Recognitions

3. Hoeffding Concept Bottleneck Models with Applications to Overhead Images

4. From Demonstrations to Rewards: Test-Time Prompt Optimization for VLM Reward Models

5. A Shared Valence Axis Across Modern LLMs and Human EEG: The Saturation Regularity

6. Automatically Differentiable Nonlinear Tensor Networks (ADNTNs) for Exponential Compression of Deep Neural Networks

7. Foundation-Preserving Adaptation via Generalized Rayleigh-Quotient Optimization

8. World Models: A Comprehensive Survey of Architectures, Methodologies, Reasoning Paradigms, and Applications

9. On Effectiveness and Efficiency of Agentic Tool-calling and RL Training

10. Generative AI and Digital Ecosystem Resilience: A Proactive Lifecycle-Based Survey

11. Geometric Erasure by Contrastive Velocity Matching in Rectified Flows

12. Adaptive data selection improves wearable prediction under low baseline performance

13. BudgetDraft: Acceptance-Aware Multi-View Training for Sparse-KV Speculative Decoding

14. RAFT: Data Refinement and Adaptive Distillation for Domain Fine-Tuning with Alleviated Forgetting

15. Emergence of Exploration in Policy Gradient Reinforcement Learning via Retrying

16. ChurnNet: A Optimized Modern AI for Churn Prediction

17. Beyond Augmentation: Score-Guided Pathological Prior for EEG-based Depression Detection

18. Agentic Transformers Provably Learn to Search via Reinforcement Learning

19. AI-Guided Design and Optimization of Graphite-Based Anodes via Iterative Experimental Feedback

20. Learning to Construct Practical Agentic Systems

21. BAGEN: Are LLM Agents Budget-Aware?

22. From Rashomon Theory to PRAXIS: Efficient Decision Tree Rashomon Sets

23. Quantized Reasoning Models Think They Need to Think Longer, but They Do Not

24. LithoGRPO: Fast Inverse Lithography via GRPO Reinforced Flow Matching

25. A Pre-Training Analogue of Grokking in Language Models: Tracing Delayed Grammatical Generalization

26. InfoAtlas: A Foundation Model for Zero-Shot Statistical Dependence Estimate

27. ARCA: Adapter-Residual Credit Assignment When Token Signals Degenerate

28. When Softmax Fails at the Top: Extreme Value Corrections for InfoNCE

29. Inner Product Aware Quantization: Provably Fast, Accurate, and Adaptive Algorithms

30. Accurate Large-sample Uncertainty Quantification using Stochastic Gradient Markov Chain Monte Carlo

31. Adaptive Order Policies for Masked Diffusion

32. FLaG: Fine-Grained Latent Grouping for Hallucination Detection

33. Modeling Spectral Energy Shifts in Spatio-Temporal Graph Anomaly Detection

34. Rethinking the Role of Temperature in Large Language Model Distillation

35. Large-scale Uncertainty Quantification for Latent Variable Models Using Subsampling Markov Chain Monte Carlo

36. Adversarially Robust Control of Conditional Value-at-Risk via Rockafellar-Uryasev Conformal Inference

37. Perturbative methods for non-parametric instrumental variable

38. KG-Guard: Graph-Based Hallucination Detection for Knowledge Base Question Answering

39. CHAM-net: A Contrastive Hierarchical Adaptive Meta-network for Robust Global Methane Flux Prediction

40. Balancing Learning Rates Across Layers: Exact Two-Step Dynamics and Optimal Scaling in Linear Neural Networks

41. ROGUE: Misaligned Agent Behavior Arising from Ordinary Computer Use

42. PE-means: Improved Differentially Private $k$-means Clustering through Private Evolution

43. The role of class encoding in neural collapse

44. Longitudinal Multimodal Sensing of Physical Activity and Well-Being in Older Adults

45. (HB-ARFM) History-Bootstrapped Flow Matching for Inverse Boiling Reconstruction

46. Drift Q-Learning

47. GLENS: Global Search via Learning from Solver Iterates with Diffusion Models

48. Reinforcement Learning with Pairwise Preferences in Long-Term Decision Problems

49. How Much Orthogonalization Does Muon Need?

50. CRMA: A Spectrally-Bounded Backbone for Modular Continual Fine-Tuning of LLMs

51. Detector-Evasive LLM Paraphrasing via Constrained Policy Optimization

52. PR2: Predictive Routing Replay for MoE-Based LLM Reinforcement Learning

53. Multi-Objective Reference-Aligned Machine Unlearning

54. Dynamic Proxy-Mixing: Transferring Replay Controllers from Small to Large Models for Continual Instruction Tuning

55. Auditing Near-Optimal Policies Can Be Exponentially Hard: Conditional Query Lower Bounds via Occupancy Rashomon Capacity

56. Canonicalized Stable-List Replay for Private Federated Continual Learning over Language-Model Embeddings

57. Topology-Aware State Abstraction with Tangle Cores for Markov Decision Processes

58. Finer Parameter Steps for Low-Rank PEFT: A Controlled Study with CP Tensor Adapters

59. Variance-sensitive Thompson sampling for generalised linear bandits, revisited

60. Grounded Decoding: Retrieval-Anchored Probability Fusion for Faithful RAG

61. EST-PRM: Stress-Testing Process Reward Models Before They Become Load-Bearing

62. Exploiting weight-space symmetries for approximating curvature

63. ProjQ: Project-and-Quantize for Adapter-Aware LLM Compression

64. Torus Graphs for Large Scale Neural Phase Analysis

65. TabChange: Precise Attribute Changes in Tabular Data

66. Saliency-Aware Model Merging

67. Semi-Supervised Learning with Noisy Proxy Covariates: Generalization Bounds and Distribution Regression

68. Generate in Reconstruction Space, Match in Semantic Space: Transport Geometry for One-Step Generation

69. DREAM-S: Speculative Decoding with Searchable Drafting and Target-Aware Refinement for Multimodal Generation

70. GNMR: Runtime Stability Control for Low-Precision Large Language Model Training

71. Rethinking Bregman Divergences in Kronecker-Factored Optimizers

72. Escaping the Mode Lottery: Multi-Response Training Improves Language Model Generalization

73. The Assistant as a Privileged Persona: A canonical reference in cross-persona self-recognition

74. Normalized Relevance Measure as a Unifying Framework to Explain Neural Network Latent Structures

75. Semi-Supervised Noise Adaptation: Transferring Knowledge from Noise Domain

76. Richer Representations for Neural Algorithmic Reasoning via Auxiliary Reconstruction

77. Interpretable Policy Distillation for Power Grid Topology Control

78. A Practical Upper Bound on Selection Bias Effects in Medical Prediction Models

79. Same Payload, Different Channel: Measuring Trust Asymmetry in Tool-Using Language Models