arXiv cs.LG - 2026-05-27

410 items collected.

1. GEM: Geometric Entropy Mixing for Optimal LLM Data Curation

Author: Yue Min, Ziyun Qiao, Ruining Chen, Yujun Li
Published: 5/27/2026, 4:00:00 AM
Categories: cs.LG, cs.AI

arXiv:2605.26121v1 Announce Type: new Abstract: LLM pre-training efficacy increasingly depends on data composition rather than sheer volume. Yet, optimal mixing is hindered by categorization flaws: human taxonomies suffer from ontological misalignment, and Euclidean clustering fails to address embed...

arXiv cs.LG - 2026-05-27 ​

1. GEM: Geometric Entropy Mixing for Optimal LLM Data Curation ​

2. The Constraint Tax: Measuring Validity-Correctness Tradeoffs in Structured Outputs for Small Language Models ​

3. AirCast-SR: A Foundation Model for Kilometer-Scale Atmospheric Super-Resolution via Latent Consistency Diffusion ​

4. SilIF: Silhouette-Augmented Isolation Forest for Unsupervised Transaction Fraud Detection ​

5. Neural Bayesian Sequential Routing ​

6. TSFMAudit: Data Contamination Auditing in Forecasting Time Series Foundation Models ​

7. On the Push-Based Asynchronous Federated Learning: A Bias-Correction Aggregation Approach ​

8. Planning Neural Dynamics with Lie Group Embedding through Supervised Projective Manifold Learning ​

9. When Rule Violations Are Rare: Chimera Training for Logical Anomaly Detection ​

10. ARBITER: Reasoning Trajectory Basins and Majority Vote Failures in Test-Time Sampling ​

11. InfoQuant: Shaping Activation Distributions for Low-Bit LLM Quantization ​

12. GAC: Noise-Aware Adaptive Mixing for Hybrid SFT-RL Post-Training ​

13. Max-Window Scale Estimation for Near-Lossless HiF8 W8A8 Quantization-Aware Training ​

14. HRVConformer: Neonatal Hypoxic-Ischemic Encephalopathy Classification from the Heart Rate signals ​

15. Modeling Dynamic Mixtures of Time-Delay Systems from Streaming Time Series ​

16. Co-folding model guided by structural proteomics ​

17. Bridging Classification and Reconstruction: Cooperative Time Series Anomaly Detection ​

18. On the Role of Inductive Bias in Time-Series Pretraining: A Case Study in Learning Generalizable Representations for Clinical Time Series ​

19. From Privacy to Generalization: Linear Max-Information Bounds for DP-SGD ​

20. Provably Communication-Efficient and Privacy-Preserving Federated Graph Neural Networks ​

21. The Bridge-Garden Dilemma in LLM Distillation: Why Mixing Hard and Soft Labels Works ​

22. Unified Neural Scaling Laws ​

23. Quantized Keys Steal Attention: Bias Correction for KV-Cache Compression in Video Diffusion ​

24. Scaling World-Model Reinforcement Learning Through Diffusion Policy Optimization ​

25. Two-Parameter Flows for Learning Population Dynamics of Physical Systems ​

26. Stateful Inference for Low-Latency Multi-Agent Tool Calling ​

27. Dynamic Link Prediction with Temporally Enhanced Signed Graph Neural Networks ​

28. Classification and detection of multiple UAVs using rational Gaussian wavelet neural networks ​

29. Curriculum Learning for Safety Alignment ​

30. MULTISEISMO: A Multimodal Seismic Dataset and Model for Cross-Modal Seismic Understanding ​

31. Semigroup Consistency as a Diagnostic for Learned Physics Simulators ​

32. Reparametrizing Shampoo and SOAP for Subspace Basis Updates and BFloat16 Storage ​

33. QAM-W: Joint 2D Codebook Quantization for LLM Weights via Hadamard Rotation and Activation-Aware Scaling ​

34. A PAC-Bayesian View of Generalisation for Physics-Informed Machine Learning ​

35. MechRL: Reinforcement Learning Agents Perform Circuit Discovery for Mechanistic Interpretability ​

36. When Correct Demonstrations Hurt: Rethinking the Role of Exemplars in In-Context Learning ​

37. Energy-Gated Attention and Wavelet Positional Encoding: Complementary Inductive Biases for Transformer Attention ​

38. Balancing Plasticity and Stability with Fast and Slow Successor Features ​

39. Online Learning on Hidden-Convex Losses via Algorithmic Equivalence: Optimal Regret, Geometric Barrier, and Bandit Feedback ​

40. Function-Valued Causal Influence in Nonlinear Time Series ​

41. When Does Deep RL Beat Calibrated Baselines? A Benchmark Study on Adaptive Resource Control ​

42. Amortized Factor Inference Networks for Posterior Inference ​

43. FM-fMRI: Event Conditioned Flow Matching for Rest-to-Task fMRI Time-Series Synthesis ​

44. Aperiodic and Low-Frequency Spectral Bias in Reconstruction based EEG Foundation Models ​

45. DDGAD: Trajectory Dynamics for Diffusion-Based Graph Anomaly Detection ​

46. MuCon: Clipped Muon Updates for LLM Training ​

47. Diffuse to Detect: Generative Diffusion Models for Unsupervised IC Anomaly Detection ​

48. Variational Inference for Evidential Deep Learning ​

49. Extra-Merge: Tracing the Rank-1 Subspace of Model Merging in Language Model Pre-Training ​

50. The Stability of Singular Distribution: A Spectral Perspective on the Two-Phase Dynamics of Language Model Pre-training ​

51. Beyond Pairwise Preferences: Listwise Reward-Aware Alignment for Diffusion Models ​

52. Dense2MoE: Pushing the Pareto Frontier of On-Device LLMs via Unified Pruning and Upcycling ​

53. PRISM: Position-encoded Regressive Inverse Spectral Model for Multilayer Thin-Film Design ​

54. SIKA-GP: Accelerating Gaussian Process Inference with Sparse Inducing Kernel Approximations for Bayesian Deep Learning ​

55. Open-Weight LLM Fine-Tuning Defenses are Susceptible to Simple Attacks ​

56. Recursive Flow Matching ​

57. Aligning Few-Step Generative Models by Amortizing Sample-based Variational Inference ​

58. Linear and Neural Dueling Bandits with Delayed Feedback ​

59. Auditing and Fixing Economic Validity in Tabular Foundation Models for Discrete Choice ​

60. Beyond Holistic Models: Systematic Component-level Benchmarking of Deep Multivariate Time-Series Forecasting ​

61. Distribution-Aware Conformal Prediction: A Framework for generating efficient prediction intervals for time series ​

62. Separate Aggregation of Split Network for Personalized Federated Learning ​

63. Focal Reward: Balanced Reinforcement Learning under Rubric-Based Rewards ​

64. On the Error-Correcting Effects of Stochasticity in Discrete Diffusion ​

65. Near-Optimal Regret in Adversarial Kernel Bandits ​

66. Few-shot Cross-country Generalization of Tabular Machine Learning and Foundation Models for Childhood Anemia Prediction under Distribution Shift ​

67. Geometry-Aware Contrastive Learning for Few-Shot Automatic Modulation Recognition ​

68. Spend Your Rollouts Where It Counts: Rollout Allocation for Group-Based RL Post-Training ​

69. PIDM-DP: Physics-Informed Diffusion with Dormand-Prince Integration for Chaotic System Identification and State Reconstruction across Multiple Dynamical Regimes ​

70. RT-Lynx: Putting the GEMM Sparsity In a Right Way for Diffusion Models ​

71. More Expressive Feedforward Layers: Part I. Token-Adaptive Mixing of Activations ​

72. Bilevel Optimization over Saddle Points of Zero-Sum Markov Games ​

73. WINDQuant: Weight-Informed Neural Decision-Making for Global Mixed-Precision LLM Quantization ​

74. Beyond Trajectory-Level Attribution: Graph-Based Credit Assignment for Agentic Reinforcement Learning ​

75. Self-Improvement Imitation with Biologically Guided Search for Protein Design Under Oracle Budgets ​

76. Model Merging on Loss Landscape: A Geometry Perspective ​

77. SL-BiLEM: Structured Learnable Behavior-in-the-Loop Epidemic Modeling for Forecasting and Policy Evaluation ​

78. Image Feature Fusion-based Federated Client Unlearning (FCU) ​

79. MTL-FNO: A Lightweight Multi-Task Fourier Neural Operator for Sparse Field Reconstruction ​

arXiv cs.LG - 2026-05-27

1. GEM: Geometric Entropy Mixing for Optimal LLM Data Curation

2. The Constraint Tax: Measuring Validity-Correctness Tradeoffs in Structured Outputs for Small Language Models

3. AirCast-SR: A Foundation Model for Kilometer-Scale Atmospheric Super-Resolution via Latent Consistency Diffusion

4. SilIF: Silhouette-Augmented Isolation Forest for Unsupervised Transaction Fraud Detection

5. Neural Bayesian Sequential Routing

6. TSFMAudit: Data Contamination Auditing in Forecasting Time Series Foundation Models

7. On the Push-Based Asynchronous Federated Learning: A Bias-Correction Aggregation Approach

8. Planning Neural Dynamics with Lie Group Embedding through Supervised Projective Manifold Learning

9. When Rule Violations Are Rare: Chimera Training for Logical Anomaly Detection

10. ARBITER: Reasoning Trajectory Basins and Majority Vote Failures in Test-Time Sampling

11. InfoQuant: Shaping Activation Distributions for Low-Bit LLM Quantization

12. GAC: Noise-Aware Adaptive Mixing for Hybrid SFT-RL Post-Training

13. Max-Window Scale Estimation for Near-Lossless HiF8 W8A8 Quantization-Aware Training

14. HRVConformer: Neonatal Hypoxic-Ischemic Encephalopathy Classification from the Heart Rate signals

15. Modeling Dynamic Mixtures of Time-Delay Systems from Streaming Time Series

16. Co-folding model guided by structural proteomics

17. Bridging Classification and Reconstruction: Cooperative Time Series Anomaly Detection

18. On the Role of Inductive Bias in Time-Series Pretraining: A Case Study in Learning Generalizable Representations for Clinical Time Series

19. From Privacy to Generalization: Linear Max-Information Bounds for DP-SGD

20. Provably Communication-Efficient and Privacy-Preserving Federated Graph Neural Networks

21. The Bridge-Garden Dilemma in LLM Distillation: Why Mixing Hard and Soft Labels Works

22. Unified Neural Scaling Laws

23. Quantized Keys Steal Attention: Bias Correction for KV-Cache Compression in Video Diffusion

24. Scaling World-Model Reinforcement Learning Through Diffusion Policy Optimization

25. Two-Parameter Flows for Learning Population Dynamics of Physical Systems

26. Stateful Inference for Low-Latency Multi-Agent Tool Calling

27. Dynamic Link Prediction with Temporally Enhanced Signed Graph Neural Networks

28. Classification and detection of multiple UAVs using rational Gaussian wavelet neural networks

29. Curriculum Learning for Safety Alignment

30. MULTISEISMO: A Multimodal Seismic Dataset and Model for Cross-Modal Seismic Understanding

31. Semigroup Consistency as a Diagnostic for Learned Physics Simulators

32. Reparametrizing Shampoo and SOAP for Subspace Basis Updates and BFloat16 Storage

33. QAM-W: Joint 2D Codebook Quantization for LLM Weights via Hadamard Rotation and Activation-Aware Scaling

34. A PAC-Bayesian View of Generalisation for Physics-Informed Machine Learning

35. MechRL: Reinforcement Learning Agents Perform Circuit Discovery for Mechanistic Interpretability

36. When Correct Demonstrations Hurt: Rethinking the Role of Exemplars in In-Context Learning

37. Energy-Gated Attention and Wavelet Positional Encoding: Complementary Inductive Biases for Transformer Attention

38. Balancing Plasticity and Stability with Fast and Slow Successor Features

39. Online Learning on Hidden-Convex Losses via Algorithmic Equivalence: Optimal Regret, Geometric Barrier, and Bandit Feedback

40. Function-Valued Causal Influence in Nonlinear Time Series

41. When Does Deep RL Beat Calibrated Baselines? A Benchmark Study on Adaptive Resource Control

42. Amortized Factor Inference Networks for Posterior Inference

43. FM-fMRI: Event Conditioned Flow Matching for Rest-to-Task fMRI Time-Series Synthesis

44. Aperiodic and Low-Frequency Spectral Bias in Reconstruction based EEG Foundation Models

45. DDGAD: Trajectory Dynamics for Diffusion-Based Graph Anomaly Detection

46. MuCon: Clipped Muon Updates for LLM Training

47. Diffuse to Detect: Generative Diffusion Models for Unsupervised IC Anomaly Detection

48. Variational Inference for Evidential Deep Learning

49. Extra-Merge: Tracing the Rank-1 Subspace of Model Merging in Language Model Pre-Training

50. The Stability of Singular Distribution: A Spectral Perspective on the Two-Phase Dynamics of Language Model Pre-training

51. Beyond Pairwise Preferences: Listwise Reward-Aware Alignment for Diffusion Models

52. Dense2MoE: Pushing the Pareto Frontier of On-Device LLMs via Unified Pruning and Upcycling

53. PRISM: Position-encoded Regressive Inverse Spectral Model for Multilayer Thin-Film Design

54. SIKA-GP: Accelerating Gaussian Process Inference with Sparse Inducing Kernel Approximations for Bayesian Deep Learning

55. Open-Weight LLM Fine-Tuning Defenses are Susceptible to Simple Attacks

56. Recursive Flow Matching

57. Aligning Few-Step Generative Models by Amortizing Sample-based Variational Inference

58. Linear and Neural Dueling Bandits with Delayed Feedback

59. Auditing and Fixing Economic Validity in Tabular Foundation Models for Discrete Choice

60. Beyond Holistic Models: Systematic Component-level Benchmarking of Deep Multivariate Time-Series Forecasting

61. Distribution-Aware Conformal Prediction: A Framework for generating efficient prediction intervals for time series

62. Separate Aggregation of Split Network for Personalized Federated Learning

63. Focal Reward: Balanced Reinforcement Learning under Rubric-Based Rewards

64. On the Error-Correcting Effects of Stochasticity in Discrete Diffusion

65. Near-Optimal Regret in Adversarial Kernel Bandits

66. Few-shot Cross-country Generalization of Tabular Machine Learning and Foundation Models for Childhood Anemia Prediction under Distribution Shift

67. Geometry-Aware Contrastive Learning for Few-Shot Automatic Modulation Recognition

68. Spend Your Rollouts Where It Counts: Rollout Allocation for Group-Based RL Post-Training

69. PIDM-DP: Physics-Informed Diffusion with Dormand-Prince Integration for Chaotic System Identification and State Reconstruction across Multiple Dynamical Regimes

70. RT-Lynx: Putting the GEMM Sparsity In a Right Way for Diffusion Models

71. More Expressive Feedforward Layers: Part I. Token-Adaptive Mixing of Activations

72. Bilevel Optimization over Saddle Points of Zero-Sum Markov Games

73. WINDQuant: Weight-Informed Neural Decision-Making for Global Mixed-Precision LLM Quantization

74. Beyond Trajectory-Level Attribution: Graph-Based Credit Assignment for Agentic Reinforcement Learning

75. Self-Improvement Imitation with Biologically Guided Search for Protein Design Under Oracle Budgets

76. Model Merging on Loss Landscape: A Geometry Perspective

77. SL-BiLEM: Structured Learnable Behavior-in-the-Loop Epidemic Modeling for Forecasting and Policy Evaluation

78. Image Feature Fusion-based Federated Client Unlearning (FCU)

79. MTL-FNO: A Lightweight Multi-Task Fourier Neural Operator for Sparse Field Reconstruction