arXiv cs.LG - 2026-06-24

240 items collected.

1. Systematic Exploration of 4-Expert Heterogeneous Mixture-of-Experts via Automated Pipeline Search

Author: Yashkumar R Lukhi, Harsh Rameshbhai Moradiya, Radu Timofte, Dmitry Ignatov
Published: 6/24/2026, 4:00:00 AM
Categories: cs.LG, cs.CV, cs.SE

arXiv:2606.23739v1 Announce Type: new Abstract: We present an automated large-scale search pipeline for heterogeneous 4-Expert Mixture-of-Experts (MoE4) architectures within the LEMUR neural network dataset ecosystem. Building on a hand-crafted heterogeneous MoE reference model, we replace manual de...

arXiv cs.LG - 2026-06-24 ​

1. Systematic Exploration of 4-Expert Heterogeneous Mixture-of-Experts via Automated Pipeline Search ​

2. Weight-Space Geometry of Offline Reasoning Training ​

3. A Survey on Federated Causal Discovery and Inference ​

4. Low-power analogue neural networks with trainable nonlinear connections for continuous control ​

5. Synergizing Physically Constrained MCMC and Chemical-Informed Gaussian Processes for Reaction Network Discovery ​

6. Exploring Dualistic Meta-Learning to Enhance Domain Generalization in Open Set Scenarios ​

7. One Ruler: A Same-Hands Re-Evaluation of Bivariate Causal Direction on Tuebingen, with a Parameter-Free Compression Baseline ​

8. Deciphering Fingerprints of 3D Molecular Surfaces for Accurate Epitope Prediction ​

9. Reconstructing GRACE Terrestrial Water Storage with Spatio-Temporal Graph Neural Networks: An Application to South America ​

10. The Degeneracy Distillery ​

11. Machine Learning Modeling for Real-Time Melt Pool Monitoring in Laser Powder Bed Fusion Additive Manufacturing: A Hybrid Approach ​

12. Sesame: Structure-Aware Molecular Generation via Spatial Density-Map Conditioning ​

13. Are Safety Guarantees in Neural Networks Safe? How to Compute Trustworthy Robustness Certifications ​

14. Exact Schur-Sylvester Dimensionality Reductions for Non-Smooth Stochastic Complexity and Manifold Sampling ​

15. Federated Survival Analysis in Healthcare: A Multi-Model Evaluation on Cross-Institutional Heterogeneous Breast Cancer Data ​

16. MGI: Member vs Generated Inference ​

17. GRACE: Gated Refinement for Accurate Causal Edge Discovery in High-Dimensional Time Series ​

18. ARIA: Adaptive Region-Based Importance Allocation for Conditional Diffusion Distillation ​

19. Closing the Loop: Formally Verified Law as a Reward Signal for Self-Improving Legal AI ​

20. Catastrophic Compositional Generation: Why Vanilla Diffusion Models Fail to Extrapolate ​

21. KLip-PPO: A per-sample KL perspective on PPO-Clip ​

22. DREG: A Layer-Wise Jacobian Regularization as a General-Purpose Penalty ​

23. Learning the Koopman Operator using Attention Free Transformers ​

24. Forget Without Compromise: Nexus Sampling for Streaming KV-Cache Eviction Under Fixed Budgets ​

25. 3D Masked Autoencoders are Robust Learners of Volumetric and Multimodal Cellular Representations for Microscopy ​

26. A Comparative Study of Bayesian Contextual Bandits for Real-Time Warehouse Sorter Optimization ​

27. Offline Reinforcement Learning for Warehouse SLAM Throughput Control ​

28. Learning to Trigger: Reinforcement Learning at the Large Hadron Collider ​

29. EMAgnet: Parameter-Space EMA Regularization for Policy Gradient Self-Play in Large Games ​

30. Cyclic Denoising Reveals Ultrastable Memories in Diffusion Models ​

31. Fast and Slow Variational Continual Learning ​

32. You Don't Need to Run Every Eval ​

33. Information-Theoretic Classifier-Free Guidance with Adaptive Schedule Optimization ​

34. RoPE-Aware Bit Allocation for KV-Cache Quantization ​

35. Rapid FinFET Modelling Using an Autoencoder ​

36. RAVEN: A Regime-Aware Variable-context Expert Network for Financial Time Series Forecasting ​

37. Blockwise Policy-Drift Gating for On-Policy Distillation ​

38. NeuroSonic: Conditional Flow Matching for EEG-to-Speech Reconstruction ​

39. FedUP: One-Shot Federated Unlearning via Centroid-Guided Plug-in Filters ​

40. When Top-1 Fails: Calibrating LoRA Monitors for Masked Diffusion LMs ​

41. Holistic Data Scheduler for LLM Pre-training via Multi-Objective Reinforcement Learning ​

42. A Time-Reparameterized Cumulative Intensity Extrapolation Sampler for Discrete Flow Matching ​

43. AsyncOPD: How Stale Can On-Policy Distillation Be? ​

44. Lightweight Transformer Models for On-Device Fault Detection: A Benchmark Study on Resource-Constrained Deployment ​

45. Project Ariadne: Prompt-Conditioned Route Generation for Synthesis Planning ​

46. Managing Task Execution for Unknown Workloads in Batteryless IoT: A Hardware-Agnostic Evaluation ​

47. Parallel Manifold Steering: Efficient Adaptation of Large Associative Memories via Residual Energy Shaping ​

48. Natural Identifiers for Privacy and Data Audits in Large Language Models ​

49. Data Augmentation: A Fourier Analysis Perspective ​

50. An LLM-based Two-Stage Transformer Framework for Cross-Domain Bearing Fault Diagnosis with Limited Data ​

51. A Fair Evaluation of Graph Foundation Models for Node Property Prediction ​

52. Reasoning as Attractor Dynamics: Latent Memory Retrieval via Gibbs-Weighted Energy Minimization ​

53. QC-SMOTE: Quality-Controlled SMOTE for Imbalanced Classification ​

54. FlowPipe: LLM-Enhanced Conditional Generative Flow Networks for Data Preparation Pipeline Construction ​

55. Grad Detect: Gradient-Based Hallucination Detection in LLMs ​

56. Real vs. Complex Spectral Bases for Neural Operators: The Role of Green's Function Alignment ​

57. EnerInfer: Energy-Aware On-Device LLM Inference ​

58. Self-Recognition Finetuning can Prevent and Reverse Emergent Misalignment ​

59. Evaluating LLM Usage for Efficient and Explainable Numerical and Classified Implicit Sentiment Analysis of Product Desirability ​

60. Zero-Shot Neural Priors for Generalizable Cross-Subject and Cross-Task EEG Decoding ​

61. Coordinate-Queryable Neural Field Reconstruction for EEG Spatial Super-Resolution with Unseen-Electrode Generation ​

62. WiFi-Based People Counting Using Beam-Steerable Antennas: A Test-bed Study ​

63. Dimensionality Reduction of QAOA Parameter Space with Kernel PCA for Max-Cut ​

64. A Hybrid Quantum-Classical Approach for Melt Pool Prediction in Laser Powder Bed Fusion ​

65. Computational references are not experiments: pre-registered validation of machine-learned sodium-cathode voltages ​

66. Sol Video Inference Engine: Agent-Native Full-Stack Acceleration Framework for Efficient Video Generation ​

67. JEDEL: Zero-Shot DNA-Encoded Library Design for Early-Stage Drug Discovery ​

68. Verifiable Foundation Models for Robot Safety ​

69. Machine Learning and Deep Learning for Exoplanet Detection and Atmospheric Characterization with JWST and the Upcoming Ariel Mission ​

70. Hessian-augmented Supervised Learning for Hamilton-Jacobi-Bellman PDEs ​

71. Do LLM Attribution Metrics Transfer? Auditing Retrieval-Augmented Generation Evaluation Across Datasets and Constructs ​

72. Flow-Corrected Thompson Sampling for Non-Stationary Contextual Bandits ​

73. When Retrieval Metrics Mislead: Measuring Policy Signal in Long-Horizon Tool-Use Agents ​

74. Constrained Variable Projection for Structured Problems ​

75. Prediction of Viscoelastic Droplet Impact Dynamics Using a Vision Transformer-Based Approach ​

76. Stochastic Expectation Maximization for Robust State-Space Radio Interferometric Imaging ​

77. Does My Embedding Reflect That $A = B$? Evaluating Mathematical Equivalence in Embedding Models ​

78. Critique of Agent Model ​

79. RASC+: Retrieval-Constrained LLM Adjudication for Clinical Value Set Authoring ​

arXiv cs.LG - 2026-06-24

1. Systematic Exploration of 4-Expert Heterogeneous Mixture-of-Experts via Automated Pipeline Search

2. Weight-Space Geometry of Offline Reasoning Training

3. A Survey on Federated Causal Discovery and Inference

4. Low-power analogue neural networks with trainable nonlinear connections for continuous control

5. Synergizing Physically Constrained MCMC and Chemical-Informed Gaussian Processes for Reaction Network Discovery

6. Exploring Dualistic Meta-Learning to Enhance Domain Generalization in Open Set Scenarios

7. One Ruler: A Same-Hands Re-Evaluation of Bivariate Causal Direction on Tuebingen, with a Parameter-Free Compression Baseline

8. Deciphering Fingerprints of 3D Molecular Surfaces for Accurate Epitope Prediction

9. Reconstructing GRACE Terrestrial Water Storage with Spatio-Temporal Graph Neural Networks: An Application to South America

10. The Degeneracy Distillery

11. Machine Learning Modeling for Real-Time Melt Pool Monitoring in Laser Powder Bed Fusion Additive Manufacturing: A Hybrid Approach

12. Sesame: Structure-Aware Molecular Generation via Spatial Density-Map Conditioning

13. Are Safety Guarantees in Neural Networks Safe? How to Compute Trustworthy Robustness Certifications

14. Exact Schur-Sylvester Dimensionality Reductions for Non-Smooth Stochastic Complexity and Manifold Sampling

15. Federated Survival Analysis in Healthcare: A Multi-Model Evaluation on Cross-Institutional Heterogeneous Breast Cancer Data

16. MGI: Member vs Generated Inference

17. GRACE: Gated Refinement for Accurate Causal Edge Discovery in High-Dimensional Time Series

18. ARIA: Adaptive Region-Based Importance Allocation for Conditional Diffusion Distillation

19. Closing the Loop: Formally Verified Law as a Reward Signal for Self-Improving Legal AI

20. Catastrophic Compositional Generation: Why Vanilla Diffusion Models Fail to Extrapolate

21. KLip-PPO: A per-sample KL perspective on PPO-Clip

22. DREG: A Layer-Wise Jacobian Regularization as a General-Purpose Penalty

23. Learning the Koopman Operator using Attention Free Transformers

24. Forget Without Compromise: Nexus Sampling for Streaming KV-Cache Eviction Under Fixed Budgets

25. 3D Masked Autoencoders are Robust Learners of Volumetric and Multimodal Cellular Representations for Microscopy

26. A Comparative Study of Bayesian Contextual Bandits for Real-Time Warehouse Sorter Optimization

27. Offline Reinforcement Learning for Warehouse SLAM Throughput Control

28. Learning to Trigger: Reinforcement Learning at the Large Hadron Collider

29. EMAgnet: Parameter-Space EMA Regularization for Policy Gradient Self-Play in Large Games

30. Cyclic Denoising Reveals Ultrastable Memories in Diffusion Models

31. Fast and Slow Variational Continual Learning

32. You Don't Need to Run Every Eval

33. Information-Theoretic Classifier-Free Guidance with Adaptive Schedule Optimization

34. RoPE-Aware Bit Allocation for KV-Cache Quantization

35. Rapid FinFET Modelling Using an Autoencoder

36. RAVEN: A Regime-Aware Variable-context Expert Network for Financial Time Series Forecasting

37. Blockwise Policy-Drift Gating for On-Policy Distillation

38. NeuroSonic: Conditional Flow Matching for EEG-to-Speech Reconstruction

39. FedUP: One-Shot Federated Unlearning via Centroid-Guided Plug-in Filters

40. When Top-1 Fails: Calibrating LoRA Monitors for Masked Diffusion LMs

41. Holistic Data Scheduler for LLM Pre-training via Multi-Objective Reinforcement Learning

42. A Time-Reparameterized Cumulative Intensity Extrapolation Sampler for Discrete Flow Matching

43. AsyncOPD: How Stale Can On-Policy Distillation Be?

44. Lightweight Transformer Models for On-Device Fault Detection: A Benchmark Study on Resource-Constrained Deployment

45. Project Ariadne: Prompt-Conditioned Route Generation for Synthesis Planning

46. Managing Task Execution for Unknown Workloads in Batteryless IoT: A Hardware-Agnostic Evaluation

47. Parallel Manifold Steering: Efficient Adaptation of Large Associative Memories via Residual Energy Shaping

48. Natural Identifiers for Privacy and Data Audits in Large Language Models

49. Data Augmentation: A Fourier Analysis Perspective

50. An LLM-based Two-Stage Transformer Framework for Cross-Domain Bearing Fault Diagnosis with Limited Data

51. A Fair Evaluation of Graph Foundation Models for Node Property Prediction

52. Reasoning as Attractor Dynamics: Latent Memory Retrieval via Gibbs-Weighted Energy Minimization

53. QC-SMOTE: Quality-Controlled SMOTE for Imbalanced Classification

54. FlowPipe: LLM-Enhanced Conditional Generative Flow Networks for Data Preparation Pipeline Construction

55. Grad Detect: Gradient-Based Hallucination Detection in LLMs

56. Real vs. Complex Spectral Bases for Neural Operators: The Role of Green's Function Alignment

57. EnerInfer: Energy-Aware On-Device LLM Inference

58. Self-Recognition Finetuning can Prevent and Reverse Emergent Misalignment

59. Evaluating LLM Usage for Efficient and Explainable Numerical and Classified Implicit Sentiment Analysis of Product Desirability

60. Zero-Shot Neural Priors for Generalizable Cross-Subject and Cross-Task EEG Decoding

61. Coordinate-Queryable Neural Field Reconstruction for EEG Spatial Super-Resolution with Unseen-Electrode Generation

62. WiFi-Based People Counting Using Beam-Steerable Antennas: A Test-bed Study

63. Dimensionality Reduction of QAOA Parameter Space with Kernel PCA for Max-Cut

64. A Hybrid Quantum-Classical Approach for Melt Pool Prediction in Laser Powder Bed Fusion

65. Computational references are not experiments: pre-registered validation of machine-learned sodium-cathode voltages

66. Sol Video Inference Engine: Agent-Native Full-Stack Acceleration Framework for Efficient Video Generation

67. JEDEL: Zero-Shot DNA-Encoded Library Design for Early-Stage Drug Discovery

68. Verifiable Foundation Models for Robot Safety

69. Machine Learning and Deep Learning for Exoplanet Detection and Atmospheric Characterization with JWST and the Upcoming Ariel Mission

70. Hessian-augmented Supervised Learning for Hamilton-Jacobi-Bellman PDEs

71. Do LLM Attribution Metrics Transfer? Auditing Retrieval-Augmented Generation Evaluation Across Datasets and Constructs

72. Flow-Corrected Thompson Sampling for Non-Stationary Contextual Bandits

73. When Retrieval Metrics Mislead: Measuring Policy Signal in Long-Horizon Tool-Use Agents

74. Constrained Variable Projection for Structured Problems

75. Prediction of Viscoelastic Droplet Impact Dynamics Using a Vision Transformer-Based Approach

76. Stochastic Expectation Maximization for Robust State-Space Radio Interferometric Imaging

77. Does My Embedding Reflect That $A = B$? Evaluating Mathematical Equivalence in Embedding Models

78. Critique of Agent Model

79. RASC+: Retrieval-Constrained LLM Adjudication for Clinical Value Set Authoring