arXiv cs.LG - 2026-06-10

396 items collected.

1. Mechanistic Analysis of Alignment Algorithms in Language Models

Author: Aarush Sinha, Ishan Garg, Veeraraju Elluru, Arth Singh, Kushal Garg
Published: 6/10/2026, 4:00:00 AM
Categories: cs.LG, cs.CL

arXiv:2606.09850v1 Announce Type: new Abstract: Post-training alignment algorithms are predominantly evaluated as black boxes, obscuring how they reshape language models' internal computations. We present a systematic mechanistic analysis of six preference-optimization methods: PPO, DPO, SimPO, ORPO...

arXiv cs.LG - 2026-06-10 ​

1. Mechanistic Analysis of Alignment Algorithms in Language Models ​

2. SynIB: Informational Bottleneck for Maximizing Synergy in Multimodal Learning ​

3. Uncertainty-aware Multi-fidelity Closure via Conditional Normalizing Flows ​

4. Mitigating Manifold Departure: Uncertainty-Aware Subspace Rectification for Trustworthy MLLM Decoding ​

5. Conformal Risk Prediction for Non-Alcoholic Fatty Liver Disease Using Gradient Boosting with Distribution-Free Coverages ​

6. Time Series as Language: A Universal Tokenizer for General-Purpose Time Series Foundation Models ​

7. Blurry Window Attention ​

8. From Confident Closing to Silent Failure: Characterizing False Success in LLM Agents ​

9. Alignment Collapse Under KV Cache Quantization: Diagnosis and Mitigation ​

10. LLM-as-a-Discriminator: When Synthetic Tables Still Look Real ​

11. Two to Tango: Coupled Task-Reference Selection for Safe LLM Fine-tuning ​

12. SPACE: Source-free Proxy Anchor Concept Erasure for MLLMs ​

13. QSplitFL: Capability Aware Deep Q-Learning for Optimal Split Point Selection in Split Federated Learning ​

14. PatchSTG: Scalable Spatiotemporal Graph Transformers for Traffic Forecasting on Irregular Sensor Networks ​

15. Rotate2Think: Geometric Priming via Orthogonal Rotation to Improve Language Model Reasoning ​

16. Disjoint or Overlapping? Inference Windowing for Reconstruction-Based Time Series Anomaly Detection ​

17. Integrating Local and Global Entropy for Uncertainty Quantification in LLMs ​

18. Calibrating Overconfidence Without Sacrificing Confidence: Probe-Conditioned Head Intervention for LLMs ​

19. Streaming Knowledge Compilation: Proactive Materiality-Scored Pinning for Time-Evolving LLM Wikis ​

20. FailureScope: Cross-Regime Behavioral Diagnosis of Language Model Weaknesses ​

21. Operator Fusion for LLM Inference on the Tensix Architecture ​

22. Hyperparameter Learning for Latent Factorization of Tensors for Representation Learning to Large-scale Dynamic Weighted Directed Network ​

23. Toward Calibrated, Fair, and accurate Deepfake Detection ​

24. TD-Grokking: Learning from Zero-Reward Problems by Training-Time Decomposition ​

25. TENP: Trapezoidal Expert Neuron Pruning For Mixture-of-Experts ​

26. SHAPE: Coalition-Aware Expert Pruning for Sparse Mixture-of-Experts LLMs ​

27. SocraticPO: Policy Optimization via Interactive Guidance ​

28. SinkRec: Mitigating Semantic State Sink in Long Sequence Recommendation with Memory-Conditioned Gated Delta Networks ​

29. Optuna Constrained Tree-Structured Parzen Estimator Is a Joint Density Generalization of c-TPE ​

30. PreAct-Bench: Benchmarking Predictive Monitoring in LLMs ​

31. Representation Curriculum: Stagewise Training for Robust Ranking and Allocation ​

32. LMT: A Bayesian Framework for Causal Discovery from Textual Alarm Records in Manufacturing Systems ​

33. A Navigable Manifold of Hypothesized Consciousness-Spectrum States in Language Model Representations ​

34. TRAPS: Therapeutic Response Analysis via Pathway-informed Stratification ​

35. When Attribution Patching Lies: Diagnosis and a Second-Order Correction ​

36. LongMoE: Longitudinal Multimodal Learning via Trajectory-Aware Mixture-of-Experts ​

37. Mix, Don't Pick: Why Synthetic Corpus Composition Matters for Time Series Foundation Model Pretraining ​

38. IntentKV: Cross-Turn Intent-Aware KV Cache Pruning for Agent Inference ​

39. SPDM: Geometry-Modulated State Space Modeling with Manifold Constraints for Time Series Forecasting ​

40. Co-GLANCE: Uncertainty-Aware Active Perception for Heterogeneous Robot Teaming ​

41. Conformal Prediction for Neural Operators: Distribution-Free Uncertainty Quantification in Physics Simulation ​

42. Sigma-Branch: Hierarchical Single-Path Network Reconstruction for Dynamic Inference with Reduced Active Parameters ​

43. Sample Where You Struggle: Sharpening Base Model Reasoning via Entropy-Guided Power Sampling ​

44. Trainable Smooth-Rotation Transforms with Learned Channel Scales for LLM Quantization ​

45. Forward-Only Convolutional Neural Networks with Learnable Channel-Class Assignment ​

46. Between Amnesia and Chaos: A Memory Stability Expressivity Trilemma for Trainable Dissipative Oscillator Networks ​

47. When RL Fails after SFT: Rejuvenating Model Plasticity for Robust SFT-to-RL Handoff ​

48. nCMD: Benign-Anchored Feature Selection for Imbalanced Network Intrusion Detection ​

49. One Lens, Many Worlds : A Capability-Typed Interface for World-Model Interpretability ​

50. RKSC: Reasoning-Aware KV Cache Sharing and Confident Early Exit for Multi-Step LLM Inference ​

51. Interactions Between Crosscoder Features: A Compact Proofs Perspective ​

52. Learning Where to Simulate: Generative Active Sampling for Online PDE Surrogate Training ​

53. Integrating Out, Twice:The Open-System Case That Neural-Network Ensemble Theory Is Missing ​

54. Hasse Diagrams for Attention: A Partial Order Framework for Designing Transformer Masks ​

55. Does Normalization Choice Matter for Causal Large Time-Series Models? ​

56. Temporal Context Conditioning for Seasonality-Aware Precipitation Nowcasting of High-Intensity Rainfall ​

57. HydraCIL: Decoupled Class-Incremental Learning through Prototype-Guided Multi-Head Classifiers ​

58. 3SPO: State-Score-Supervised Policy Optimization for LLM Agents ​

59. Optimality of FSQ Tokens for Continuous Diffusion for Categorical Data with Application to Text-to-Speech ​

60. Interpreting and Steering a Text-to-Speech Language Model with Sparse Autoencoders ​

61. Bittensor Agent Arenas as a Trajectory Primitive: Distilling a Shopping Agent from ShoppingBench Subnet Traces ​

62. Importance-Aware Scheduling for High-Dimensional Hyperparameter Optimization ​

63. Spatiotemporal Seismic Hazard Assessment Using VQ-VAE and Seismic Statistical Features ​

64. Temporal Sheaf Neural Networks with Dynamic Orthogonal Transport ​

65. VFUSE: Virulent Feature Understanding with Sparse autoEncoders ​

66. Divide-and-Conquer Modeling for the CTF-4-Science Lorenz Benchmark ​

67. Structured Adaptive Tensor Prediction for Streaming Data ​

68. A Theory on Flow Matching with Neural Networks ​

69. Decision-Making under Combinatorial Risk ​

70. Unsupervised Style Representation Learning for AI-Text Detection via Paraphrase Inversion ​

71. Nonlinear Estimator: Dual Bayesian Affine Estimators for Parameter Learning ​

72. FedSteer: Taming Extreme Gradient Staleness in Federated Learning with Corrective Projections and Caching ​

73. Discovering Interpretable Multi-Parameter Control Policies for Evolutionary Algorithms Using Deep Reinforcement Learning ​

74. Ambiguous Strategic Classification ​

75. Compositional Generative Modeling from Decentralized Data ​

76. Quality Is Not a Safety Proxy Under Quantization ​

77. Learning Entropy and Spatial Adaptation Dynamics of Multilayer Perceptrons for Structural Point Extraction ​

78. Dropout-GRPO: Variational Stochasticity for Continuous Latent Reasoning ​

79. MMClima: A Framework for Multimodal Climate Science Data and Evaluation ​

arXiv cs.LG - 2026-06-10

1. Mechanistic Analysis of Alignment Algorithms in Language Models

2. SynIB: Informational Bottleneck for Maximizing Synergy in Multimodal Learning

3. Uncertainty-aware Multi-fidelity Closure via Conditional Normalizing Flows

4. Mitigating Manifold Departure: Uncertainty-Aware Subspace Rectification for Trustworthy MLLM Decoding

5. Conformal Risk Prediction for Non-Alcoholic Fatty Liver Disease Using Gradient Boosting with Distribution-Free Coverages

6. Time Series as Language: A Universal Tokenizer for General-Purpose Time Series Foundation Models

7. Blurry Window Attention

8. From Confident Closing to Silent Failure: Characterizing False Success in LLM Agents

9. Alignment Collapse Under KV Cache Quantization: Diagnosis and Mitigation

10. LLM-as-a-Discriminator: When Synthetic Tables Still Look Real

11. Two to Tango: Coupled Task-Reference Selection for Safe LLM Fine-tuning

12. SPACE: Source-free Proxy Anchor Concept Erasure for MLLMs

13. QSplitFL: Capability Aware Deep Q-Learning for Optimal Split Point Selection in Split Federated Learning

14. PatchSTG: Scalable Spatiotemporal Graph Transformers for Traffic Forecasting on Irregular Sensor Networks

15. Rotate2Think: Geometric Priming via Orthogonal Rotation to Improve Language Model Reasoning

16. Disjoint or Overlapping? Inference Windowing for Reconstruction-Based Time Series Anomaly Detection

17. Integrating Local and Global Entropy for Uncertainty Quantification in LLMs

18. Calibrating Overconfidence Without Sacrificing Confidence: Probe-Conditioned Head Intervention for LLMs

19. Streaming Knowledge Compilation: Proactive Materiality-Scored Pinning for Time-Evolving LLM Wikis

20. FailureScope: Cross-Regime Behavioral Diagnosis of Language Model Weaknesses

21. Operator Fusion for LLM Inference on the Tensix Architecture

22. Hyperparameter Learning for Latent Factorization of Tensors for Representation Learning to Large-scale Dynamic Weighted Directed Network

23. Toward Calibrated, Fair, and accurate Deepfake Detection

24. TD-Grokking: Learning from Zero-Reward Problems by Training-Time Decomposition

25. TENP: Trapezoidal Expert Neuron Pruning For Mixture-of-Experts

26. SHAPE: Coalition-Aware Expert Pruning for Sparse Mixture-of-Experts LLMs

27. SocraticPO: Policy Optimization via Interactive Guidance

28. SinkRec: Mitigating Semantic State Sink in Long Sequence Recommendation with Memory-Conditioned Gated Delta Networks

29. Optuna Constrained Tree-Structured Parzen Estimator Is a Joint Density Generalization of c-TPE

30. PreAct-Bench: Benchmarking Predictive Monitoring in LLMs

31. Representation Curriculum: Stagewise Training for Robust Ranking and Allocation

32. LMT: A Bayesian Framework for Causal Discovery from Textual Alarm Records in Manufacturing Systems

33. A Navigable Manifold of Hypothesized Consciousness-Spectrum States in Language Model Representations

34. TRAPS: Therapeutic Response Analysis via Pathway-informed Stratification

35. When Attribution Patching Lies: Diagnosis and a Second-Order Correction

36. LongMoE: Longitudinal Multimodal Learning via Trajectory-Aware Mixture-of-Experts

37. Mix, Don't Pick: Why Synthetic Corpus Composition Matters for Time Series Foundation Model Pretraining

38. IntentKV: Cross-Turn Intent-Aware KV Cache Pruning for Agent Inference

39. SPDM: Geometry-Modulated State Space Modeling with Manifold Constraints for Time Series Forecasting

40. Co-GLANCE: Uncertainty-Aware Active Perception for Heterogeneous Robot Teaming

41. Conformal Prediction for Neural Operators: Distribution-Free Uncertainty Quantification in Physics Simulation

42. Sigma-Branch: Hierarchical Single-Path Network Reconstruction for Dynamic Inference with Reduced Active Parameters

43. Sample Where You Struggle: Sharpening Base Model Reasoning via Entropy-Guided Power Sampling

44. Trainable Smooth-Rotation Transforms with Learned Channel Scales for LLM Quantization

45. Forward-Only Convolutional Neural Networks with Learnable Channel-Class Assignment

46. Between Amnesia and Chaos: A Memory Stability Expressivity Trilemma for Trainable Dissipative Oscillator Networks

47. When RL Fails after SFT: Rejuvenating Model Plasticity for Robust SFT-to-RL Handoff

48. nCMD: Benign-Anchored Feature Selection for Imbalanced Network Intrusion Detection

49. One Lens, Many Worlds : A Capability-Typed Interface for World-Model Interpretability

50. RKSC: Reasoning-Aware KV Cache Sharing and Confident Early Exit for Multi-Step LLM Inference

51. Interactions Between Crosscoder Features: A Compact Proofs Perspective

52. Learning Where to Simulate: Generative Active Sampling for Online PDE Surrogate Training

53. Integrating Out, Twice:The Open-System Case That Neural-Network Ensemble Theory Is Missing

54. Hasse Diagrams for Attention: A Partial Order Framework for Designing Transformer Masks

55. Does Normalization Choice Matter for Causal Large Time-Series Models?

56. Temporal Context Conditioning for Seasonality-Aware Precipitation Nowcasting of High-Intensity Rainfall

57. HydraCIL: Decoupled Class-Incremental Learning through Prototype-Guided Multi-Head Classifiers

58. 3SPO: State-Score-Supervised Policy Optimization for LLM Agents

59. Optimality of FSQ Tokens for Continuous Diffusion for Categorical Data with Application to Text-to-Speech

60. Interpreting and Steering a Text-to-Speech Language Model with Sparse Autoencoders

61. Bittensor Agent Arenas as a Trajectory Primitive: Distilling a Shopping Agent from ShoppingBench Subnet Traces

62. Importance-Aware Scheduling for High-Dimensional Hyperparameter Optimization

63. Spatiotemporal Seismic Hazard Assessment Using VQ-VAE and Seismic Statistical Features

64. Temporal Sheaf Neural Networks with Dynamic Orthogonal Transport

65. VFUSE: Virulent Feature Understanding with Sparse autoEncoders

66. Divide-and-Conquer Modeling for the CTF-4-Science Lorenz Benchmark

67. Structured Adaptive Tensor Prediction for Streaming Data

68. A Theory on Flow Matching with Neural Networks

69. Decision-Making under Combinatorial Risk

70. Unsupervised Style Representation Learning for AI-Text Detection via Paraphrase Inversion

71. Nonlinear Estimator: Dual Bayesian Affine Estimators for Parameter Learning

72. FedSteer: Taming Extreme Gradient Staleness in Federated Learning with Corrective Projections and Caching

73. Discovering Interpretable Multi-Parameter Control Policies for Evolutionary Algorithms Using Deep Reinforcement Learning

74. Ambiguous Strategic Classification

75. Compositional Generative Modeling from Decentralized Data

76. Quality Is Not a Safety Proxy Under Quantization

77. Learning Entropy and Spatial Adaptation Dynamics of Multilayer Perceptrons for Structural Point Extraction

78. Dropout-GRPO: Variational Stochasticity for Continuous Latent Reasoning

79. MMClima: A Framework for Multimodal Climate Science Data and Evaluation