RSD
Process rewards route reasoning steps between small and large models. FLOPs savings are promising; service-level latency remains unmeasured.
Read report| Technology area | Oct 2026 | Sep 2026 | Aug 2026 | Jul 2026 |
|---|---|---|---|---|
| Agent Memory & Security | — | — | ||
| VLM, Vision & 3D | ||||
| LLM Systems & Efficient Inference | ||||
| Reinforcement Learning & PEFT | — | |||
| Trustworthy ML & Learning Theory | — | |||
| AI4Science & Scientific ML | — |
Process rewards route reasoning steps between small and large models. FLOPs savings are promising; service-level latency remains unmeasured.
Read reportModern recurrent backbones for large action models: long-context efficiency, action-copy shortcuts, and limits of simulation-only evidence.
Read reportLearnable stochastic transitions connect flow matching and continuous autoregression, trading expensive backbone calls for small generative heads.
Read reportInformation gain selects visual evidence while attention changes determine when to insert it into multimodal reasoning.
Read reportError-type curricula and staged rewards teach mathematical reflection, with open questions about calibration and reproducibility.
Read reportAll-atom protein co-design through coordinate diffusion and recycling, balancing sequence quality, structural diversity, and experimental validation.
Read reportSocial-deduction games reveal how deception and detection scale, and what internal probes can tell us about agent behavior.
Read reportEfficient bidirectional KV migration for disaggregated inference, with a close look at latency targets and hardware dependence.
Read reportStructured point maps connect visual geometry to robotic action, exposing task-dependent tradeoffs between spatial and color information.
Read reportMultiscale flow matching for image generation: interface simplicity, high-frequency artifacts, and reproducibility tradeoffs.
Read reportLow-rank object–position bindings in vision-language models, examined through interventions and spatial-reasoning tests.
Read reportCompact process reward models guide test-time reasoning, raising questions about full search costs and error-detection quality.
Read reportDiscrete environment representations for drug-interaction prediction under distribution shifts.
Read reportWeightLens produces clearer circuit descriptions, while purity and causal faithfulness expose limits of interpretability metrics.
Read reportSwitching tensor and pipeline parallelism between prefill and decode improves throughput while trading off latency and memory.
Read reportThree-view visual heatmaps connect pretrained vision-language representations to 3D robotic action keypoints.
Read reportHard rejected-response sampling improves preference optimization, with careful attention to reward margins and external quality.
Read reportJoint gradient guidance for molecular optimization, separating docking-score improvements from evidence of drug quality.
Read reportNegative tilting for robust learning: theoretical guarantees, contamination models, and the challenge of choosing parameters in practice.
Read reportAdaptive cache budgets across attention heads for efficient long-context inference, with safeguards and deployment caveats.
Read reportGeometrically verifiable reinforcement learning for embodied reasoning and action, connecting visual evidence to robotic control.
Read reportAverage-velocity learning for one-step generation, examining guidance, numerical consistency, and quality–compute tradeoffs.
Read reportMultimodal preference learning and safety alignment, with a review of dataset consistency and external evaluation.
Read reportHow quantization and structured pruning affect reasoning in small language models, beyond final-answer accuracy.
Read reportPhysical knowledge improves learning from scarce biophysical measurements, while input differences complicate attribution.
Read reportCoordinate-wise corruption in linear regression: minimax limits and why even sparse missingness can be difficult.
Read reportScale selection for low-bit inference, disentangling quantization gains from high-precision safeguards.
Read reportReinforcement learning for collaborative embodied reasoning, with mixed in-distribution and out-of-distribution results.
Read reportNoise-conditioned learning reduces diffusion-model memorization while exposing the gap between reduced copying and privacy guarantees.
Read reportTool-assisted multimodal fact-checking, where evidence coverage matters more than simply extending reasoning.
Read reportTraining-data selection for instruction tuning, examining empirical gains and the assumptions behind importance weighting.
Read reportFormal molecular grammars guided by semantic feedback, balancing synthesizability, diversity, and limited training data.
Read reportNarrow fine-tuning can induce broader misalignment, with important differences across framing, models, and evaluation settings.
Read reportTrace-based performance modeling for distributed training, connecting runtime behavior to software–hardware planning.
Read reportSynthetic video as a source of executable robot-training signals, with tradeoffs in compute, transfer, and evidence quality.
Read reportStreaming long-video generation: temporal consistency, persistent context, and efficient inference.
Read reportAudio-visual understanding for video question answering, examining cross-modal evidence and evaluation.
Read reportPath attribution for time series: explaining temporal dependencies and evaluating the faithfulness of model explanations.
Read reportSufficiency, minimality, and token interactions for document-QA explanations, with a focus on faithfulness.
Read reportW4A8KV4 quantization and GPU kernel co-design remove dequantization bottlenecks to improve inference throughput.
Read reportReward-free test-time policy adaptation through action-entropy minimization and KL constraints under environment shifts.
Read reportToken-aware low-rank compensation and video-relation distillation mitigate low-bit video Transformer degradation.
Read reportVisual Graph Arena tests graph recovery from pixels, layout robustness, and the separation of perception from reasoning.
Read reportProcess and artifact diagnostics across 800 scientific-agent trajectories reveal failures to revise detected flaws.
Read reportThe teacher–student gap between reward models and current policies guides preference-data selection for alignment.
Read reportAuxiliary velocities turn diffusion on periodic crystal coordinates into a dynamical system for crystal generation.
Read reportA simplex-constrained attribution matrix explains the complete label distribution of structured-output models.
Read reportPiecewise-affine regularization and proximal updates move quantization training from continuous to discrete weights.
Read reportHyperspherical normalization and scale-stable distributional value prediction improve deep RL scaling and stability.
Read reportReward-weighted distributions unify diffusion and flow-matching alignment through changes to sampling dynamics.
Read reportLesion-level perturbations and clinical relevance connect medical preference optimization to visual evidence.
Read reportCross-block consensus enables test-time scaling in diffusion language models through implicit semi-autoregressive experts.
Read reportBit-level supervision, geometric biases, and representation alignment improve multimodal protein structure learning.
Read reportMultistep query policies learned inside a Gaussian-process world model for nonmyopic Bayesian optimization.
Read reportA question-aware video compressor allocates a global token budget to improve efficient long-video understanding.
Read reportGradient geometry guides trainable-parameter selection for low-rank adaptation under verifiable reinforcement learning rewards.
Read reportA systematic evaluation of molecular-regression GNNs reveals layer choice as a consequential hyperparameter.
Read reportTheoretical bounds on Transformer succinctness, architectural complexity advantages, and the conditions behind them.
Read reportA low-bit copy of the target model serves as a training-free draft for lossless speculative decoding with offloaded models.
Read reportVisual representations for long-term memory: optical context retrieval and the tradeoffs between capacity, cost, and fidelity.
Read reportHow historical experience creates feedback loops in agent behavior, and why more memory does not always help.
Read reportLong-horizon tool-use reinforcement learning through curriculum data, reward design, and generalization.
Read reportA unified Transformer uses implicit KV-cache representations to reconstruct 3D scenes from partial observations.
Read reportFour complementary relation graphs organize agent memory. Evidence and limitations from LoCoMo and LongMemEval.
Read reportPrediction error as a signal for adaptive memory distillation: deciding which experiences an agent should retain.
Read reportRewarding both reasoning structure and effectiveness in subjective visual tasks, with implications for RL evaluation.
Read reportHow reasoning traces can encourage overinterpretation, misplaced trust, and evaluation bias.
Read reportLong-context genomic modeling and unified biological foundation models for genome understanding and design.
Read reportGrokking as a dimensional phase transition, connecting memorization, generalization, and experimental evidence.
Read reportToken relationships stabilize routing and load balancing in sparse mixture-of-experts models.
Read reportEvent-progress graphs and thematic networks balance rapid adaptation with stable long-term knowledge.
Read reportForged reasoning memories expose a new attack surface in agent memory systems. A review of risks, evidence, and defenses.
Read reportTraining-free in-context segmentation: methods, quantitative evidence, and limitations from a CVPR 2026 Oral paper.
Read reportUnified long- and short-term memory management for language-model agents, with a close look at policy design and evaluation.
Read report