NEURIPS 2025 ORAL · GENERATIVE MODELS

MeanFlow: Average-Velocity Reparameterization for One-Step Generation, Evidence, and Failure Boundaries

Average-velocity identity × JVP bootstrapping × 1-NFE generation

NeurIPS 2025 · arXiv:2505.13447v1 2026-09-16 Flow Matching · One-step Generation

One-NFE FID drops from Shortcut's 10.60 to 3.43, but CFG contributes heavily, significance tests are absent, and two internal numerical inconsistencies remain.

Field: Generative Models (Diffusion / Flow Matching / One-Step Generation) Core paper: Mean Flows for One-step Generative Modeling,NeurIPS 2025 Main Conference,Oral。
Evidence conventions: Original values are explicitly stated in text/appendices; recomputations use only arithmetic on identified tables; unreported values are never invented. PDF pages follow file pagination. Links/page status checked 2026-09-16.

0. Main finding: what does it actually solve?

MeanFlow matters for separating one-step generation from teacher–student distillation, explicit curricula, and multistage optimization. It directly learns the average velocity over any interval [r,t] , u(z_t,r,t)and uses u = v − (t−r) d u/dt to turn an indirectly supervised average into a computable bootstrap target. Trained from scratch on ImageNet 256×256, MF-XL/2 reaches 1-NFE FID 3.43(Table 2, p.9), versus the equally 1-NFE, 676M-parameter Shortcut-XL/2 at 10.60for the proposed method—an absolute reduction of 7.17and relative reduction of 67.64%(recomputed here). One step is not free: training still uses large-scale ImageNet, a fixed VAE, CFG, and JVP, without seed variance/significance tests. On CIFAR-10, MeanFlow FID 2.92 is worse than iCT's 2.83(Table 3, p.9).

1. Link verification table

Item Conference / official page arXiv version and date Code Data / weights Project page / videos Verification result
MeanFlow (core) NeurIPS 2025 proceedings index; listed in Main Conference Track, with Oral designation arXiv:2505.13447v1,2025-05-19 Official JAX implementation, MIT license; CIFAR PyTorch added later Users supply ImageNet; repository links MF-B/4 checkpoint and FID statistics; main-table XL weights not found Hugging Face Daily Papers; separate project page/official video not found All accessible; code page states TPU testing
Flow Matching No separate conference page listed arXiv:2210.02747v2,2023-02-08 Accessibility of the paper's implementation link was not used as reproduction evidence Public datasets; weights unverified Separate project page/video not found Paper PDF read
Improved Techniques for Training Consistency Models(iCT) ICLR 2024 arXiv:2310.14189v1,2023-10-22 Official repository not confirmed in this check Public datasets; weights unverified Separate project page/video not found Paper PDF read
Shortcut Models ICLR 2025 arXiv:2410.12557v3,2025-06-23 Official repository not confirmed in this check Public datasets; weights unverified Separate project page/video not found Paper PDF read
Inductive Moment Matching(IMM) ICML 2025 arXiv:2503.07565v7,2025-05-14 Official repository not confirmed in this check Public datasets; weights unverified Separate project page/video not found Paper PDF read
Improved Mean Flows(iMF) ICLR 2026 arXiv:2512.02012v2,2026-05-09 Code entry linked from MeanFlow repository updates Public datasets; weights not individually verified Separate video not found Paper PDF read

Link boundaries. Papers with Code did not provide a stable readable paper page, so it served only as a cross-search entry, not quantitative evidence. Semantic Scholar, Hugging Face, arXiv, OpenReview/proceedings supported discovery/identity checks. All experimental numbers come from read PDFs.

2. Candidate pool and random selection

The run falls on Wednesday, rotating to generative models. First checked ml-report-index.mdand excluded recently covered LongLive (streaming long video), DreamGen (robot trajectories from video world models), Ambient Creativity (diffusion memorization control), and adjacent topics. Candidates came from NeurIPS/ICLR proceedings, OpenReview, arXiv, and Hugging Face Daily Papers, with Semantic Scholar/Papers with Code checking names/versions. The 24-paper pool is within 24 months, prioritizing recent 12-month main-conference papers/high-quality preprints.

Number Candidate paper Entry Relation to this topic
1 Improved Mean Flows for One-step Generative Modeling ICLR 2026 / arXiv Direct MeanFlow follow-up
2 SoFlow arXiv 2025 One-step flow improvements
3 Pixel MeanFlow arXiv 2026 One-step pixel-space generation
4 PixelGen arXiv 2026 Pixel-level generation
5 W‑Flow arXiv 2026 Flow reparameterization
6 Modular MeanFlow arXiv 2025 Modular MeanFlow
7 Contrastive Flow Matching arXiv 2025 Flow training objectives
8 Mean Flows for One-step Generative Modeling NeurIPS 2025 Oral / arXiv Selected this round
9 Diffuse and Disperse arXiv 2025 Diffusion trajectory design
10 Fair Benchmarking of Emerging One-Step Generative Models arXiv 2026 One-step model evaluation
11 SubFlow arXiv 2026 Subinterval flow
12 APEX OpenReview Efficient generation
13 Building Flow Uniqueness OpenReview Flow identifiability
14 TwinFlow OpenReview Dual-flow modeling
15 Decoupled MeanFlow ICLR 2026 proceedings Decoupled MeanFlow objectives
16 Understanding and Improving MeanFlow ICLR 2026 proceedings Mechanistic analysis
17 On the Design of One-step Diffusion via Shortcutting Paths OpenReview shortcut path
18 Understand Before You Generate: ST‑AR arXiv 2025 Autoregressive image generation
19 Towards Better and Faster AR Image Generation via Entropy arXiv 2025 Efficient autoregression
20 Mage‑Flow arXiv 2026 Flow generation
21 World‑In‑World OpenReview World models
22 Are We Ready for RL in Text-to-3D? arXiv 2025 3D / RL generation
23 Watermarking Autoregressive Image Generation arXiv 2025 Generation provenance
24 ARRA arXiv 2025 Autoregressive generation

After fixing N=24 , the system command shuf -i 1-24 -n 1returned 8selected MeanFlow. Paper, appendices, formal status, code, and main results were sufficient, so the severe-information-shortage condition did not apply;zero redraws. Selection was not based on popularity or author preference, and fame does not relax subsequent evidence standards.

3. Motivation: where one-step generation gets stuck

Flow Matching learns instantaneous velocity v(z_t,t). Moving from noise z_1 to data z_0normally requires numerical ODE integration. One Euler step uses only z_0≈z_1−v(z_1,1), collapsing a curved trajectory to an endpoint tangent with potentially large error. Shortcut's compute-matched DiT-B comparison is clear: on ImageNet 256, ordinary flow matching has one-step FID 324.8versus Shortcut's 40.3; at 128 steps these become 17.3 with 15.5(Shortcut Table 1, p.8). The network can generate, but its training object mismatches the finite-interval displacement required at inference.

Three remedies have costs. Distillation requires a pretrained teacher and extra stages. Consistency training enforces agreement across noise levels, with stability depending on curricula, weights, and discretization. Shortcut conditions on step size to cover multiple integration intervals but remains affected by noise–data coupling. MeanFlow asks: if a jump requires the z_t to z_r interval'saverage velocity, why not learn it directly?

The quantitative opportunity is large: MF-XL/2 reaches 1-NFE FID 3.43versus equally sized Shortcut-XL/2 at 10.60(MeanFlow Table 2, p.9). Yet multistep SiT+REPA reaches 1.42, leaving a 2.01 absolute FID gap. MeanFlow does not end multistep generation; it changes the learned object under a one-evaluation budget.

4. Narrative, core assumptions, and tradeoffs

Four steps define the method: define interval-average velocity as exact integrated displacement; derive its identity with instantaneous velocity; treat the right side as a stop-gradient target and compute trajectory derivatives by JVP; incorporate CFG into training so inference still calls the network once.

Three assumptions matter.Representability: one conditioned network fits many [r,t] intervals;Bootstrap stability: stop-gradient prevents collapse even when targets contain current-network derivatives;Distribution coverage: sampled intervals, CFG weights, and latent data cover the important inference region r=0,t=1 . Benefits are no teacher, pretraining, or explicit curriculum; costs are a more complex objective, JVP, and strong sensitivity to time sampling/CFG.

5. Equation-level formalization

5.1 From probability paths to instantaneous velocity

Take data x~p_data and noise ε~N(0,I)to construct a linear or general probability path

z_t = a_t x + b_t ε, t∈[0,1]。

The conditional velocity is its derivative v_t(x,ε)=d z_t/dt; marginal velocity is the conditional expectation given z_t :

v(z_t,t)=E[v_t(x,ε) | z_t]。

This defines the ODE d z_t/dt = v(z_t,t)(Eqs.1–2, pp.2–3). Standard Flow Matching regresses vbut sampling still integrates from 1 to 0.

5.2 Average velocity is the correct finite-displacement object

For any 0≤r≤t≤1, define

u(z_t,r,t) = 1/(t-r) ∫_r^t v(z_τ,τ)dτ。

Then exact displacement satisfies

z_r = z_t − (t−r) u(z_t,r,t)。

In particular, if r=0,t=1, predicting the entire interval's average velocity gives z_0=z_1−u(z_1,0,1)in one step (Eqs.3,12, pp.3,5). This is not approximate Euler: with perfectly correct u , the finite-interval update is exact integration by definition.

5.3 MeanFlow identity

Let Δ=t−r. Taking the total derivative of Δu=∫_r^t v dτ versus t gives

u(z_t,r,t) = v(z_t,t) − (t−r) d u(z_t,r,t)/dt。

Since u depends on state z_t and explicit time t, the total derivative expands as

d u/dt = (∂u/∂z_t)·v(z_t,t) + ∂u/∂t,

This is a JVP of network u_θ(z_t,r,t) along direction (v,0,1) (Eqs.6,8, pp.4–5).r is held fixed during differentiation, so the middle component must be zero. Using the incorrect direction (v,0,0)、(v,1,0) or (v,1,1)degrades FID from 61.06 to 268.06 / 329.22 / 137.96(Table 1b, p.7). JVP semantics are the method itself, not a minor implementation detail.

5.4 Bootstrap targets and stop-gradient

The target is

u_tgt = sg[v − (t−r) JVP(u_θ; (v,0,1))],

L = E[w · ||u_θ(z_t,r,t) − u_tgt||²]。

sg denotes stop-gradient, preventing degenerate solutions from moving predictions and targets together. Eqs.9–11 also apply adaptive power weighting to error magnitude (pp.5–6). Training does not always sample r<t: Table 1a shows that when the fraction of r≠t is 0%,FID 328.91; increasing it to 25% and for 61.06,50% and for 63.14,100% and for 67.32(p.7). Retaining some r=t instantaneous-velocity tasks anchors the bootstrap system.

5.5 Training and one-step sampling pseudocode

repeat:
    x ~ p_data, ε ~ N(0, I)
    sample t and r ≤ t; construct z_t = a_t x + b_t ε
    compute analytic conditional velocity v_t(x, ε)
    predict u = u_θ(z_t, r, t, class)
    compute J = JVP[u_θ] along tangent (v_t, 0, 1)
    target = stopgrad(v_t - (t-r) * J)
    update θ on adaptive_weight(u,target) * ||u-target||²

sampling (1-NFE):
    z_1 ~ N(0, I)
    z_0 = z_1 - u_θ(z_1, 0, 1, class; CFG folded into target)
    image = VAE_decode(z_0)

One NFE counts one main-network call, not one arithmetic operation for the whole system: noise sampling and VAE decoding remain, with JVP during training.

6. Key mechanisms and engineering details

Module Paper implementation Why it matters Evidence
Interval conditioning Input (t,r); ablations also test (t,t−r) and alternatives The network must know the integration interval (t,r) 61.75,(t,t−r) 61.06; all three inputs together 63.98; Table 1c, p.7
Time sampling Log-normal; best main ablation (-0.4,1.0) Training density determines interval coverage Uniform 65.90, best 61.06; Table 1d, p.7
Adaptive weighting Error exponent p; main setting p=1 Reduce scale imbalance p=0/0.5/1/1.5/2 gives 79.75/63.98/61.06/66.57/69.19; Table 1e, p.7
CFG in the target Construct a guided target field during training Preserve 1-NFE inference ω=1→61.06, 2→20.15, 3→15.53, 5→20.75; Table 1f, p.7
JVP Tangent vector (v,0,1) Compute a total rather than partial derivative Wrong directions worsen FID by at least 76.90; Table 1b, p.7
Latent training Fixed VAE; latent 32×32×4 Reduce backbone training cost Experimental setup, p.7
Optimizer Adam,β=(0.9,0.95),LR 1e−4,batch 256,EMA .9999 Basic configuration for reproducing ImageNet results Table 4, p.14
CIFAR configuration LR .0006,batch 1024,dropout .2,EMA .99995,800K iter + 10K warmup Shows CIFAR is not a direct scaling of the ImageNet recipe Appendix C, p.14

The appendix reports TPU v4-8 step wall time rising from 0.045 s without JVP to 0.052 s, approximately 16%relative overhead (Appendix B.4, p.16). This supports manageable JVP training cost, not GPU extrapolation: the official main implementation was tested on TPUs, with no GPU-kernel, peak-memory, or end-to-end energy results.

7. Datasets, benchmarks, and metrics

ImageNet 256×256。 Class-conditional generation uses a fixed VAE to encode images into 32×32×4 latents; primary evaluation is 50K-sample FID. Lower is better, but FID compares feature means/covariances and alone cannot establish semantic faithfulness, absence of diversity collapse, or individual-image quality. Main results emphasize 1 NFE; 2-NFE results use a different budget and cannot be mixed into equal-budget rankings.

CIFAR‑10。 A roughly 55M-parameter U-Net reports unconditional FID, testing whether the method extends beyond latent ImageNet DiTs. MeanFlow's 2.92 beats most consistency/moment-matching comparisons but not iCT's 2.83 (Table 3, p.9).

NFE。 NFE counts backbone calls and is fairer than sampling steps, but per-call FLOPs, VAEs, and CFG implementations may differ. Table 4 provides some FLOPs without matching all baselines by actual latency or energy.

8. Main-results matrices

8.1 ImageNet 256: core 1-NFE comparison

Method Parameters Training approach NFE FID↓ Gap to MF-XL/2 Source
iCT‑XL/2 675M Consistency from scratch 1 34.24 +30.81 Table 2, p.9
Shortcut‑XL/2 675M Step-conditioned flow from scratch 1 10.60 +7.17 Table 2, p.9
MF‑B/2 131M MeanFlow from scratch 1 6.17 +2.74 Table 2, p.9
MF‑M/2 308M MeanFlow from scratch 1 5.01 +1.58 Table 2, p.9
MF‑L/2 459M MeanFlow from scratch 1 3.84 +0.41 Table 2, p.9
MF‑XL/2 676M MeanFlow from scratch 1 3.43 0 Table 2, p.9

Against the strongest comparable Shortcut, absolute reduction is 10.60−3.43=7.17and relative reduction 7.17/10.60=67.64%(recomputed). Scaling 131M→676M reduces FID 6.17→3.43, improving 2.74 absolute/44.41% relative. Gains are substantial but nonlinear: L→XL adds only 0.41.

8.2 Broader method families: do not conflate NFE

Family Method NFE FID↓ Directly fair against 1 NFE? Source
One / few steps MF‑XL/2 1 3.43 Reference point Table 2, p.9
One / few steps IMM 2(1×2) 7.77 No: higher NFE and still worse Table 2, p.9
One / few steps MF‑XL/2 2 2.93 No: measures its own compute scaling Table 2, p.9
One / few steps MF‑XL/2+ 2 2.20 No: extra training/configuration Table 2, p.9
GAN BigGAN — 6.95 Different model paradigm Table 2, p.9
GAN GigaGAN — 3.45 Different paradigm; MF leads by only 0.02 Table 2, p.9
GAN StyleGAN‑XL — 2.30 Different model paradigm Table 2, p.9
AR VQGAN — 26.52 Sequence length not converted to NFE Table 2, p.9
AR MaskGIT — 6.18 Iterative token decoding Table 2, p.9
AR VAR‑d30 — 1.92 Different compute accounting Table 2, p.9
AR MAR‑H — 1.55 Different compute accounting Table 2, p.9
Diffusion / flow ADM Multiple steps 10.94 No Table 2, p.9
Diffusion / flow LDM Multiple steps 3.60 No Table 2, p.9
Diffusion / flow SimDiff Multiple steps 2.77 No Table 2, p.9
Diffusion / flow DiT Multiple steps 2.27 No Table 2, p.9
Diffusion / flow SiT Multiple steps 2.06 No; text separately states 2.15 Table 2, p.9; text p.8
Diffusion / flow SiT+REPA Multiple steps 1.42 No Table 2, p.9

This table deliberately avoids inventing five benchmarks×six methods: the core paper has only ImageNet and CIFAR, with differing training data, architectures, and NFEs across papers. It establishes a substantial FID advance under one evaluation, not dominance across all paradigms, latency, and quality dimensions.

8.3 CIFAR-10 external validity

Method Parameter scale FID↓ MeanFlow difference Source
iCT About 55M 2.83 MeanFlow +0.09 (worse) Table 3, p.9
ECT About 55M 3.60 MeanFlow −0.68 Table 3, p.9
sCT About 55M 2.97 MeanFlow −0.05 Table 3, p.9
IMM About 55M 3.20 MeanFlow −0.28 Table 3, p.9
MeanFlow About 55M 2.92 0 Table 3, p.9

The large ImageNet lead does not reproduce proportionally on CIFAR. Against iCT, MeanFlow's FID is 0.09 higher, a relative difference of 3.18%(recomputed). Without variance, it is unknown whether this exceeds training randomness.

ImageNet 256: from-scratch, 1-NFE FID

One y-axis, lower is better; MeanFlow variants blue, earlier one-step baselines orange.

MeanFlowOne-step baseline
ImageNet 256 one-step FID: MeanFlow versus iCT and Shortcut iCT 34.24, Shortcut 10.60; MeanFlow B/M/L/XL 6.17/5.01/3.84/3.43. 010203036iCT34.24Shortcut10.60MF-B/26.17MF-M/25.01MF-L/23.84MF-XL/23.43
Source: core Table 2 (p.9). Hover or keyboard-focus for exact values; error bars unreported.

9. Layered ablations: necessary mechanisms versus refinements

Layer one: task definition. Without nonzero-interval samples (r≠t=0%), FID is 328.91; 25% reduces it to 61.06, but 100% regresses to 67.32 (Table 1a, p.7). Average-velocity supervision is essential, yet pure average-velocity training is suboptimal; instantaneous samples may anchor learning.

Layer two: derivative semantics. Correct (v,0,1) gives 61.06; three wrong JVP directions degrade catastrophically (Table 1b, p.7). This is the strongest mechanistic ablation, distinguishing the correct identity from arbitrary derivative regularization.

Layer three: conditioning parameterization. (t,t−r) slightly outperforms (t,r), 61.06 versus 61.75, only 0.69 apart; all three inputs yield 63.98 (Table 1c, p.7). More conditioning is not monotonically better; redundancy may complicate learning.

Layer four: sampling distribution. Uniform gives 65.90; four log-normal settings span 61.06–64.72 (Table 1d, p.7). The best (-0.4,1.0) improves by 4.84 over uniform, supporting a material role for time density, but finer grids/cross-model checks are absent.

Layer five: loss weighting. p=1 is best at 61.06;p=0 gives 79.75 andp=2 69.19 (Table 1e, p.7). The relationship is U-shaped, not simply better with more focus on difficult examples.

Layer six: CFG. In short-training B/4, ω=1→3 reduces FID 61.06→15.53; ω=5 rebounds to 20.75 (Table 1f, p.7). With modified CFG at fixed effective ω'=2 , κ=0 gives 20.15, κ=0.9 gives 18.63, and κ=0.95 gives 19.17 (Table 5, p.15). CFG contributes heavily with a clear favorable region.

10. Hyperparameter sensitivity and transitions

No continuous phase diagram is given, but discrete grids show three transition-like behaviors.

  1. Interval supervision switch: r≠t moving from 0% to 25% reduces FID 328.91→61.06, an absolute 267.85 gain. This is a structural shift from learning instantaneous fields to finite displacements, not a minor adjustment.
  2. JVP semantics: changing only tangent components can move FID 61.06→329.22, showing the parameterization does not automatically absorb incorrect derivatives.
  3. Guidance strength: ω=1→3 improves rapidly, then 3→5 worsens; κ is also U-shaped near 0.9. Guidance strengthens class signals but excess can sacrifice coverage/stability.

The paper does not jointly sweep learning rate, batch, EMA, width, and time sampling, report failure rates, or establish stable hyperparameter regions across seeds/datasets/GPU backends. Transition describes observed discrete points, not rigorously estimated critical values.

11. Statistical significance and repeatability audit

not reported by the paper multi-seed ImageNet means, standard deviations, CIs, or significance tests; CIFAR Table 3 also gives single values. A 7.17-FID gap is unlikely to be only noise, but 0.02 versus GigaGAN and 0.09 versus CIFAR iCT cannot establish robust wins/losses.

Reproducibility lies between public code and out-of-box main-SOTA reproduction. The repository provides JAX/TPU code, preprocessing, MF-B/4 checkpoint, and FID statistics, expecting checkpoint FID 11.4. Yet complete training resources, main weights, and seed logs for Table 2's MF-XL/2 FID 3.43 were not fully available in verified pages. Parameter counts also conflict: M/2 is 308Min Table 2 but 497.8Min Table 4 (pp.9,14), directly affecting scaling curves and reproduction budgets.

Another inconsistency is SiT: the text says 2.15while Table 2 says 2.06(pp.8–9). This does not change MeanFlow's one-NFE conclusion, but baseline numbers need checking against original sources.

12. Related-work chain: problem origins, technical sources, and design transfer

12.1 Flow Matching: directly learning continuous flows, while still requiring integration

Flow Matching constructs regressable velocities from conditional probability paths, avoiding expensive likelihood ODEs. On CIFAR-10, FM+OT FID is 6.35 / NFE 142versus DDPM 7.48 / 274; on ImageNet-64 the respective values are 14.45 / 138 with 17.36 / 264(Flow Matching Table 1, p.7). It stabilizes continuous-flow training but leaves numerical integration at inference. MeanFlow retains probability paths and velocity regression, changing the learned object from instantaneous v to interval-average u. The inherited design uses conditional paths for simulation-free training signals; what changes is which field is learned.

12.2 iCT: teacher-free consistency training, with curriculum/weight dependence remaining

Improved consistency training reaches CIFAR-10 one/two-step FID 2.51 / 2.24and ImageNet-64 3.25 / 2.77(iCT Tables 2–3, p.8). It proves few-step generation without distillation, but still depends on discretization/curricula. MeanFlow replaces explicit curricula with continuous intervals [r,t] and identity-based bootstrapping. Both seek global consistency across noise levels; MeanFlow expresses it through average-velocity calculus rather than directly equating predictions across times.

12.3 Shortcut Models: one model across step sizes, with coupling/one-step quality gaps

Shortcut conditions on step size and trains with bootstrap shortcuts. At matched DiT-B compute, one-step FID improves from ordinary flow's 324.8 to 40.3; four-step from 108.2 to 28.3 (Table 1, p.8); the large model reaches 10.60 at one step. Noise-to-data maps remain coupling-dependent (limitations, p.10). MeanFlow's [r,t] conditioning shares this origin, but connects short/long intervals through an integral-average identity rather than directly composing short predictions. The inherited step-size condition gains an analytic, verifiable velocity meaning.

12.4 IMM: propagating distributions by moment matching, with particle/extra-NFE costs

Inductive moment matching moves generated distributions toward targets, reaching ImageNet 256 eight-step FID 1.99,CIFAR‑10 2-step 1.98; MeanFlow Table 2 cites its one-step setting at 2 NFE、FID 7.77. This is another route beyond classical teacher distillation, but requires moment estimation and particle configurations. MeanFlow reduces supervision to a single-trajectory velocity/JVP identity, replacing particle-moment propagation with analytic derivatives while retaining the idea of global maps from locally estimable quantities.

12.5 Improved Mean Flows: identifying gaps in original MeanFlow

iMF examines network-derivative-dependent targets, fixed training CFG, and architectures not optimized for one-step objectives. On ImageNet 256, it improves B/2 from original FID 6.17 to a v-loss auxiliary head at 5.68, flexible Ω at 4.57、in-context 4.09, advanced blocks at 3.82, and 640 epochs at 3.39(iMF Table 1, p.6). XL improves from 676M/3.43 to 610M/ 1.72(Table 2, p.7). MeanFlow's equation is a useful foundation, not a final recipe. The direct transfer retains average-velocity semantics while decoupling targets and strengthening conditioning.

12.6 Nonlinear technical evolution tree

Probability paths / continuous flows
├─ Flow Matching: instantaneous velocity v ───────────┐
│                                                    │ still requires multistep ODE integration
│                                                    ▼
│     consistency route ─ iCT ── teacher-free, curriculum/discretization-dependent
│              └────────────────┐
│                               ├─ global one-step mapping
│     step-size route ─ Shortcut┘      │
│       (cross-step bootstrapping, coupling-dependent) │
│                                      ▼
│                         MeanFlow: interval-average velocity u
│                         ├─ identity u=v−Δ·du/dt
│                         ├─ JVP (v,0,1)
│                         └─ CFG in targets → 1 NFE
│                                      │
│                                      ├─ iMF: decoupled targets/flexible Ω/new blocks
│                                      ├─ Pixel MeanFlow: pixel space
│                                      └─ Decoupled/Modular branches
└─ moment route ─ IMM: recursive distribution moments ─┘

Drivers and turning points. The first shift moves from better integration to changing the learned finite-step object; the second moves from teacher distillation to self-consistent, self-supervised global maps. MeanFlow specifically gives step-size conditioning exact average-velocity semantics. iMF shows the next phase is separating target coupling, guidance, and architecture rather than merely proving one-step feasibility.

12.7 Cross-paper comparison

Work Learned object Teacher required Source of global training consistency Inference-budget highlight Main remaining gap
Flow Matching Instantaneous velocity v No Probability-path regression High quality, multiple steps ODE integration
iCT consistency function No Cross-noise consistency + curriculum 1–2 step Curriculum / weight sensitivity
Shortcut Step-conditioned velocity No Bootstrap long steps from short ones 1-step 10.60 Coupling, one-step quality
IMM Distribution-moment map No inductive moment matching High quality in few steps Particle and NFE costs
MeanFlow Interval-average velocity u No Analytic identity + JVP 1‑NFE 3.43 CFG dependence, target coupling, no variance
iMF Improved average-velocity system No Decoupled targets + stronger conditioning/architecture 1‑NFE 1.72 Broader fair latency evaluation still needed

13. Genuine contributions, reusable design, and transfer potential

Contribution one: reparameterizing the learned object. Rather than adding a loss, it identifies interval-average velocity as the natural one-step prediction target, independently reusable beyond particular DiT blocks.

Contribution two: a computable self-consistency identity. u=v−Δ du/dt An integral definition becomes a locally trainable relation, with JVP making total derivatives affordable. Catastrophic wrong-direction ablations in Table 1b provide strong mechanistic evidence.

Contribution three: treating guidance as a target field. Traditional conditional/unconditional double forwards would violate strict 1 NFE. Folding CFG into training preserves one call, a reusable design for any claimed one-step conditional generator.

Direct transfers include video, audio, 3D, and molecular flows: continuous paths, conditional velocities, and model JVPs permit interval-average fields. High-dimensional temporal curvature, CFG, memory, and JVP cost may become harder. In inverse problems, treat [r,t] as a variable solving interval so one network chooses one or few steps by observation difficulty, but this needs calibrated error estimators beyond FID.

14. Limitations acknowledged by the paper

The paper has no separate systematic Limitations section. The following are explicit or directly locatable text/appendix boundaries, not independent criticisms presented as author statements.

  1. JVP training cost. Appendix B.4 (p.16) reports 0.045→0.052 s/iteration, about +16%. The authors consider it manageable, but measure only TPU v4-8.
  2. CFG recipes can improve. Appendix B.3 (p.15) introduces modified CFG and an optimal κ region, acknowledging the original fixed guidance target is not final.
  3. One step still trails the strongest multistep models. The discussion (pp.8–9) claims narrowing, not eliminating, the gap; Table 2's 3.43 versus SiT+REPA 1.42 makes this clear.

15. Independent critique: because X, therefore Y

  1. [Statistics] Because ImageNet/CIFAR main tables lack multiple seeds, standard deviations, or CIs, the 7.17-FID advantage is directionally persuasive, but 0.02 versus GigaGAN and 0.09 versus iCT cannot be called significant.
  2. [Attribution] Because changing B/4 CFG ω from 1 to 3 alone reduces FID 61.06→15.53 (Table 1f, p.7), far more than most structural refinements, final 3.43 cannot be attributed solely to the average-velocity identity. Strong baselines need matched CFG training.
  3. [External validity] Because CIFAR-10 MeanFlow 2.92 trails iCT 2.83 (Table 3, p.9), latent ImageNet DiT superiority does not establish universal cross-dataset gains.
  4. [Fairness] Because Table 2 mixes GANs, autoregressive models, multistep diffusion, and 1-NFE flows without matched latency, FLOPs, VAEs, or energy, overall SOTA can only describe tabulated FID ranking, not best system throughput.
  5. [Reproducibility] Because MF-M/2 is 308M in Table 2 but 497.8M in Table 4 (pp.9,14), scaling and training budgets cannot be reproduced unambiguously; the authors should correct this.
  6. [Baseline audit] Because SiT FID is 2.15 in the text and 2.06 in Table 2 (pp.8–9), at least one comparison has a transcription/version error. Differences near 0.1 require original-paper/protocol checks.
  7. [Mechanism] Because r≠t=0% at 328.91 versus correct JVP at 61.06 establishes the need for average-velocity tasks and total derivatives. Yet no compute-matched derivative-regularization control without the MeanFlow identity separates analytic structure from extra supervision/compute completely.
  8. [Deployment] Because +16% JVP overhead was measured only on TPU v4-8 and main code targets TPUs, negligible GPU cost is unproven. GPU peak memory, compilation stability, and throughput remain gaps.

16. Open challenges: actionable head-to-head experiments

Theory

  • Average-field identifiability. Fix architecture/data; compare the MeanFlow identity, arbitrary JVP regularization, and directly integrated pseudo-labels. Measure u interval-closure error, endpoint error, and FID, and prove when bootstrap fixed points are unique.
  • Error-propagation bounds. On 2D/low-dimensional distributions with analytic flows, compare one-step MeanFlow, Shortcut, and Euler/RK. Sweep curvature/Lipschitz constants and test whether average-velocity regression error linearly controls endpoint error.
  • Coupling sensitivity. On identical data, compare independent, OT, and learned couplings at fixed NFE/parameters/FLOPs. Measure FID, precision/recall, and pairing stability to test whether MeanFlow mitigates Shortcut's coupling dependence.

Engineering and applications

  • Wall-clock-matched controls. On one H100 cluster, compare MeanFlow, Shortcut, iCT, and iMF with equal training hours. Report throughput, peak memory, energy, failure restarts, and FID rather than only epochs.
  • End-to-end serving comparison. At batch 1/8/64, measure p50/p95 latent encoding, 1-NFE backbone, and VAE decoding latency against two/four-step models. If VAE dominates, reducing four backbone steps to one may yield overstated system gains.
  • Causal CFG ablation. Give MeanFlow and all one-step baselines identical guidance training/effective ω; grid-sweep ω/κ. Report no-CFG and best-CFG leaderboards separately to isolate identity and guidance gains.

Emerging directions

  • Video average velocity. Compare MeanFlow/Shortcut on one video DiT at fixed frames, resolution, and training FLOPs. Beyond FVD, report identity/motion drift by temporal position to test whether interval averaging blurs long-horizon action phases.
  • Text-to-3D / molecule generation. Compare instantaneous and average fields on hard-constrained flows using validity, property distributions, deduplication, and sampling latency. Test whether one-step jumps cross feasible manifolds.
  • Adaptive one/few-step routing. Train an interval-error predictor to assign 1 NFE to easy samples and 2–4 to hard ones. Compare fixed 1/2/4 NFE at equal average compute using FID, worst-quantile quality, and calibration.

17. Recent-work radar

  1. Improved Mean Flows: the most direct follow-up identifies target coupling, fixed guidance, and architecture as bottlenecks. XL 1-NFE FID 1.72 makes MeanFlow a foundation rather than an endpoint.
  2. Pixel MeanFlow: moves average-velocity generation from latents to pixels; evaluate end-to-end latency and quality without VAE error, not FID alone.
  3. Modular MeanFlow: separates MeanFlow training components, useful for testing independently transferable modules in video/audio/3D.
  4. Contrastive Flow Matching: improves flow matching through representations/contrastive objectives, orthogonal to interval targets and potentially complementary, but extra negative-sample compute must be controlled.
  5. Fair Benchmarking of Emerging One-Step Generative Models: aligns parameters, training volume, and evaluation protocols beyond 1 NFE, directly addressing fairness concerns.
  6. Decoupled MeanFlow(ICLR 2026 proceedings): focuses on bootstrap-target coupling. Locate the formal entry by title in conference lists; this report cites no unverified numbers.

18. Reproduction blueprint and final assessment

A minimal credible reproduction has three layers. Verify the official MF-B/4 checkpoint's claimed FID 11.4 and hash the FID statistics. Train B/4 per Table 4 and reproduce three key Table 1 comparisons:r≠t=0/25%, correct/incorrect JVP, and ω=1/3. Then scale to B/2 or XL/2 with at least three seeds. Always report wall-clock training, JVP share, peak memory, and end-to-end generation latency.

MeanFlow offers a simple transferable idea: learn average velocity for one-step generation, using a calculus identity to make it trainable. ImageNet results surpass prior from-scratch one-step quality, but contributions of the equation, CFG, scale, and cross-dataset robustness remain incompletely separated. Research should reuse average-quantity reparameterization, correct JVP, and training-time guidance; engineering should verify GPU costs and multi-seed stability before promising FID 3.43.


Sources and audit footnote. The core and five related PDFs were read page by page; numbers cite tables/pages. Unlisted exact values were not guessed from plots. HTML uses inline CSS/JS, light/dark themes, and responsive tables; charts use only Table 2's reported 1-NFE values.ml-report-index.md This entry was appended after generation. A local Playwright Chromium probe found the package installed, but /usr/bin/chromium、/opt/pw-browsers and recorded browser paths had no executable. The no-playwright-install constraint was respected, preventing real light/dark/mobile screenshots. Alternative checks included Warm Editorial validation (0 warnings), placeholder/structure scans, table scrolling, mobile queries, theme variables, and tooltip keyboard focus; these are not claimed as screenshot validation.