0. Link verification table
All links were accessed on 2026-08-22. Version dates follow arXiv submission history; “not found” means unverified through PMLR/OpenReview, arXiv, and public author pages, not definitive nonexistence.
| The paper | Conference website / publication page | arXiv (specific version) | Code repository | Datasets / weights | Project page / video |
|---|---|---|---|---|---|
| LIMEFLDL (core) | ICML 2025 / PMLR; OpenReview | Not found | Not public / not found | Reuses LDL datasets; LDL dataset homepage | Not found |
| Label Distribution Learning | Author page corresponding to IEEE TKDE 2016 | 1408.6027v2, 2016-04-05 | Author's MATLAB implementation | 14 public LDL datasets | Same author page as at left |
| LIME | KDD 2016 / arXiv paper page | 1602.04938v3, 2016-08-09 | marcotcr/lime | Not applicable / not separately released | Not found |
| SHAP | NeurIPS 2017 paper PDF | 1705.07874v2, 2017-11-25 | shap/shap | Not applicable | Author paper page (video/code links) |
| GLIME | NeurIPS 2023 | 2311.15722v1, 2023-11-27 | thutzr/GLIME | Not applicable | OpenReview |
1. Search, deduplication, and random selection
1.1 Deduplication
Checked local ml-report-index.md. The Theory and Trustworthiness core work in the past 14 days was Sparse Autoencoders Do Not Find Canonical Units of Analysis on 2026-08-15, concerning atomicity of SAE representations. This issue excludes SAE canonicality, dictionary width, and meta-SAE. LIMEFLDL concerns post-hoc local explanations, label-distribution constraints, and stability theory, without topic duplication.
1.2 Candidate pool (20 papers)
Candidates were cross-searched through ICML 2025 PMLR, NeurIPS 2025 proceedings, OpenReview, and arXiv; core candidates are at most 24 months old.
- Mechanistic Unlearning (ICML 2025)
- GaussMark (ICML 2025)
- Evaluating Neuron Explanations (ICML 2025)
- InfoCons (ICML 2025)
- Counterfactual Effect Decomposition (ICML 2025)
- RISE (ICML 2025)
- LIMEFLDL (ICML 2025)
- TIMING (ICML 2025)
- From Mechanistic Interpretability to Mechanistic Biology (ICML 2025)
- Layer-wise Alignment (ICML 2025)
- SafetyAnalyst (ICML 2025)
- Safety Neurons (NeurIPS 2025)
- Finding and Reactivating Post-Trained LLMs’ Hidden Safety Mechanisms (NeurIPS 2025)
- Refusal Direction is Universal Across Safety-Aligned Languages (NeurIPS 2025)
- Lifelong Safety Alignment for Language Models (NeurIPS 2025)
- JailBound (NeurIPS 2025)
- The VLLM Safety Paradox (NeurIPS 2025)
- COUPLE (NeurIPS 2025)
- CARES (NeurIPS 2025)
- CoP: Agentic Red-Teaming for LLMs (NeurIPS 2025)
Running shuf -i 1-20 -n 1 returned 7, selecting LIMEFLDL. The homepage, 24-page text, theoretical appendices, experiments on four black-box models, and human-evaluation materials were readable and sufficient, zero redraws.
2. In-depth analysis of the core paper
2.1 Motivation: independent explanations break distributions, not simply “LIME lacks multilabel support”
LDL outputs are not unrelated classification probabilities but a description-degree vector (D_i=[d_{x_i}^{y_1},\ldots,d_{x_i}^{y_r}]), with each entry in ([0,1]) and a sum of 1. It expresses how strongly each label describes an instance. Emotion images can express relative intensities of multiple emotions; disease states can involve co-occurrence and propagation dependencies. Original LDL work validated dedicated modeling on 1 synthetic and 15 real datasets; the author's public page lists 14 real datasets, including Human Gene with 30,542 instances and 68 labels, showing this is not merely a toy output form (Geng 2016 abstract/dataset page).
Running LIME (r) times in parallel seems natural but creates three structural failures: independent label fits miss dependencies, repeated sampling/training scales linearly with (r), and predictions lack joint simplex constraints, allowing negative description degrees or sums other than 1. This last concern is empirical: PULIME in Tables 2, 3, 6, and 7 repeatedly produces negative KL divergence, such as dataset 6 in Table 7 at (-0.6579\pm0.0160). Standard KL cannot be negative, so this signals invalid probability outputs rather than better fitting.
Traditional single-label explanations ask which features support a class; LDL explanations must ask how a feature redistributes description degrees across all labels. The explanation becomes a matrix (A\in\mathbb{R}^{r\times f}) rather than a vector (a\in\mathbb{R}^f), with each column showing one feature's effect on the entire distribution. Valid explanations must jointly satisfy local fidelity, probability validity, seed consistency, and cross-label coupling.
2.2 Narrative: from parallel-LIME counterexamples to constrained matrix regression
The argument has four turns.
First, retain LIME's assumption that a complex function can be locally approximated by a simple linear model; change the surrogate's output geometry, not the local-surrogate idea. Second, combine feature–label attributions into matrix (A), sharing one local sample set across labels. Third, constrain prediction rows to sum to 1 with nonnegative entries, keeping explanations on the simplex. Fourth, to explain stability, derive analytical solutions ignoring some regularizers, convergence sample complexity, and stability bounds between nearby black boxes.
The tradeoff is clear: joint matrix optimization buys valid distributions and label dependence, but replaces independent ridge regressions with linear/nonnegativity constraints. ADMM-style augmented terms plus L-BFGS yield a scalable implementation, yet leave a theory–solver gap: the strongest convergence theorem explicitly omits regularization.
2.3 Formal definitions and mechanism analysis
For instance (x), generate (m) local interpretable representations forming (Z\in{0,1}^{m\times f}). After adding a bias column, denote it (Z'=[Z;1]). Black-box LDL outputs on inverse-transformed samples (h(Z)) are (F(h(Z))\in[0,1]^{m\times r}). The local linear surrogate is:
[ G(Z)=ZA^\top+b=Z'A'^\top. \tag{1–2, main text p.3} ]
Each sample is weighted by distance:
[ \pi(z_i)=\exp{-\sigma^{-2}\lVert 1-z_i\rVert_2^2},\quad \Pi=\operatorname{diag}(\pi(z_i)). \tag{3, main text p.3} ]
The core objective is constrained weighted multioutput ridge regression:
[ \min_{A'}\frac{1}{2m}\left\lVert\Pi(Z'A'^\top-F(h(Z)))\right\rVert_F^2 +\frac{\lambda}{2m}\lVert A'\rVert_F^2, ]
[ \text{s.t.}\quad Z'A'^\top\mathbf 1_r=\mathbf 1_m,\qquad Z'A'^\top\ge 0. \tag{4, main text p.4} ]
These constraints are central: the first makes every local prediction sum to 1; the second forbids negative description degrees. The solver places the sum constraint in an augmented Lagrangian with multiplier (u) and penalty coefficient ( ho), while nonnegativity uses penalty (v\sum\max(-Z'A'^\top,0)). Equation (7) provides gradients, L-BFGS updates (A'), and Equation (6) updates (u).
Feature selection evaluates the whole distribution after selecting features rather than truncating each label independently:
[ S=1-\frac{KL(G(Z_c),F(h(Z)))}{KL(Y_{mean},F(h(Z)))}. \tag{8, main text p.4} ]
The denominator uses a uniform distribution as an uninformative reference; (S) measures how much distributional information selected features recover beyond it. A hidden risk is numerical sensitivity when black-box outputs are nearly uniform and the denominator is tiny; the paper does not separately evaluate this boundary.
Instance x to explain
├─ Images: Quickshift → f superpixels → Bernoulli retain/mask
└─ Tables: entropy bins → Bernoulli same/different bin → inverse discretization
↓
m local samples Z and weights Π
↓
Black-box LDL outputs F(h(Z)): m × r label distributions
↓
Constrained matrix surrogate G(Z)=Z'A'^T
├─ Each row sums to 1
├─ All entries nonnegative
└─ Frobenius regularization + L-BFGS/augmented terms
↓
A: attribution distribution across f features × r labels
↓
Distribution-level fidelity + Top-K Jaccard consistency
| Mechanism / dimension | Design choice | Motivation | Key hyperparameters / implementation |
|---|---|---|---|
| Local representation | Image superpixels; entropy bins for tables | Compatible with LIME's human-readable feature switches | Quickshift kernel_size=4, max_dist=200, ratio=0.2; seed=2024 (Appendix A.1, p.11) |
| Joint attribution | (A\in\mathbb{R}^{r\times f}) | Explain the entire label distribution and dependencies at once | Uniform initialization; bias extends it to (A') |
| Neighborhood weights | Cosine for images; L2 for tables | Avoid image L2 assigning zero weight to every sample except the target | Default bandwidth stated as (0.75\sqrt f) (Appendix A.3, p.12) |
| Validity | Rows sum to 1 + nonnegativity | Ensure surrogate outputs remain label distributions | (lambda=v=\rho=0.01), (u^{(0)}=0) (Appendix A.1) |
| Optimization | L-BFGS + augmented constraints | Avoid explicit high-order matrix inversion while handling constraints | At most 50 L-BFGS iterations (Appendix A.1) |
| fidelity | 4 distances + 2 similarities; R² added in appendix | Single-label R² cannot capture distribution geometry | Fidelity experiments: (m=100), Top-10 features |
| consistency | Top-K Jaccard over 10 seeds | Check explanation stability against randomness | Consistency experiments: (m=1000), unrestricted feature rankings |
2.4 Theory: meaningful bounds, not a complete guarantee for the implemented algorithm
Ignoring regularization constraints in a simplified problem yields an approximate analytical expression:
[ A'^\top=(Z'^\top\Pi Z')^{-1}\big[Z'^\top\Pi F(h(Z))-Z'^\top u\mathbf 1_{1\times r}\big]. \tag{11, main text p.4} ]
Theorem 3.2 bounds ( ho) so the iterative map is contractive; Theorem 3.3 uses matrix Hoeffding inequalities for sample complexity. Its leading term includes (f^3e^{5/\sigma^2}\epsilon^{-2}\log(4f/\delta)), so dimension (f) and small bandwidth (sigma) rapidly increase required samples. Theorem 3.4 states that if two black boxes differ by less than (epsilon) in each output on local samples, the Frobenius distance between their attribution matrices is bounded by a quantity depending on (m,f,r,e^{1/\sigma^2}epsilon).
The value is not proving the actual implementation invariably stable, but quantifying three intuitions: more samples approach a fixed point; narrower neighborhoods require more samples; and closer local black-box outputs yield closer explanations. Appendix A.4 visualizes convergence for AA-KNN, MEM, and other models at (m=100,500,1000,5000), without tabulated values for recalculation. A phase-transition clue comes from Appendix B.3: when (sigma<1) and dimension exceeds 10, the polynomial degree in the sample bound becomes impractical; as (sigma\to0), attributions approach 0 and coefficient signs may change with bandwidth. This is a clear theoretical transition region, not a precise empirical threshold.
2.5 Datasets, metrics, and protocols
| ID | Dataset | Sample count | Feature count | Label count | Modality / source |
|---|---|---|---|---|---|
| 1 | Yeast alpha | 2,465 | 24 | 18 | Tabular / biological |
| 2 | Yeast cold | 2,465 | 24 | 4 | Tabular / biological |
| 3 | JAFFE | 213 | 243 | 6 | Tabularized emotions |
| 4 | SBU 3DFE | 2,500 | 243 | 6 | Tabularized emotions |
| 5 | Emotion6 | 1,980 | 168 | 7 | Tabularized emotions |
| 6 | Natural Scene | 2,000 | 294 | 9 | Tabularized scenes |
| 7 | Image-JAFFE | 213 | 243 | 6 | Image |
| 8 | Image-Emotion6 | 1,980 | 168 | 7 | Image |
Data comes from Table 1 (p.6). Black boxes include RBF-LDL-LRR, LDL-SCL, AA-KNN, and MEM. Main fidelity metrics are Chebyshev, Clark, Canberra, and KL (lower is better), plus Cosine and Intersection (higher is better); consistency uses Top-K Jaccard across 10 seeds (higher is more stable). Each dataset uses 10-fold cross-validation; Tables 2, 3, 6, and 7 report means/standard deviations (p.8). The aggregation level of standard deviations—folds, samples, or seeds—is unspecified, so these cannot be treated as CIs from independent retraining.
2.6 Main-results matrix: 8 datasets × 4 explainers
Appendix Table 5 compares LIMEFLDL, LIME, DLIME, and GLIME using LIME-compatible R², the closest fair multibenchmark/multimethod comparison. The table is transcribed fully, adding absolute and relative gains over each row's strongest competitor. “—” means unreported.
| Black box | Dataset ID | LIME | DLIME | GLIME | LIMEFLDL | Gap to strongest competitor | Relative change |
|---|---|---|---|---|---|---|---|
| LDL-SCL | 1 | 0.16 | 0.15 | 0.16 | 0.67 | +0.51 | +318.8% |
| LDL-SCL | 2 | 0.15 | 0.15 | 0.16 | 0.67 | +0.51 | +318.8% |
| LDL-SCL | 3 | 0.48 | 0.35 | 0.34 | 0.58 | +0.10 | +20.8% |
| LDL-SCL | 4 | 0.39 | 0.33 | 0.34 | 0.40 | +0.01 | +2.6% |
| LDL-SCL | 5 | 0.34 | 0.25 | 0.25 | 0.30 | −0.04 | −11.8% |
| LDL-SCL | 6 | 0.37 | 0.34 | 0.32 | 0.38 | +0.01 | +2.7% |
| LDL-SCL | 7 | 0.94 | — | 0.95 | 0.99 | +0.04 | +4.2% |
| LDL-SCL | 8 | 0.89 | — | 0.89 | 0.98 | +0.09 | +10.1% |
| RBF-LDL-LRR | 1 | 0.17 | 0.17 | 0.16 | 0.99 | +0.82 | +482.4% |
| RBF-LDL-LRR | 2 | 0.16 | 0.15 | 0.17 | 0.99 | +0.82 | +482.4% |
| RBF-LDL-LRR | 3 | 0.34 | 0.33 | 0.33 | 0.36 | +0.02 | +5.9% |
| RBF-LDL-LRR | 4 | 0.25 | 0.31 | 0.29 | 0.36 | +0.05 | +16.1% |
| RBF-LDL-LRR | 5 | 0.26 | 0.47 | 0.36 | 1.00 | +0.53 | +112.8% |
| RBF-LDL-LRR | 6 | 0.52 | 0.49 | 0.47 | 0.99 | +0.47 | +90.4% |
| RBF-LDL-LRR | 7 | 0.93 | — | 0.96 | 0.99 | +0.03 | +3.1% |
| RBF-LDL-LRR | 8 | 0.67 | — | 0.94 | 0.99 | +0.05 | +5.3% |
Source: Appendix Table 5, p.14; relative changes recomputed here. On LDL-SCL, method macro-averages are LIME 0.465, DLIME 0.262 (6 reported entries only), GLIME 0.426, and LIMEFLDL 0.621; on RBF-LDL-LRR, respectively 0.413, 0.320 (6 entries), 0.460, and 0.834. The strongest evidence is RBF-LDL-LRR datasets 1/2: 0.17→0.99, absolute +0.82, relative +482.4%. Yet the same table has a counterexample: LDL-SCL/tabular Emotion6 drops 0.34→0.30, a relative 11.8% deficit.
Table 2's Jaccard suggests joint explanations are usually more stable: on RBF-LDL-LRR, dataset 2 rises 0.3608→0.6200 (+0.2592, +71.84%), and dataset 8 rises 0.1591→0.7903 (+0.6312, +396.73%). Dataset 1 instead drops 0.6428→0.5044 (-21.53%). Universal stability superiority is false; gains are clearer for non-nearly-uniform label distributions, especially images, and inconsistent on nearly uniform biological data.
2.7 Ablations, sensitivity, and statistical significance
Progressive component ablations: unreported. There is no staircase comparison of joint matrix regression alone, +sum-to-one, +nonnegativity, +new feature scoring, and +L-BFGS. R²/Jaccard gains cannot be assigned to components. Table 5 adds baselines but is not mechanistic ablation.
| Available sensitivity evidence | Value | Paper observation | Can a transition be located? |
|---|---|---|---|
| Sample count (m) | 100, 500, 1000, 5000 | Top-20 Jaccard rises and stabilizes with (m) (Figure 4, Appendix A.4) | Trend only; exact point values absent |
| Bandwidth (sigma) | Theory analyzes (sigma<1), (sigma\to0) | (f>10), where convergence sample bounds worsen; at the limit, attributions approach zero and signs can change (Appendix B.3, p.21) | Theoretical transition region, no empirical threshold table |
| Optimization iterations | Maximum 50 | Authors state this balances accuracy/efficiency (Appendix A.1) | No 10/20/50/100 sweep to establish optimality |
| Penalty coefficients | (lambda=v=\rho=0.01) | Fixed throughout experiments | No sensitivity study, so robustness unestablished |
Reporting 10-fold means±standard deviations is a strength. For example, Table 3/dataset 6 Chebyshev falls from (0.3584\pm0.0036) to (0.1692\pm0.0030), an absolute decrease of 0.1892 (52.79%). However, no p-values, bootstrap CIs, multiple-comparison correction, or independent training seeds appear. Human evaluation reports means only: 2.1 versus 3.1 for correct predictions and 2.3 versus 3.0 for incorrect ones (Figure 3, p.9), without variance/significance tests.
2.8 Genuine contributions, reusable designs, and transfer potential
The contribution is not applying LIME to LDL, but recognizing that an explainer's output space must respect the structure of the task being explained. Scalar surrogates for single-label classification cannot safely be copied column-wise to distributions. Ranking, sets, graphs, sequences, and multitask outputs likewise should encode feasible-domain constraints in the surrogate, not clip explanations afterward.
Three designs are reusable. First, attribution-distribution matrices extend importance into how features move mass across output dimensions, relevant to MoE routing, multiattribute risk scores, or multiobjective decisions. Second, distribution-level fidelity reports multiple distances/similarities rather than allowing one R² to conceal invalid probabilities. Third, bounds linking black-box-output perturbations to attribution-matrix perturbations offer a template for auditing explanation drift after model updates.
Transfer the principle rather than the implementation: replace simplices with ranking cones, flow conservation, multilabel marginal polytopes, or physical conservation constraints for compositional outputs; reduce (A)'s (fr) parameters via low-rank/sparse structure for high-dimensional outputs; replace one-off sampling with reusable neighborhood caches and drift-triggered updates for online data.
2.9 Limitations
Limitations stated by the paper
- Discontinuous binning: Appendix A.3 (p.12) acknowledges nearby instances in one bin receive identical explanations, while crossing a bin boundary can change explanations sharply. More bins or no discretization mitigate but do not solve boundary discontinuities.
- Difficult convergence with small bandwidth and high dimensions: Appendix B.3 (p.21) notes that when (sigma<1) and (f>10), Theorem 3.3's sample requirements are difficult to satisfy, leaving behavior dominated by regularization omitted from theory.
- Extreme bandwidth degenerates explanations: The same passage states (sigma\to0) implies (A\to0), with coefficient signs varying by bandwidth, directly limiting stable interpretations of signs as promoting/inhibiting.
Additional critique
- [Missing key competitors] Main Tables 2/3 compare directly only with the authors' PULIME; GLIME/DLIME appear only in Appendix Table 5 with default parameters, R², and no standard deviations. This does not establish superiority over strong stable-LIME variants on core distribution metrics. Compare a distributional GLIME extension under identical sampling, (m), and solver budgets.
- [Metric validity] PULIME repeatedly yields negative KL across four main tables, such as -0.6579 in Table 7/ID6, while valid KL must be nonnegative. This mixes fidelity with invalid outputs; circling anomalies while counting most-metric wins can exaggerate constrained methods' advantages. First project all baselines onto the simplex, then compare KL.
- [Failing subtask] Appendix Table 5's LDL-SCL/ID5 gives LIMEFLDL=0.30 versus LIME=0.34, an 11.8% relative deficit. Joint constraints do not unconditionally improve local R², potentially trading local freedom for validity on tabular Emotion6.
- [Experimental design] Fidelity uses (m=100), consistency (m=1000), so they are not evaluated at the same sampling budget. “More stable and faithful” is not a same-configuration Pareto advantage. Fix (m\in{100,500,1000,5000}) and report fidelity, Jaccard, and latency together.
- [Conflicting metrics] Table 2/ID8 Jaccard rises 0.1591→0.7903, but Chebyshev worsens 0.0003→0.0033, Clark 0.0032→0.0116, and Canberra 0.0069→0.0236. Approximately 396.7% better consistency accompanies substantially worse distances. Stable repetition is not faithful approximation; multiobjective Pareto analysis is missing.
- [Human-evaluation validity] Appendix A.2 has only 10 graduate students, 20 cases each, with 7 specializing in ML—a small, expert-biased sample. The text also says 10 people in each of two parts, leaving participant overlap unclear. Mean gains of 1.0/0.7 lack variance, blinding, randomized order, and significance, preventing extrapolation to end users.
- [Argument gap] Theorem 3.3 explicitly omits regularization, while the actual algorithm fixes (lambda=v=\rho=0.01) and runs 50 L-BFGS steps. The theoretical fixed point differs from the deployed algorithm's. Measure convergence gaps between the unregularized analytical and actual optimized versions.
- [Reproducibility] No core-paper code repository was found by verification, and Table 5 calls DLIME/GLIME settings default. Appropriate LDL tuning and exact Figures 4/5 curves cannot be checked. Fixing seed=2024 reduces one run's randomness but cannot replace public code or multiseed validation.
3. Related-work retrospective: transfer of problems and techniques
3.1 Label Distribution Learning — 2016, IEEE TKDE
What it solved. Geng extends label ambiguity from binary relevance to sum-to-one description degrees, proposing 6 algorithms across problem transformation, adaptation, and specialized design, evaluated with 6 metric classes on 1 synthetic and 15 real datasets. This defines LIMEFLDL's object: a normalized vector rather than a class decision.
Remaining gap. Original LDL focuses on prediction and algorithms, with public BFGS/IIS/CPNN/LDSVR implementations and data but no dedicated local explainer for why an instance receives a distribution. Richer outputs increase the chance that independent label explanations violate sum/nonnegativity constraints.
How the core paper responds. LIMEFLDL directly encodes LDL's simplex definition as surrogate constraints: (G(Z)\mathbf1=\mathbf1), (G(Z)\ge0), within optimization rather than postprocessing.
Inherited design. LDL's distribution-distance evaluation transfers into explanation fidelity: Chebyshev, Clark, Canberra, KL, Cosine, and Intersection translate prediction evaluation into explanation evaluation.
3.2 LIME — 2016, KDD
What it solved. LIME fits sparse interpretable surrogates to weighted local data, explaining arbitrary classifiers near individual instances; human experiments address trust in predictions/models. Its core combines locality kernel (pi_x), interpretable representation (z), and simple model (g).
Remaining gap. The original target is single-output explanation; random perturbations cause instability, and reference points/bandwidth alter explanations. Independent application to LDL labels multiplies compute by (r) and produces outputs that may not be distributions.
How the core paper responds. LIMEFLDL preserves sampling–weighting–local-linear-surrogate structure, replacing scalar with matrix regression and obtaining all (r) outputs in one black-box batch inference.
Inherited design. Quickshift superpixels, entropy discretizers, cosine/L2 distances, and locality kernels carry over directly. Changes concern output space and constraints, not input perturbations.
3.3 SHAP — 2017, NeurIPS
What it solved. SHAP unifies 6 explanation classes as additive feature attribution and establishes a unique solution structure satisfying local accuracy, missingness, and consistency, moving reliability from visual intuition to axioms.
Remaining gap. Generic additive SHAP does not automatically keep multioutput vectors in task-specific feasible sets; per-output SHAP values can struggle to express coupling and conservation among label description degrees.
How the core paper responds. LIMEFLDL Property 3.5 expresses the matrix surrogate as a sum of feature-attribution vectors, proving compatibility with additive feature attribution; Properties 3.6/3.7 discuss dummy and symmetry.
Inherited design. Axiomatic checks for local accuracy, dummy, and symmetry carry over from scalars to (r)-dimensional attribution vectors. The paper does not prove Shapley uniqueness, instead choosing an optimizable local linear matrix.
3.4 GLIME — 2023, NeurIPS Spotlight
What it solved. GLIME shows that tiny LIME sample weights let regularization dominate and slow convergence. It absorbs weights into local unbiased sampling distributions to improve stability/fidelity and reduce reference dependence; code offers binomial and other distributions.
Remaining gap. GLIME improves where to sample and convergence stability, not LDL probability constraints or dependencies. Stable individual columns still need not form a distribution together.
How the core paper responds. LIMEFLDL advances an orthogonal axis: output structure rather than sampling distribution, with convergence/stability bounds depending on (m,f,r,\sigma).
Inherited design. GLIME's warnings about bandwidth, weights, and regularizer dominance recur as exploding small-(sigma) sample complexity in LIMEFLDL Appendix B.3. Yet only default GLIME R² comparisons appear in Table 5; unbiased local sampling and simplex constraints have not actually been combined.
Macro-average R²: gains from joint distribution constraints depend on the black box
Macro-average over 8 datasets; DLIME averages only 6 available entries because image results are absent. One Y-axis; higher is better.
4. Technical evolution
2016 LDL: one-hot/multi-hot outputs → label description-degree distributions
│
└── Task structure demands simplex preservation
2016 LIME: arbitrary black boxes → locally weighted linear surrogates
├── Local sampling, interpretable switches, sparse attribution
└── Gaps: single outputs, random instability, independent labels break distributions
2017 SHAP: explanation families → unified additive-attribution axioms
└── local accuracy / dummy / consistency
2023 GLIME: redesign sampling → faster convergence, stability, locality
└── Addresses input neighborhoods, not structured outputs
2025 LIMEFLDL: LIME input structure + SHAP-style properties + LDL simplex
├── One f×r attribution matrix explains every label jointly
├── Sum-to-one/nonnegativity ensure valid outputs
└── Still needs GLIME unbiased sampling and full regularized theory
The driver is moving from scalar predictions to structured output objects. First readability, then axioms/stability, then task geometry enter explainers. The turning point is not richer visualization but recognizing post-hoc explanations as predictive models that must obey the original task's feasible domain.
| Work | Publication date | Conference/publication | Core contribution | Main quantitative evidence | Relationship to the core paper |
|---|---|---|---|---|---|
| Label Distribution Learning | 2016.07 | IEEE TKDE 28(7) | Defines description-degree distributions and 6 algorithm classes | 1 synthetic + 15 real datasets (abstract) | Supplies the problem, data, and distribution metrics |
| LIME | 2016.08 | KDD 2016 | Locally weighted interpretable surrogates | Text, image, and human-evaluation settings (abstract) | Supplies sampling–weighting–linear-surrogate structure |
| SHAP | 2017.11 | NeurIPS 2017 | Unifies additive attribution with axioms | Unifies 6 method classes (abstract) | Source of local accuracy/dummy properties |
| GLIME | 2023.11 | NeurIPS 2023 Spotlight | Local unbiased sampling improves stability/fidelity | Reports faster convergence; public implementation example (n=1024) | Strong sampling-stability baseline, only partly compared by the core paper |
| LIMEFLDL | 2025.07 | ICML 2025 | Simplex-constrained distribution-level attribution matrix | Table 5: two RBF benchmarks 0.17→0.99; human evaluation 2.1→3.1 | Combines output structure, local surrogates, and axiomatic analysis |
5. Open challenges and actionable research opportunities
5.1 Theory
- Complete regularized convergence theory. For identical (Z,Pi), compare unregularized closed forms, exact convex solutions with (lambda\lVert A\rVert_F^2), and the paper's 50-step L-BFGS solution. Plot (lVert A_{closed}-A_{actual}\rVert_F) against (m,f,r,\sigma) to determine when theoretical bounds predict practice.
- Locate bandwidth–dimension transitions. At fixed target fidelity, sweep (f\in{8,16,32,64,128,256}) and (sigma\in{0.25,0.5,0.75,1,1.5,2}), measuring minimum (m) for Jaccard 0.9 and comparing pointwise with theoretical (e^{5/\sigma^2}f^3) scaling.
- Uniqueness axioms for structured outputs. Compare per-label Shapley followed by projection, conservation-preserving Shapley, and LIMEFLDL matrices. Test joint satisfiability of local accuracy, dummy, symmetry, and simplex conservation, and whether solutions are unique.
5.2 Engineering and Applications
- Equal-budget head-to-head evaluation. At equal black-box calls, CPU/GPU time, and memory, compare PULIME, GLIME-LDL, KernelSHAP-LDL, and LIMEFLDL. Report all 6 fidelity metrics, Jaccard, and latency for each (m), eliminating the current 100/1000-sample mismatch.
- Ablate sources of validity. Compare unconstrained matrix regression, sum-to-one only, nonnegativity only, both, and added feature scoring. Measure invalid-output rates, negative-KL counts, R², and Jaccard to quantify each constraint's benefits/costs.
- Continuous neighborhoods instead of bins. On tabular data, compare entropy bins, soft bins, normalizing-flow conditional samplers, and no discretization. Construct sample pairs (10^{-6}) apart across boundaries and measure Lipschitz ratios of explanation jumps.
- Deployment-scale caching. For a 30,542×36×68 Human Gene stream, compare per-request sampling with neighborhood caching. Update the black box every 1,000 steps and report explanation latency, cache hits, and drift errors.
5.3 Emerging Directions
- Calibration consistency in medical probability explanations. With matched cases and blinded physicians, compare LIMEFLDL, temperature-calibrated projected LIME, and inherently interpretable models. Report fidelity, calibration error, physician diagnosis-change rates, and erroneous confidence.
- Multiattribute VLM outputs. Jointly perturb image patches and text tokens for safety/factuality/relevance scores. Compare independent block explanations with cross-modal conserving matrices, testing attribution stability under prompt paraphrases.
- Privacy and explanation leakage. Under membership inference, compare publishing full (A), Top-K (A), and differentially private attribution. Plot attack AUC and fidelity against (epsilon_{DP}) to obtain privacy Pareto frontiers for trustworthy explanations.
6. Other recent work worth watching
Mechanistic Unlearning (2025.07, ICML)
Locates knowledge editing/unlearning in predictable intermediate mechanisms rather than merely output-preserving components, arguing mechanistic localization resists relearning attacks better than locating correlated parameters. The paper
GaussMark (2025.07, ICML)
Embeds watermarks in weight structure and uses Gaussian-independence tests for validity/power bounds; its zero-generation-latency claim and corruption robustness merit attention. The paper
Evaluating Neuron Explanations (2025.07, ICML)
Unifies neuron-explanation evaluation with sanity checks, showing some common metrics barely change despite major concept-label changes and challenging the equation of high scores with faithfulness. The paper
InfoCons (2025.07, ICML)
Uses information theory to divide point clouds into faithful, semantically coherent concepts, validated on synthetic/real 3D data and relevant to structured explanation. The paper
Counterfactual Effect Decomposition (2025.07, ICML)
Decomposes counterfactual total action effects in multiagent MDPs into paths through agent behavior and environment states, then attributes effects to agents/variables with Shapley values. The paper
RISE (2025.07, ICML)
Extracts explanatory subgraphs for 3D molecular GNNs around influence radii, linking geometric neighborhoods and outputs as a structured-input counterpart to LIMEFLDL. The paper
7. Conclusion
LIMEFLDL is best understood not as a vertical LIME variant but as a reusable trustworthy-AI principle: post-hoc explainers must inherit the prediction task's output geometry. Appendix Table 5 raises strongest-row-competitor R² from 0.17 to 0.99 (+0.82, +482.4%) on RBF-LDL-LRR datasets 1/2, and correct-prediction human ratings from 2.1 to 3.1. Yet LDL-SCL/tabular Emotion6 falls 0.34→0.30, and main results show consistency–fidelity conflicts.
The paper opens research on structure-preserving explanations rather than completing LDL interpretability. The key next step is not another heatmap, but equal budgets, valid projected baselines, full component ablations, and regularized convergence theory to determine whether gains arise from validity, label dependence, or greater joint-fitting freedom.
Verification and transparency
- Core figures come from directly read ICML 2025/PMLR PDF Tables 1–3, Appendix Tables 4–7, Figures 1–5 descriptions, and Appendices A/B. Derived percentages were recalculated.
- Component ablations, penalty sweeps, exact hyperparameter-curve coordinates, p-values, and CIs are unavailable; relevant sections retain these omissions as “unreported,” without invention.
- As of 2026-08-22, no core-paper arXiv entry or author repository was verified. OpenReview exists but triggered browser verification; PMLR text/PDF were accessible.
- HTML passed the Warm Editorial static validator (0 warnings); the runtime provided no Chromium executable under
/usr/bin/chromiumor/opt/pw-browsers, and the instruction not to run playwright install prevented light/dark/mobile screenshot checks. Responsive table scrolling, theme variables, and SVGviewBoxwere checked deterministically. ml-report-index.mdwas appended during this generation workflow; if remote persistence fails, the local index takes precedence.