LLM-generated corrections to the published research of P. M. Aronow

Journal article P005

Corrections to: Exact Bias Correction for Linear Adjustment of Randomized Controlled Trials

Haoge Chang, Joel A. Middleton, and P. M. Aronow (2024). Exact Bias Correction for Linear Adjustment of Randomized Controlled Trials. Econometrica 92(5):1503–1519.

DOI
10.3982/ECTA20289
arXiv
2110.08425
Audited edition
Econometrica, 2024, 92(5):1503–1519; 18 pages in the audited file
SHA-256 of the audited file
3dab5dd9d1c112bb75028fa4f81cf1e9da3142d48327697e24a4f1c0778e3f38
Permanent address
https://pmaronow.github.io/llm-audit/works/P005/

Summary

The article addresses Freedman’s objection that regression adjustment is biased in completely randomized experiments. It derives closed-form estimators of the bias of the noninteracted and interacted OLS estimators of the average treatment effect. Its results are that the bias-corrected estimators are exactly unbiased and, under Freedman’s assumptions, have the limiting distributions of the uncorrected ones. 16 entries are classified as errors (1 Moderate, 15 Minor), and 2 are clarity notes. These are counts of entries: P005-N004 expands the discussion of the same defect as P005-E001 and adds no separate error. The most consequential error is in the last display of Theorem 4.1, which prints the third component of the bias with both signs reversed (P005-E003). The bias correction of Theorem 4.2 has the correct signs.

What was and was not checked

I checked the following points, which held up. This list is not a statement that the article is correct, and the absence of a correction elsewhere is not a finding of correctness.

  • The bias estimators of Theorems 3.2 and 4.2 were derived again from the moments of simple random sampling. Enumeration of every assignment confirmed unbiasedness to numerical precision in several small designs and in the twelve designs with n=24n=24 and nT=8n_T=8 of the replication files.
  • In Theorem 3.1, the decomposition β^=β∗+ν1+ν2+ν3\widehat\beta=\beta^*+\nu_1+\nu_2+\nu_3 and equations (5) and (6) were derived again and agree with enumeration. In Theorem 4.1, the same holds for the decomposition and the first display. The last display is corrected in P005-E003.
  • The expectation identity of Lemma A.1 was derived again for vectors that need not be centered. Lemma A.2 and each step of its proof were checked, apart from the misprints corrected in P005-E005, and so were the constants NTTTN_{\mathrm{TTT}}, NCCCN_{\mathrm{CCC}} and NTTCN_{\mathrm{TTC}}.
  • The stochastic expansions of Theorems 3.1, 3.2 and 4.2 were followed step by step through Appendices B.1.1, B.2 and B.4. The stated rates hold once Lemma A.1 is used in its centered form (P005-E002). The expansion of Theorem 4.1 was derived for d≥2d\ge2; the case d=1d=1 is corrected in P005-E001, and P005-N004 concerns the same defect.
  • Remarks 1 and 4, the calculation with one covariate on pp. 1507–1508, and footnotes 3 and 4.
  • In the replication files, the functions unbiased.reg.noninteract_new_formula and unbiased.reg.interact_appl_new_formula agree with the estimators of Theorems 3.2 and 4.2 on the enumerated designs.

The cited works were not among the sources and were not checked. The statements taken from Lei and Ding (2021), Freedman (2008b), Wu and Ding (2021), Finucan, Galbraith and Stone (1974) and Lin (2013) were derived again or checked numerically where the argument needs them, and they were not compared with their sources. The results of Lin (2013) on which the conclusion of the article relies were not examined. The statement in footnote 1 and Remark 5 that earlier corrections are not exactly unbiased was not checked. The simulations of the replication files were not run in full, the designs with n=36n=36 were not enumerated, and the scripts in the folder of old files were examined through their differences from the current scripts and targeted checks.

The article contains no table, figure, simulation or empirical estimate, so there was no numerical result to reproduce. No supplement or correction notice was among the sources. The replication files are a snapshot, dated June 2023, of a public repository of research code. The repository is not a journal replication package and predates publication, and its simulations and applications do not appear in the article. My checks of that code cover the selected formulas and implementation errors reported here.

Headline claims and related corrections

  1. For the noninteracted OLS-adjusted estimator of the average treatment effect in a completely randomized experiment, the paper gives a closed-form estimator of the bias that is exactly unbiased in finite samples (including the higher-order terms), so that the corrected estimator is exactly unbiased for the ATE.

    Theorem 3.2, equations (7)-(8); Theorem 3.1; proof B.2

    See P005-E002, P005-E009, P005-E010, P005-N005.

  2. The same holds for the interacted (Lin) estimator: a closed-form, exactly unbiased estimator of its bias, giving an exactly unbiased corrected estimator.

    Theorem 4.2; Theorem 4.1; proof B.4

    See P005-E003, P005-E004, P005-E010, P005-E012, P005-E013, P005-E015, P005-N007.

  3. The bias of the noninteracted estimator splits into three parts; the leading part is −1/(n−1)-1/(n-1) times the finite-population covariance between leverage and the individual treatment effect, it vanishes under additive effects, and the third part vanishes in balanced designs.

    Theorem 3.1, equations (5)-(6); Remark 1; Lemma A.2; proof B.1

    See P005-E005, P005-E007, P005-N005.

  4. The bias of the interacted estimator has an analogous three-part characterization, with closed forms for the first and third parts.

    Theorem 4.1; proof B.3 (details omitted in the paper)

    See P005-E001, P005-E003, P005-E004, P005-N004.

  5. Under Freedman's assumptions, the bias-corrected estimators have the same limiting distributions as the uncorrected ones, so that in large samples the additional variation caused by the correction is negligible.

    Theorems 3.1, 3.2, 4.1 and 4.2 (stochastic expansions); Lemma A.1; Remarks 3 and 4

    See P005-E001, P005-E002, P005-N002, P005-N005, P005-N007.

  6. Taken together with Lin (2013) (treatment-by-covariate interactions and robust standard errors), these results show that Freedman's theoretical objections to regression adjustment can be resolved with minor modifications to practice.

    Theorems 3.2 and 4.2 together with the results of Lin (2013) cited in the introduction

    See P005-E001, P005-E015.

  7. Earlier closed-form bias corrections (Cochran, Lin, Tan, Lei and Ding, Chiang et al.) are not exactly unbiased; to the authors' knowledge this paper is the first to give exactly unbiased corrections for both the interacted and the noninteracted estimator.

    Footnote 1 (p. 1504); Remark 5 (p. 1509)

Corrections

Moderate (1)

A real substantive error with limited reach.

Both signs on the right-hand side of the last display of Theorem 4.1 are reversed.

Theorem 4.1, p. 1509 (PDF p. 8), last display

See also under Formal statements (Lean): P005-T5, P005-T6, P005-T13, P005-T20, P005-T24

As printed

Theorem 4.1 defines ν3T=−(xˉTy∗(1)‾T)\nu_{3T}=-(\bar x_T\overline{y^*(1)}_T) and ν3C=−(xˉCy∗(0)‾C)\nu_{3C}=-(\bar x_C\overline{y^*(0)}_C), and its last display reads

E[xˉC′ν3C]−E[xˉT′ν3T]=nT(nT−nC)(n−1)(n−2)nC2(hy(0)‾−hˉ×y(0)‾)−nC(nC−nT)(n−1)(n−2)nT2(hy(1)‾−hˉ×y(1)‾).\begin{aligned} E\bigl[\bar x_C'\nu_{3C}\bigr]-E\bigl[\bar x_T'\nu_{3T}\bigr] ={}&{}\colorbox{#ffe58a}{$\displaystyle \frac{n_T(n_T-n_C)}{(n-1)(n-2)n_C^2}$}\bigl(\overline{hy(0)}-\bar h\times\overline{y(0)}\bigr)\\ &{}\colorbox{#ffe58a}{$\displaystyle -$}\frac{n_C(n_C-n_T)}{(n-1)(n-2)n_T^2}\bigl(\overline{hy(1)}-\bar h\times\overline{y(1)}\bigr). \end{aligned}
The problem

Theorem 4.1 writes the bias of the interacted estimator as a sum of three components, E[xˉC′νjC]−E[xˉT′νjT]E[\bar x_C'\nu_{jC}]-E[\bar x_T'\nu_{jT}] for j=1,2,3j=1,2,3, and its last display states the third component in closed form. The theorem defines ν3T\nu_{3T} and ν3C\nu_{3C} with a minus sign each. With these definitions, the right-hand side of the last display is the negative of the left-hand side. I write St=hy(t)‾−hˉ y(t)‾S_t=\overline{hy(t)}-\bar h\,\overline{y(t)} for t=0,1t=0,1, and I let NTTTN_{TTT} and NCCCN_{CCC} denote the constants of Appendix A.1. The left-hand side is −NCCCS0+NTTTS1-N_{CCC}S_0+N_{TTT}S_1, and the display prints NCCCS0−NTTTS1N_{CCC}S_0-N_{TTT}S_1. A bias computed by adding the three displayed components is off by twice the third component. The printed and the correct value agree only when the component is zero. This is the case when nT=nCn_T=n_C, so a balanced design does not reveal the error. With unequal arm sizes, the component can also vanish by cancellation between nonzero S0S_0 and S1S_1.

Evidence an exact counterexample

The evidence is a derivation and an exact counterexample. For the derivation, let AA be a uniformly chosen subset of size mm of the n≥3n\ge3 units, and let aa, bb and cc be fixed arrays that each sum to zero. I set s=∑iaibicis=\sum_i a_ib_ic_i. In the sum ∑i,j,kaibjck\sum_{i,j,k}a_ib_jc_k, the terms in which all three indices are equal contribute ss, and the terms in which exactly two indices are equal contribute −3s-3s. The whole sum is zero, so the terms in which the three indices are distinct contribute 2s2s. One, two and three distinct units are included in AA with probabilities q1=m/nq_1=m/n, q2=m(m−1)/(n(n−1))q_2=m(m-1)/(n(n-1)) and q3=m(m−1)(m−2)/(n(n−1)(n−2))q_3=m(m-1)(m-2)/(n(n-1)(n-2)). I obtain

E[aˉAbˉAcˉA]=q1−3q2+2q3m3 s=(n−m)(n−2m)(n−1)(n−2)m2 abc‾.E\bigl[\bar a_A\bar b_A\bar c_A\bigr]=\frac{q_1-3q_2+2q_3}{m^3}\,s=\frac{(n-m)(n-2m)}{(n-1)(n-2)m^2}\,\overline{abc}.

This is the first identity of Lemma A.2. Note that the coefficient is NTTTN_{TTT} for m=nTm=n_T and NCCCN_{CCC} for m=nCm=n_C. Let a=ba=b be a coordinate of xx, which is centered by Assumption 2, and let c=y∗(t)c=y^*(t). Summing over the coordinates and using hy∗(t)‾=St\overline{hy^*(t)}=S_t, I have

E[xˉT′xˉT y∗(1)‾T]=NTTTS1,E[xˉC′xˉC y∗(0)‾C]=NCCCS0.E\bigl[\bar x_T'\bar x_T\,\overline{y^*(1)}_T\bigr]=N_{TTT}S_1,\qquad E\bigl[\bar x_C'\bar x_C\,\overline{y^*(0)}_C\bigr]=N_{CCC}S_0.

By the definitions of ν3T\nu_{3T} and ν3C\nu_{3C}, each of which has a minus sign, I have E[xˉC′ν3C]=−NCCCS0E[\bar x_C'\nu_{3C}]=-N_{CCC}S_0 and E[xˉT′ν3T]=−NTTTS1E[\bar x_T'\nu_{3T}]=-N_{TTT}S_1. This implies that the left-hand side of the last display is −NCCCS0+NTTTS1-N_{CCC}S_0+N_{TTT}S_1.

For the counterexample, let n=6n=6, d=1d=1, x=(−8,−5,0,3,4,6)/5x=(-8,-5,0,3,4,6)/5, yi(1)=xi2y_i(1)=x_i^2 and yi(0)=2xi2+3y_i(0)=2x_i^2+3. Then xˉ=0\bar x=0, x2‾=1\overline{x^2}=1, S1=434/625S_1=434/625 and S0=868/625S_0=868/625, and every arm regression is invertible. For nT=2n_T=2 and nC=4n_C=4, the constants are NTTT=1/10N_{TTT}=1/10 and NCCC=−1/80N_{CCC}=-1/80. Enumerating the 15 assignments in exact arithmetic, I find 217/2500217/2500 for the left-hand side, while the right-hand side as printed is −217/2500-217/2500. For nT=4n_T=4 and nC=2n_C=2 the two values are −3689/25000-3689/25000 and 3689/250003689/25000, and for nT=nC=3n_T=n_C=3 both are zero. If this population is repeated rr times, with nT=2rn_T=2r and nC=4rn_C=4r, the resulting sequence satisfies Assumptions 1–3. On this sequence the third component is 5S1/(2(6r−1)(6r−2))>05S_1/(2(6r-1)(6r-2))>0, and the printed display is the negative of this value.

A second example shows the effect on the total. Let n=5n=5, x=(−3/2,−1/2,0,1/2,3/2)x=(-3/2,-1/2,0,1/2,3/2), y(1)=(0,0,1,0,0)y(1)=(0,0,1,0,0), y(0)=0y(0)=0, nT=2n_T=2 and nC=3n_C=3. Enumerating the 10 assignments, I obtain the entries of the table. The three components add up to the bias of ATE^I\widehat{\mathrm{ATE}}_I only with the third component as defined.

Five-unit example: exact expectations of the components of the bias of ATE^I\widehat{\mathrm{ATE}}_I.
QuantityThird component as definedThird component as printed
First component3/403/403/403/40
Second component11/8011/8011/8011/80
Third component−1/80-1/801/801/80
Sum of the three components1/51/59/409/40
Bias of ATE^I\widehat{\mathrm{ATE}}_I, by enumeration1/51/51/51/5
What survives

The decomposition of the coefficients in Theorem 4.1 and the display for its first component are unaffected, and no stochastic order changes. Theorem 4.2 is unaffected. Its coefficients nT/((n−2)nC)n_T/((n-2)n_C) and −nC/((n−2)nT)-n_C/((n-2)n_T) follow from the corrected signs, and the opening display of its proof in Appendix B.4 carries the correct sign through an outer minus. In the six-unit example the mean of the debiased estimator over all assignments equals the average treatment effect, −4-4, for each of the three allocations. The analogous equation (6) for the noninteracted estimator is correct as printed. The interacted correction in the replication files uses the signs of Theorem 4.2. What changes is the last display of Theorem 4.1, and with it any bias computed from that display when the third component is nonzero.

Corrected

Theorem 4.1, last display. Let Assumptions 1–3 hold, with Assumption 2’s normalization holding at the sample size considered, let yi∗(t)=yi(t)−y(t)‾y_i^*(t)=y_i(t)-\overline{y(t)} and hi=∥xi∥22h_i=\|x_i\|_2^2, and let ν3T=−(xˉTy∗(1)‾T)\nu_{3T}=-(\bar x_T\overline{y^*(1)}_T) and ν3C=−(xˉCy∗(0)‾C)\nu_{3C}=-(\bar x_C\overline{y^*(0)}_C), as in the theorem. The expectation is over the complete randomization of nTn_T of the n≥3n\ge3 units to treatment, with nC=n−nTn_C=n-n_T. Then

E[xˉC′ν3C]−E[xˉT′ν3T]=−nT(nT−nC)(n−1)(n−2)nC2(hy(0)‾−hˉ×y(0)‾)+nC(nC−nT)(n−1)(n−2)nT2(hy(1)‾−hˉ×y(1)‾).\begin{aligned} E\bigl[\bar x_C'\nu_{3C}\bigr]-E\bigl[\bar x_T'\nu_{3T}\bigr] ={}&{}\colorbox{#ffe58a}{$\displaystyle -$}\frac{n_T(n_T-n_C)}{(n-1)(n-2)n_C^2}\bigl(\overline{hy(0)}-\bar h\times\overline{y(0)}\bigr)\\ &{}\colorbox{#ffe58a}{$\displaystyle +$}\frac{n_C(n_C-n_T)}{(n-1)(n-2)n_T^2}\bigl(\overline{hy(1)}-\bar h\times\overline{y(1)}\bigr). \end{aligned}

In the notation of Appendix A.1, the right-hand side is −NCCCS0+NTTTS1-N_{CCC}S_0+N_{TTT}S_1. The definitions of ν3T\nu_{3T} and ν3C\nu_{3C} and the estimator of Theorem 4.2 stay as printed.

Crop of the lower part of Theorem 4.1 on page 1509. Two rows define nu_1T, nu_2T, nu_3T and nu_1C, nu_2C, nu_3C. Here nu_3T is minus x-bar_T times the treated mean of y star of 1, and nu_3C is minus x-bar_C times the control mean of y star of 0. Two displays follow. In the last display, the expectation of x-bar_C prime nu_3C minus the expectation of x-bar_T prime nu_3T is set equal to n_T (n_T - n_C) over (n-1)(n-2) n_C squared, times the covariance term for y(0), minus n_C (n_C - n_T) over (n-1)(n-2) n_T squared, times the covariance term for y(1). Red boxes mark the first coefficient and the second coefficient together with its minus sign.
Theorem 4.1, p. 1509 (PDF p. 8): the definitions of ν3T\nu_{3T} and ν3C\nu_{3C} and the two displays for the bias components. The marked coefficients in the last display carry the reversed signs.
Chart with three positions on the horizontal axis: n_T = 2 and n_C = 4 with 15 assignments, n_T = 3 and n_C = 3 with 20 assignments, and n_T = 4 and n_C = 2 with 15 assignments. The vertical axis is the third bias component in units of the outcome, from -0.2 to 0.2. Filled blue circles, the exact expectations, are at 217/2500, 0 and -3689/25000. Open orange squares, the printed display, are at -217/2500, 0 and 3689/25000. At each unbalanced allocation the square is the mirror image of the circle about zero, and at the balanced allocation both are zero.
The third bias component of ATE^I\widehat{\mathrm{ATE}}_I in the six-unit example, for three allocations. Filled circles give the exact expectation over all assignments, which equals the corrected display. Open squares give the last display of Theorem 4.1 as printed.

Minor (15)

Real but inconsequential, for example a misprint that does not change a result.

The function interacted_unbiased_regression calls a function under the name unbiased.reg.interact_new_formula, which the replication files do not define; the name they define is unbiased.reg.interact_appl_new_formula.

Replication files (public repository Debias, commit c9cfb0c1d006), folder 1_main_functions_for_simulations, file 30_functions2.R, function interacted_unbiased_regression (lines 593–658), line 612. No passage of the article

As printed

Line 612 of 30_functions2.R:

debiased_estimator= unbiased.reg.interact_new_formula(y,d,z) #debiased estimator

The problem

Line 612 calls a function that the replication files do not define. The function that computes the bias-corrected estimator of Theorem 4.2 is defined at line 345 of the same file under the name unbiased.reg.interact_appl_new_formula, and line 467 calls it by that name. When the file is loaded on its own, interacted_unbiased_regression stops at line 612 and returns no estimate, standard error or interval.

Evidence an exact counterexample

This finding rests on a run of the unmodified file and on a search of the replication files. In a new R session I called the function on eight units with two covariates, for which the interacted regression has full rank. The call stops with the message could not find function followed by the name unbiased.reg.interact_new_formula. The name occurs once in the text of the replication files, at line 612, and none of the 43 files of saved R objects contains a function of that name.

What survives

The article is not affected. It reports no simulation or application, and its estimators, theorems and proofs do not involve this function. I found no direct call to interacted_unbiased_regression in the replication scripts, and the simulation code calls unbiased.reg.interact_appl_new_formula directly. The change below corrects the name only. With more than one covariate the function then stops at the error described in P005-E016.

Corrected

Line 612 of 30_functions2.R:

debiased_estimator= unbiased.reg.interact_appl_new_formula(y,d,z) #debiased estimator

Listing of lines 606 to 614 of an R function in monospaced type with line numbers. A red box marks the name unbiased.reg.interact_new_formula in line 612, which assigns to debiased_estimator the value of that function at (y,d,z). Line 608 fits lm of y on d times z, and line 614 replaces the coefficient on d by debiased_estimator.
Replication files, 30_functions2.R, lines 606–614, typeset from the source file with line numbers added. The marked name is the function called at line 612; the replication files define no function of this name.
Listing of lines 345 to 350 in monospaced type with line numbers. A red box marks the name unbiased.reg.interact_appl_new_formula at the start of line 345, where it is assigned a function of y, d and z.
Replication files, 30_functions2.R, lines 345–350, typeset from the source file with line numbers added. The marked name is the function that the file defines.

The function interacted_unbiased_regression converts the assignment d to an n×1n\times1 matrix, and with more than one covariate the product d*z.tr at line 370 then fails; d should remain a numeric vector.

Replication files (public repository Debias, commit c9cfb0c1d006), folder 1_main_functions_for_simulations, file 30_functions2.R: function interacted_unbiased_regression, lines 602–604 and 612; function unbiased.reg.interact_appl_new_formula, lines 358 and 370. No passage of the article

As printed

Lines 602–604 of 30_functions2.R, in interacted_unbiased_regression:

y=as.matrix(y)

d=as.matrix(d)

z=as.matrix(z)

Lines 358 and 370, in unbiased.reg.interact_appl_new_formula:

z.tr <- apply(z,2,function(y) y - mean(y))

ols<-coef(ols.model<-lm(y∼\simd+z.tr+I(d*z.tr)))[2]

The problem

After line 603, d is an n×1n\times1 matrix. Line 612 passes it to the function that computes the bias-corrected estimate, under the name corrected in P005-E015. That function centers the kk covariates in the n×kn\times k matrix z.tr and fits a regression whose formula contains the elementwise product d*z.tr. For k>1k>1, R does not multiply an n×1n\times1 matrix by an n×kn\times k matrix elementwise, and the call stops with the error non-conformable arrays. This failure is separate from the undefined name and appears once the name is corrected.

Evidence an exact counterexample

This finding rests on a run of the unmodified file on twelve units with two covariates and alternating assignment, for which both arm regressions have full rank. With the missing name defined in the session as in P005-E015 and the file unchanged, the call of interacted_unbiased_regression stops with non-conformable arrays. The function unbiased.reg.interact_appl_new_formula stops with the same message when called with as.matrix(d), and returns 2.392143013373332.39214301337333 when called with the vector d.

What survives

The article is not affected. The formulas of the estimators and the function unbiased.reg.interact_appl_new_formula, called with a vector d, are unchanged. I found no direct call to interacted_unbiased_regression in the replication scripts, and the failure is an error message, not a wrong estimate. I did not test whether the function runs to its end once both changes are made.

Corrected

Line 603 of 30_functions2.R:

d=as.numeric(d)

Lines 602 and 604 are unchanged. Line 612 also needs the name given in P005-E015.

Listing of lines 593 to 606 in monospaced type with line numbers: the header of the function interacted_unbiased_regression, comments that describe its arguments, and three assignments. A red box marks line 603, 'd=as.matrix(d)'. Lines 602 and 604 apply as.matrix to y and to z.
Replication files, 30_functions2.R, lines 593–606, typeset from the source file with line numbers added. The marked statement at line 603 converts the assignment to a matrix; the comment at line 597 describes d as an assignment vector.
Listing of lines 358 to 370 in monospaced type with line numbers. Line 358 assigns to z.tr the columns of z minus their means. A red box marks the product 'd*z.tr' inside the formula of the regression at line 370, lm of y on d plus z.tr plus I(d*z.tr). The lines between are comments and two constants, CA and CB.
Replication files, 30_functions2.R, lines 358–370, typeset from the source file with line numbers added. The marked product at line 370 multiplies the assignment by the centered covariate matrix z.tr defined at line 358.

The condition for the expansion in Theorem 4.1 should read κlog⁡max⁡{d,2}=o(1)\kappa\log\max\{d,2\}=o(1): for a single covariate the printed condition κlog⁡d=o(1)\kappa\log d=o(1) is empty, and the expansion can fail.

Theorem 4.1, p. 1510 (PDF p. 9), the condition “If κlog⁡d=o(1)\kappa\log d=o(1)” and the expansion that follows it; the theorem begins on p. 1509 (PDF p. 8)

See also under Formal statements (Lean): P005-T7, P005-T8, P005-T9, P005-T20, P005-T24, P005-T27

As printed

Theorem 4.1 is stated “Under Assumptions 1–3”. Its last paragraph reads “If κlog⁡d=o(1)\kappa\colorbox{#ffe58a}{$\log d$}=o(1),” with footnote 8 attached, and continues with the display

ATE^I=ATE+1nT∑i∈[T](yi(1)−y(1)‾−xi′βI,T)−1nC∑i∈[C](yi(0)−y(0)‾−xi′βI,C)+Op(κdn).\widehat{\mathrm{ATE}}_I=\mathrm{ATE}+\frac{1}{n_T}\sum_{i\in[T]}\bigl(y_i(1)-\overline{y(1)}-x_i'\beta_{I,T}\bigr)-\frac{1}{n_C}\sum_{i\in[C]}\bigl(y_i(0)-\overline{y(0)}-x_i'\beta_{I,C}\bigr)+O_p\Bigl(\sqrt{\frac{\kappa d}{n}}\Bigr).

Footnote 8: “The upper bound on the stochastic order of the bias of the interacted case is characterized in equation (15) in Lei and Ding (2021).”

The problem

The number of covariates dd may equal 11: Assumption 1 allows every d≤nd\le n, and the paper gives log⁡\log no special meaning. Since log⁡1=0\log1=0, the condition κlog⁡d=o(1)\kappa\log d=o(1) holds for every sequence with d=1d=1, whatever the maximum leverage κ\kappa. The theorem therefore asserts the expansion with remainder Op(κ/n)O_p(\sqrt{\kappa/n}) for sequences with a single covariate such that κ\kappa does not tend to zero. On such sequences the expansion can fail. One unit whose leverage stays away from zero is enough, as the example below shows.

Evidence an exact counterexample

The evidence is an exact counterexample and a derivation. For even n≥6n\ge6, let d=1d=1, nT=nC=n/2n_T=n_C=n/2 and ϵ=n−2\epsilon=n^{-2}. Let v1=0v_1=0, and let v2,…,vnv_2,\ldots,v_n be the n−1n-1 equally spaced points from −1-1 to 11. I define a1=1a_1=1 and ai=ϵvia_i=\epsilon v_i for i≥2i\ge2, and I write xx for the array aa after centering and scaling to x2‾=1\overline{x^2}=1. The potential outcomes are yi(1)=yi(0)=viy_i(1)=y_i(0)=v_i. Assumptions 1–3 hold, with K=1K=1 in Assumption 1. The average treatment effect is zero, and both arm regressions are invertible under every assignment. The maximum leverage is

κ=3n(n−1)(n−2)3n2(n−2)+1⟶1,\kappa=\frac{3n(n-1)(n-2)}{3n^2(n-2)+1}\longrightarrow1,

while κlog⁡d=0\kappa\log d=0 for every nn. In the arm without unit 1, the relation yi=ai/ϵy_i=a_i/\epsilon holds exactly, so the fitted value at x=0x=0, that is, at a=1/na=1/n, equals nn. In the arm with unit 1, the fitted value at x=0x=0 is less than 33 in absolute value. Hence ∣ATE^I∣≥n−3|\widehat{\mathrm{ATE}}_I|\ge n-3 under every assignment. The linear term of the expansion is at most 13/613/6 in absolute value. Combining these two bounds, I find that the remainder RnR_n satisfies ∣Rn∣≥n−6|R_n|\ge n-6 under every assignment, while the claimed order is κ/n≤n−1/2\sqrt{\kappa/n}\le n^{-1/2}. The ratio is at least (n−6)n(n-6)\sqrt n, which implies that RnR_n is not Op(κd/n)O_p(\sqrt{\kappa d/n}). I enumerated all assignments in exact arithmetic for n=6,8,10,12,14n=6,8,10,12,14, and the results agree with these bounds. At n=12n=12, the smallest value of ∣Rn∣|R_n| over the 924 assignments is 8690712840/7529212878690712840/752921287, which is larger than 1111. Note that in this example the estimator and its remainder each have mean zero over the assignments. The failure concerns the stochastic order of the remainder and not the expected bias.

For the derivation, let d=1d=1, and suppose that Assumptions 1–3 hold, that the arm regressions are invertible, and that κ=o(1)\kappa=o(1). Let SS be an arm of size mm and ww a fixed array. Then

EwˉS=wˉ,Var⁡(wˉS)=n−mm(n−1) (w−wˉ)2‾,E\bar w_S=\bar w,\qquad \operatorname{Var}(\bar w_S)=\frac{n-m}{m(n-1)}\,\overline{(w-\bar w)^2},

and the coefficient in the formula for the variance is O(1/n)O(1/n) by Assumption 3. Since xˉ=0\bar x=0, x2‾=1\overline{x^2}=1 and max⁡ixi2=nκ\max_ix_i^2=n\kappa, I have xˉS=Op(n−1/2)\bar x_S=O_p(n^{-1/2}) and x4‾≤nκ\overline{x^4}\le n\kappa. This gives x2‾S=1+Op(κ)\overline{x^2}_S=1+O_p(\sqrt\kappa) and L^S=x2‾S−xˉS2=1+Op(κ)\widehat L_S=\overline{x^2}_S-\bar x_S^2=1+O_p(\sqrt\kappa), so that L^S−1=Op(1)\widehat L_S^{-1}=O_p(1). Let yy be the potential outcome of the arm, β=xy‾\beta=\overline{xy} and ei=yi−yˉ−xiβe_i=y_i-\bar y-x_i\beta. Then eˉ=xe‾=0\bar e=\overline{xe}=0 and e2‾≤K\overline{e^2}\le K. Applying the formula for the variance to the residuals, I find eˉS=Op(n−1/2)\bar e_S=O_p(n^{-1/2}). The same formula yields xe‾S=Op(κ)\overline{xe}_S=O_p(\sqrt\kappa), since x2e2‾≤nκ e2‾\overline{x^2e^2}\le n\kappa\,\overline{e^2}. The fitted slope satisfies

β^S−β=L^S−1(xe‾S−xˉSeˉS)=Op(κ),\widehat\beta_S-\beta=\widehat L_S^{-1}\bigl(\overline{xe}_S-\bar x_S\bar e_S\bigr)=O_p(\sqrt\kappa),

where I used that κ≥1/n\kappa\ge1/n. Subtracting the linear term from the estimator, I obtain

Rn=−xˉT(β^I,T−βI,T)+xˉC(β^I,C−βI,C)=Op(κn).R_n=-\bar x_T\bigl(\widehat\beta_{I,T}-\beta_{I,T}\bigr)+\bar x_C\bigl(\widehat\beta_{I,C}-\beta_{I,C}\bigr)=O_p\Bigl(\sqrt{\frac{\kappa}{n}}\Bigr).

This is the stated remainder for d=1d=1. For d≥2d\ge2 the corrected condition is the printed one; the expansion in that range is the subject of P005-N004.

What survives

The finite-sample decomposition in Theorem 4.1, the exact bias formulas, the noninteracted results and the case d≥2d\ge2 are unaffected. Theorem 4.2 already assumes κ=o(1)\kappa=o(1) for its expansion. Its proof in Appendix B.4 refers to the stochastic orders of Theorem 4.1, but that assumption excludes the example. The condition of Remark 4, a fixed dd with bounded fourth moments, also excludes it, since x4‾\overline{x^4} grows at least as nκ2n\kappa^2 in the example. In the example the mean of the debiased estimator of Theorem 4.2 over all assignments is exactly zero, which is the average treatment effect. What changes is the domain of the expansion for d=1d=1: a sequence in which the leverage of one unit does not vanish is excluded. The estimators, the estimand and the stated remainder do not change.

Corrected

Theorem 4.1, last paragraph. Let Assumptions 1–3 hold, and let all design matrices be invertible, as footnote 4 assumes. If κlog⁡max⁡{d,2}=o(1)\kappa\colorbox{#ffe58a}{$\log\max\{d,2\}$}=o(1), then

ATE^I=ATE+1nT∑i∈[T](yi(1)−y(1)‾−xi′βI,T)−1nC∑i∈[C](yi(0)−y(0)‾−xi′βI,C)+Op(κdn).\widehat{\mathrm{ATE}}_I=\mathrm{ATE}+\frac{1}{n_T}\sum_{i\in[T]}\bigl(y_i(1)-\overline{y(1)}-x_i'\beta_{I,T}\bigr)-\frac{1}{n_C}\sum_{i\in[C]}\bigl(y_i(0)-\overline{y(0)}-x_i'\beta_{I,C}\bigr)+O_p\Bigl(\sqrt{\frac{\kappa d}{n}}\Bigr).

Equivalently, the printed condition κlog⁡d=o(1)\kappa\log d=o(1) is kept, and κ=o(1)\kappa=o(1) is required in addition when d=1d=1.

Crop of the top of page 1510. The first line reads 'If kappa log d = o(1),' with the footnote mark 8. The display below gives ATE-hat_I as ATE plus the treated-arm average of y_i(1) minus its mean minus x_i' beta_{I,T}, minus the corresponding control-arm average, plus O_p of the square root of kappa d over n. A red box marks the condition 'kappa log d = o(1)'.
Theorem 4.1, continued, p. 1510 (PDF p. 9): the condition and the expansion. The marked condition is κlog⁡d=o(1)\kappa\log d=o(1).

The variance bound of Lemma A.1 holds when its right side is computed from the centered vectors a−aˉa-\bar a and b−bˉb-\bar b, not for arbitrary aa and bb as printed; with this change, the order O(κ2n+κd/n)O(\kappa^2n+\kappa d/n) in the proof of Theorem 3.2 is the same.

Appendix A.2, Lemma A.1, p. 1511 (PDF p. 10), the variance bound and the second paragraph of its proof; applied in Appendix B.2, proof of Theorem 3.2, item 2, p. 1517 (PDF p. 16)

See also under Formal statements (Lean): P005-T1, P005-T2, P005-T3, P005-T4, P005-T19, P005-T26

As printed

P. 1510: “Let a=(a1,…,an)∈Rna=(a_1,\ldots,a_n)\in\mathbb R^n and b=(b1,…,bn)∈Rnb=(b_1,\ldots,b_n)\in\mathbb R^n be arbitrary nn-vectors with fixed elements. We define the covariance estimator for the treated group as Cov⁡^T(a,b)=ab‾T−aˉTbˉT\widehat{\operatorname{Cov}}_T(a,b)=\overline{ab}_T-\bar a_T\bar b_T, and similarly for the control group as Cov⁡^C(a,b)=ab‾C−aˉCbˉC\widehat{\operatorname{Cov}}_C(a,b)=\overline{ab}_C-\bar a_C\bar b_C.”

P. 1511: “LEMMA A.1: Let t∈{T,C}t\in\{T,C\} and n≥4n\ge4. Then,

E[Cov⁡^t(a,b)]=(nt−1)nnt(n−1)(ab‾−aˉbˉ),\mathbb E\bigl[\widehat{\operatorname{Cov}}_t(a,b)\bigr]=\frac{(n_t-1)n}{n_t(n-1)}\bigl(\overline{ab}-\bar a\bar b\bigr),
Var⁡(Cov⁡^t(a,b))≤2(n−nt)nt(n−1)1n∑i=1n(aibi−ab‾)2+2(n−nt)nnt3(n−1)1n∑i=1nai2×1n∑i=1nbi2.”\operatorname{Var}\bigl(\widehat{\operatorname{Cov}}_t(a,b)\bigr)\le\frac{2(n-n_t)}{n_t(n-1)}\frac1n\sum_{i=1}^n\bigl(\colorbox{#ffe58a}{$\displaystyle a_ib_i-\overline{ab}$}\bigr)^2+\frac{2(n-n_t)n}{n_t^3(n-1)}\frac1n\sum_{i=1}^n\colorbox{#ffe58a}{$\displaystyle a_i^2$}\times\frac1n\sum_{i=1}^n\colorbox{#ffe58a}{$\displaystyle b_i^2$}.\text{''}

P. 1511, proof: “To upper-bound the variance, we first note that the covariance estimator is location invariant and we can assume, without loss of generality, aˉ=0\bar a=0 and bˉ=0\bar b=0.9^{9}”

P. 1517, item 2: “First notice, by Lemma A.1 and Assumption 1,

Var⁡[(hy(1)‾T−hˉTy(1)‾T)]≤2(n−nT)nT(n−1)1n∑i=1n(hiyi(1)−hy(1)‾)2+2(n−nT)nnT3(n−1)1n∑i=1nyi2(1) 1n∑i=1nhi2≤2(n−nT)nT(n−1)1n∑i=1nhi2yi2(1)+2(n−nT)nnT3(n−1)1n∑i=1nyi2(1) 1n∑i=1nhi2≤2(n−nT)nT(n−1)n2κ21n∑i=1nyi2(1)+2(n−nT)nnT3(n−1)1n∑i=1nyi2(1) 1n∑i=1nhi×nκ=O(κ2n+κdn).”\begin{aligned} &\operatorname{Var}\bigl[\bigl(\overline{hy(1)}_T-\bar h_T\overline{y(1)}_T\bigr)\bigr]\\ &\quad\le\frac{2(n-n_T)}{n_T(n-1)}\frac1n\sum_{i=1}^n\bigl(\colorbox{#ffe58a}{$\displaystyle h_iy_i(1)-\overline{hy(1)}$}\bigr)^2+\frac{2(n-n_T)n}{n_T^3(n-1)}\frac1n\sum_{i=1}^n\colorbox{#ffe58a}{$\displaystyle y_i^2(1)$}\,\frac1n\sum_{i=1}^n\colorbox{#ffe58a}{$\displaystyle h_i^2$}\\ &\quad\le\frac{2(n-n_T)}{n_T(n-1)}\frac1n\sum_{i=1}^n\colorbox{#ffe58a}{$\displaystyle h_i^2y_i^2(1)$}+\frac{2(n-n_T)n}{n_T^3(n-1)}\frac1n\sum_{i=1}^n\colorbox{#ffe58a}{$\displaystyle y_i^2(1)$}\,\frac1n\sum_{i=1}^n\colorbox{#ffe58a}{$\displaystyle h_i^2$}\\ &\quad\le\frac{2(n-n_T)}{n_T(n-1)}n^2\kappa^2\frac1n\sum_{i=1}^ny_i^2(1)+\frac{2(n-n_T)n}{n_T^3(n-1)}\frac1n\sum_{i=1}^ny_i^2(1)\,\frac1n\sum_{i=1}^nh_i\times n\kappa\\ &\quad=O\Bigl(\kappa^2n+\frac{\kappa d}{n}\Bigr).\text{''} \end{aligned}
The problem

Lemma A.1 is stated for arbitrary fixed vectors aa and bb, and the bars in its variance bound denote their population means. The variance argument begins by assuming aˉ=bˉ=0\bar a=\bar b=0, on the ground that the covariance estimator is location invariant. The estimator is unchanged when a constant is added to aa or to bb, but the right side of the bound is not. The proof therefore establishes the bound only when the right side is computed from a−aˉa-\bar a and b−bˉb-\bar b. I refer to the bound with this right side as the centered bound. For vectors that are not centered, the printed right side can be smaller than the variance. Item 2 of the proof of Theorem 3.2 applies the lemma to the leverage hh, whose population mean is dd by Assumption 2, and to the outcome y(1)y(1), whose mean need not be zero. The first two purported upper bounds in the display on p. 1517 are not valid in general: both fail for a design that Assumptions 1–3 allow.

Evidence an exact counterexample

The evidence is an exact counterexample to the printed bound and a derivation of the centered bound. All variances below are over the random assignment, in which the group is a uniformly random subset of size ntn_t. For each numerical example, the variance is computed in exact rational arithmetic over every assignment.

The lemma. Let n=6n=6, nt=4n_t=4, a=(0,−3,−1,2,−4,−3)a=(0,-3,-1,2,-4,-3) and b=(2,1,3,−3,1,1)b=(2,1,3,-3,1,1). Over the 15 assignments, Cov⁡^t(a,b)\widehat{\operatorname{Cov}}_t(a,b) has mean −69/40-69/40, in agreement with the expectation identity, and variance 16607/480016607/4800. The printed right side is 3829/14403829/1440, which is smaller. The centered bound is 835/128835/128; the means of aa and bb are −3/2-3/2 and 5/65/6.

The application. Let n=16n=16, nT=8n_T=8, d=1d=1 and x=(8c,−8c,c,−c,…,c,−c)x=(8c,-8c,c,-c,\ldots,c,-c) with c=8/71c=\sqrt{8/71}, so that xˉ=0\bar x=0 and x2‾=1\overline{x^2}=1. Then hi=xi2h_i=x_i^2 equals 512/71512/71 for the first two units and 8/718/71 for the others, hˉ=1=d\bar h=1=d and κ=32/71\kappa=32/71. Let y(1)=(1/64,1/64,1,…,1)y(1)=(1/64,1/64,1,\ldots,1) and y(0)=0y(0)=0. The mean squares of xx, y(1)y(1) and y(0)y(0) are at most 1, and nT/n=1/2n_T/n=1/2. Since every product hiyi(1)h_iy_i(1) equals 8/718/71, the first term of the printed bound vanishes. Over the 12870 assignments, the variance of hy(1)‾T−hˉTy(1)‾T\overline{hy(1)}_T-\bar h_T\overline{y(1)}_T is 1678565511/82591744001678565511/8259174400. The first line of the display on p. 1517 equals 117645319/619438080117645319/619438080 and the second line equals 334349/1744896334349/1744896; both are smaller than the variance. The centered bound equals 5550293259/132146790405550293259/13214679040. In a third example, with n=14n=14, nt=7n_t=7, a=(30,1,…,1)a=(30,1,\ldots,1) and bi=1/aib_i=1/a_i, the variance is 707281/240100707281/240100, the printed right side is 10683013/401310010683013/4013100 and the centered bound is 365664277/60505200365664277/60505200. The table collects the three examples.

Exact variance of Cov⁡^t(a,b)\widehat{\operatorname{Cov}}_t(a,b) and the two bounds in three examples, rounded to four decimals; the exact values are in the text. A valid upper bound is at least as large as the variance.
ExampleExact varianceBound as printedCentered bound
n=6n=6, nt=4n_t=4, arbitrary aa and bb3.45982.65906.5234
n=14n=14, nt=7n_t=7, aibi=1a_ib_i=1 for all ii2.94582.66206.0435
n=16n=16, nT=8n_T=8, a=ha=h and b=y(1)b=y(1)0.20320.18990.4200

The centered bound. Let n≥4n\ge4 and 1≤m≤n−11\le m\le n-1, where m=ntm=n_t, let SS be the random group, and write u=a−aˉu=a-\bar a and v=b−bˉv=b-\bar b. Expanding the sample means shows that Cov⁡^t(a,b)=uv‾S−uˉSvˉS\widehat{\operatorname{Cov}}_t(a,b)=\overline{uv}_S-\bar u_S\bar v_S for every SS. By the variance of a sample mean under simple random sampling, I have

Var⁡(uv‾S)=n−mm(n−1)1n∑i=1n(uivi−uv‾)2.\operatorname{Var}\bigl(\overline{uv}_S\bigr)=\frac{n-m}{m(n-1)}\frac1n\sum_{i=1}^n\bigl(u_iv_i-\overline{uv}\bigr)^2.

For the product of the two means, set Z=(∑i∈Sui)(∑i∈Svi)Z=\bigl(\sum_{i\in S}u_i\bigr)\bigl(\sum_{i\in S}v_i\bigr), A=∑iui2A=\sum_iu_i^2, B=∑ivi2B=\sum_iv_i^2, G=∑iuiviG=\sum_iu_iv_i and H=∑iui2vi2H=\sum_iu_i^2v_i^2, and define

α=m(n−m)n(n−1),ℓ=m(m−1)(n−m)(n−m−1)n(n−1)(n−2)(n−3).\alpha=\frac{m(n-m)}{n(n-1)},\qquad\ell=\frac{m(m-1)(n-m)(n-m-1)}{n(n-1)(n-2)(n-3)}.

Expanding Z2Z^2, grouping the terms by the number of distinct indices and using ∑iui=∑ivi=0\sum_iu_i=\sum_iv_i=0, I obtain

Var⁡Z=(α−6ℓ)H+ℓAB+(2ℓ−α2)G2.\operatorname{Var}Z=(\alpha-6\ell)H+\ell AB+(2\ell-\alpha^2)G^2.

Here 0≤H≤AB0\le H\le AB, G2≤ABG^2\le AB and G2≤nHG^2\le nH, and ℓ≤α(n−2)/(4(n−3))\ell\le\alpha(n-2)/(4(n-3)) because the factors m−1m-1 and n−m−1n-m-1 sum to n−2n-2. If α≥6ℓ\alpha\ge6\ell, the identity implies that Var⁡Z≤(α−3ℓ)AB≤αAB\operatorname{Var}Z\le(\alpha-3\ell)AB\le\alpha AB. If α<6ℓ\alpha<6\ell, using H≥G2/nH\ge G^2/n, I find

Var⁡Z≤[αn+(3−6n)ℓ]AB≤α[1−n−44(n−3)]AB≤αAB.\operatorname{Var}Z\le\Bigl[\frac\alpha n+\Bigl(3-\frac6n\Bigr)\ell\Bigr]AB\le\alpha\Bigl[1-\frac{n-4}{4(n-3)}\Bigr]AB\le\alpha AB.

In the second inequality, I used the bound on ℓ\ell. Since uˉSvˉS=Z/m2\bar u_S\bar v_S=Z/m^2, in both cases

Var⁡(uˉSvˉS)≤(n−m)nm3(n−1)(1n∑i=1nui2)(1n∑i=1nvi2).\operatorname{Var}\bigl(\bar u_S\bar v_S\bigr)\le\frac{(n-m)n}{m^3(n-1)}\Bigl(\frac1n\sum_{i=1}^nu_i^2\Bigr)\Bigl(\frac1n\sum_{i=1}^nv_i^2\Bigr).

The centered bound follows from Var⁡(U−V)≤2Var⁡U+2Var⁡V\operatorname{Var}(U-V)\le2\operatorname{Var}U+2\operatorname{Var}V. Both of its sides are unchanged when constants are added to aa and bb. The reduction to aˉ=bˉ=0\bar a=\bar b=0 in the printed proof is then legitimate.

The order on p. 1517. By Assumption 2, I have hˉ=d\bar h=d and 0≤hi≤nκ0\le h_i\le n\kappa. Then ∣hi−d∣≤nκ|h_i-d|\le n\kappa and n−1∑i(hi−d)2≤n−1∑ihi2≤nκdn^{-1}\sum_i(h_i-d)^2\le n^{-1}\sum_ih_i^2\le n\kappa d. Assumption 1 gives n−1∑i(yi(1)−y(1)‾)2≤Kn^{-1}\sum_i(y_i(1)-\overline{y(1)})^2\le K. Subtracting a mean lowers a mean square, so the first sum in the centered bound is at most n−1∑i(hi−d)2(yi(1)−y(1)‾)2≤n2κ2Kn^{-1}\sum_i(h_i-d)^2(y_i(1)-\overline{y(1)})^2\le n^2\kappa^2K. Inserting these bounds into the centered bound, and using Assumption 3 for the coefficients, I obtain the chain in the correction below.

What survives

The expectation identity of Lemma A.1 is correct as printed. The covariance estimators, the bias corrections and the unbiasedness claims of Theorems 3.2 and 4.2 do not depend on the variance bound. The asymptotic expansions of Theorems 3.2 and 4.2 use the bound only for the order of the variance of the covariance between leverage and outcome. Under Assumptions 1–3 this order is the same with the centered bound, and this variance error does not affect the expansions. This correction requires no change to an assumption, estimand, estimator or theorem conclusion, or to a computation in the replication files.

Corrected

Lemma A.1: Let aa and bb be arbitrary nn-vectors with fixed elements, and write aic=ai−aˉa_i^c=a_i-\bar a and bic=bi−bˉb_i^c=b_i-\bar b. Let t∈{T,C}t\in\{T,C\} and n≥4n\ge4. Then,

E[Cov⁡^t(a,b)]=(nt−1)nnt(n−1)(ab‾−aˉbˉ),\mathbb E\bigl[\widehat{\operatorname{Cov}}_t(a,b)\bigr]=\frac{(n_t-1)n}{n_t(n-1)}\bigl(\overline{ab}-\bar a\bar b\bigr),
Var⁡(Cov⁡^t(a,b))≤2(n−nt)nt(n−1)1n∑i=1n(aicbic−acbc‾)2+2(n−nt)nnt3(n−1)1n∑i=1n(aic)2×1n∑i=1n(bic)2.\operatorname{Var}\bigl(\widehat{\operatorname{Cov}}_t(a,b)\bigr)\le\frac{2(n-n_t)}{n_t(n-1)}\frac1n\sum_{i=1}^n\bigl(\colorbox{#ffe58a}{$\displaystyle a_i^cb_i^c-\overline{a^cb^c}$}\bigr)^2+\frac{2(n-n_t)n}{n_t^3(n-1)}\frac1n\sum_{i=1}^n\colorbox{#ffe58a}{$\displaystyle (a_i^c)^2$}\times\frac1n\sum_{i=1}^n\colorbox{#ffe58a}{$\displaystyle (b_i^c)^2$}.

P. 1517, item 2: “First notice, by Lemma A.1 applied to hh and y(1)y(1), whose centered versions are h−dh-d and y(1)−y(1)‾y(1)-\overline{y(1)}, and by Assumptions 1–3,

Var⁡[(hy(1)‾T−hˉTy(1)‾T)]≤2(n−nT)nT(n−1)1n∑i=1n((hi−d)(yi(1)−y(1)‾)−(h−d)(y(1)−y(1)‾)‾)2+2(n−nT)nnT3(n−1)1n∑i=1n(yi(1)−y(1)‾)2 1n∑i=1n(hi−d)2≤2(n−nT)nT(n−1)n2κ2K+2(n−nT)nnT3(n−1)nκdK=O(κ2n+κdn),\begin{aligned} &\operatorname{Var}\bigl[\bigl(\overline{hy(1)}_T-\bar h_T\overline{y(1)}_T\bigr)\bigr]\\ &\quad\le\frac{2(n-n_T)}{n_T(n-1)}\frac1n\sum_{i=1}^n\Bigl(\colorbox{#ffe58a}{$\displaystyle (h_i-d)\bigl(y_i(1)-\overline{y(1)}\bigr)-\overline{(h-d)\bigl(y(1)-\overline{y(1)}\bigr)}$}\Bigr)^2\\ &\qquad+\frac{2(n-n_T)n}{n_T^3(n-1)}\frac1n\sum_{i=1}^n\colorbox{#ffe58a}{$\displaystyle \bigl(y_i(1)-\overline{y(1)}\bigr)^2$}\,\frac1n\sum_{i=1}^n\colorbox{#ffe58a}{$\displaystyle (h_i-d)^2$}\\ &\quad\le\frac{2(n-n_T)}{n_T(n-1)}n^2\kappa^2\colorbox{#ffe58a}{$\displaystyle K$}+\frac{2(n-n_T)n}{n_T^3(n-1)}n\kappa\colorbox{#ffe58a}{$\displaystyle dK$}\\ &\quad=O\Bigl(\kappa^2n+\frac{\kappa d}{n}\Bigr), \end{aligned}

where KK is the constant of Assumption 1.” The next sentence of the proof, which gives the order O(κ2/n+κd/n3)O(\kappa^2/n+\kappa d/n^3) for the variance of n−1(hy(1)‾T−hˉTy(1)‾T)n^{-1}(\overline{hy(1)}_T-\bar h_T\overline{y(1)}_T), is unchanged.

Crop of the statement of Lemma A.1: the line 'Lemma A.1: Let t in {T, C} and n at least 4. Then,', the identity for the expectation of the covariance estimator, and the variance bound, followed by the first two lines of the proof. A red box marks the whole right side of the variance bound, from the inequality sign to the sum of the squares b_i^2.
Lemma A.1, p. 1511 (PDF p. 10). The marked right side of the variance bound is written with the vectors aa and bb themselves, which the paragraph before the lemma allows to be arbitrary.
Crop of the second paragraph of the proof of Lemma A.1 and the two-line display after it. A red box marks the clause 'we can assume, without loss of generality, a-bar = 0 and b-bar = 0', with its footnote mark 9. The display bounds Var(ab-bar_T minus a-bar_T b-bar_T) by the same right side as in the lemma.
Proof of Lemma A.1, p. 1511 (PDF p. 10). The marked clause centers aa and bb; the display below it then derives the bound for centered vectors only.
Crop of item 2, which begins 'Since the first-order term in (11) is canceled' and ends 'First notice, by Lemma A.1 and Assumption 1,', and of the four-line chain of inequalities for the variance of the treated-arm covariance of h and y(1). A red box marks the first line of the chain, whose terms contain h_i y_i(1) minus the mean of hy(1), y_i(1) squared and h_i squared. The chain ends with O(kappa squared n plus kappa d over n).
Proof of Theorem 3.2, item 2, p. 1517 (PDF p. 16). The marked line applies Lemma A.1 to the leverage hh, whose mean is dd, and the outcome y(1)y(1), whose mean need not be zero.
Dot plot with three rows, one for each example: arbitrary a and b with n = 6 and n_t = 4; a_i b_i = 1 for all i with n = 14 and n_t = 7; leverage h and outcome y(1) with n = 16 and n_T = 8. The horizontal axis is the bound divided by the exact variance of the estimator, from 0 to about 2.3, with a vertical line at ratio 1 labeled exact variance. In each row a blue circle for the bound as printed lies to the left of the line, at 0.77, 0.90 and 0.93, and an orange square for the centered bound lies to the right, at about 1.89, 2.05 and 2.07.
The printed and the centered bound of Lemma A.1, each divided by the exact variance of the covariance estimator, in the three examples of the table. A ratio below 1 means that the bound fails. The printed bound has ratios 0.77, 0.90 and 0.93.

In the proof of Lemma A.2, the bracket [DiDj][D_iD_j] should read E[DiDj]\mathbb E[D_iD_j], and the upper limit NN should read nn.

Appendix A.2, proof of Lemma A.2: first display, p. 1511 (PDF p. 10); last display, p. 1512 (PDF p. 11)

See also under Formal statements (Lean): P005-T16

As printed

P. 1511:

E[∑i=1nDixiyi∑j≠iDjzj]=∑i=1n∑j≠i[DiDj]xiyizj=nT(nT−1)n(n−1)∑i=1n∑j≠ixiyizj\mathbb E\Bigl[\sum_{i=1}^nD_ix_iy_i\sum_{j\ne i}D_jz_j\Bigr]=\sum_{i=1}^n\sum_{j\ne i}\colorbox{#ffe58a}{$\displaystyle [D_iD_j]$}x_iy_iz_j=\frac{n_T(n_T-1)}{n(n-1)}\sum_{i=1}^n\sum_{j\ne i}x_iy_iz_j

P. 1512, last display:

E[xˉTyˉTzˉT]=1nT3(E[∑iDixiyizi]+E[∑i=1n∑j≠iDiDj(xiyizj+xiyjzi+xjyizi)]+E[∑i=1NDixi∑j≠iDjyj∑s∉{i,j}Dszs])\begin{aligned} \mathbb E[\bar x_T\bar y_T\bar z_T]=\frac1{n_T^3}\Bigl(&\mathbb E\Bigl[\sum_iD_ix_iy_iz_i\Bigr]+\mathbb E\Bigl[\sum_{i=1}^n\sum_{j\ne i}D_iD_j(x_iy_iz_j+x_iy_jz_i+x_jy_iz_i)\Bigr]\\ &+\mathbb E\Bigl[\sum_{i=1}^{\colorbox{#ffe58a}{$\displaystyle N$}}D_ix_i\sum_{j\ne i}D_jy_j\sum_{s\notin\{i,j\}}D_sz_s\Bigr]\Bigr) \end{aligned}
The problem

The first equality on p. 1511 takes the expectation inside the double sum. The bracket then needs the expectation sign, and the next equality replaces it by nT(nT−1)/(n(n−1))n_T(n_T-1)/(n(n-1)), which is E[DiDj]\mathbb E[D_iD_j] for i≠ji\ne j. On p. 1512 the outer sum of the third term runs to NN. The population has nn units, and the same triple sum runs to nn in the display above.

Evidence a derivation

The evidence is a check of pp. 1511–1512 and a derivation. With both readings restored, the coefficient of ∑ixiyizi\sum_ix_iy_iz_i in the last display is

1nT3(nTn−3nT(nT−1)n(n−1)+2nT(nT−1)(nT−2)n(n−1)(n−2))=(n−nT)(n−2nT)n nT2(n−1)(n−2),\frac1{n_T^3}\Bigl(\frac{n_T}{n}-\frac{3n_T(n_T-1)}{n(n-1)}+\frac{2n_T(n_T-1)(n_T-2)}{n(n-1)(n-2)}\Bigr)=\frac{(n-n_T)(n-2n_T)}{n\,n_T^2(n-1)(n-2)},

which equals NTTT/nN_{\mathrm{TTT}}/n with NTTTN_{\mathrm{TTT}} as defined on p. 1510.

What survives

Lemma A.2, its constants and the rest of its proof are unchanged.

Corrected

P. 1511:

E[∑i=1nDixiyi∑j≠iDjzj]=∑i=1n∑j≠iE[DiDj]xiyizj=nT(nT−1)n(n−1)∑i=1n∑j≠ixiyizj\mathbb E\Bigl[\sum_{i=1}^nD_ix_iy_i\sum_{j\ne i}D_jz_j\Bigr]=\sum_{i=1}^n\sum_{j\ne i}\colorbox{#ffe58a}{$\displaystyle \mathbb E[D_iD_j]$}x_iy_iz_j=\frac{n_T(n_T-1)}{n(n-1)}\sum_{i=1}^n\sum_{j\ne i}x_iy_iz_j

P. 1512, last display:

E[xˉTyˉTzˉT]=1nT3(E[∑iDixiyizi]+E[∑i=1n∑j≠iDiDj(xiyizj+xiyjzi+xjyizi)]+E[∑i=1nDixi∑j≠iDjyj∑s∉{i,j}Dszs])\begin{aligned} \mathbb E[\bar x_T\bar y_T\bar z_T]=\frac1{n_T^3}\Bigl(&\mathbb E\Bigl[\sum_iD_ix_iy_iz_i\Bigr]+\mathbb E\Bigl[\sum_{i=1}^n\sum_{j\ne i}D_iD_j(x_iy_iz_j+x_iy_jz_i+x_jy_iz_i)\Bigr]\\ &+\mathbb E\Bigl[\sum_{i=1}^{\colorbox{#ffe58a}{$\displaystyle n$}}D_ix_i\sum_{j\ne i}D_jy_j\sum_{s\notin\{i,j\}}D_sz_s\Bigr]\Bigr) \end{aligned}
Crop of the opening of the proof of Lemma A.2 and its first display, which expands the expectation of the sum over i of D_i x_i y_i times the sum over j not equal to i of D_j z_j. A red box marks the bracket [D_i D_j] in the double sum after the first equality sign.
Proof of Lemma A.2, p. 1511 (PDF p. 10), first display. The marked bracket has no expectation sign; the next equality replaces it by the probability nT(nT−1)/(n(n−1))n_T(n_T-1)/(n(n-1)).
Crop of the last display of the proof of Lemma A.2, which writes E[x-bar_T y-bar_T z-bar_T] as one over n_T cubed times three expectations. A red box marks the capital N above the first summation sign of the third expectation, whose lower limit is i = 1.
Proof of Lemma A.2, p. 1512 (PDF p. 11), last display. The marked upper limit of the outer sum is NN; the sums in the lines above run to nn.

In the last line of the variance bound for (∗)(*), the leverage and the residual difference should carry the same summation index.

Appendix B.1.1, p. 1514 (PDF p. 13), display bounding Var⁡[(∗)]\operatorname{Var}[(*)], third line

See also under Formal statements (Lean): P005-T17

As printed
=(1pCnTn)2n2nTnCn(n−1)∑in−1∥xi∥22(ej(1)−ej(0))2=O(κn),=\Bigl(\frac1{p_Cn_Tn}\Bigr)^2n^2\frac{n_Tn_C}{n(n-1)}\sum_{\colorbox{#ffe58a}{$\displaystyle i$}}n^{-1}\|x_{\colorbox{#ffe58a}{$\displaystyle i$}}\|_2^2\bigl(e_j(1)-e_j(0)\bigr)^2=O\Bigl(\frac\kappa n\Bigr),

and, below the display: “For the second to last equality, we use the fact

∑i,j(xi′xjaj)2=∑jaj2xj′(∑ixixi′)xj=n∑jaj2∥xj∥22\textstyle\sum_{i,j}(x_i'x_ja_j)^2=\sum_ja_j^2x_j'(\sum_ix_ix_i')x_j=n\sum_ja_j^2\|x_j\|_2^2

by Assumption 2.”

The problem

The sum binds ii, but the residuals carry jj, which is then a free index. The identity quoted below the display contracts the double sum over ii and jj to a single sum in which the leverage and the squared coefficient have the same index.

Evidence a derivation

The evidence is a check of the page and a derivation. I write δj=ej(1)−ej(0)\delta_j=e_j(1)-e_j(0) and hj=∥xj∥22h_j=\|x_j\|_2^2. Since ∑ixixi′=nId\sum_ix_ix_i'=nI_d by Assumption 2, I have

∑i,j(xi′xjδj)2=∑jδj2xj′(∑ixixi′)xj=n∑jhjδj2.\sum_{i,j}(x_i'x_j\delta_j)^2=\sum_j\delta_j^2x_j'\Bigl(\sum_ix_ix_i'\Bigr)x_j=n\sum_jh_j\delta_j^2.

With the index matched, the last line equals hδ2‾/(pTpCn(n−1))\overline{h\delta^2}/(p_Tp_Cn(n-1)). Since hj≤nκh_j\le n\kappa, this is at most κ δ2‾/(pTpC(n−1))\kappa\,\overline{\delta^2}/(p_Tp_C(n-1)), which is O(κ/n)O(\kappa/n) by Assumption 3 and the bounds on the residuals stated on p. 1513.

What survives

The contraction identity and the rate O(κ/n)O(\kappa/n) are correct, and only the index changes.

Corrected
=(1pCnTn)2n2nTnCn(n−1)∑jn−1∥xj∥22(ej(1)−ej(0))2=O(κn),=\Bigl(\frac1{p_Cn_Tn}\Bigr)^2n^2\frac{n_Tn_C}{n(n-1)}\sum_{\colorbox{#ffe58a}{$\displaystyle j$}}n^{-1}\|x_{\colorbox{#ffe58a}{$\displaystyle j$}}\|_2^2\bigl(e_j(1)-e_j(0)\bigr)^2=O\Bigl(\frac\kappa n\Bigr),
Crop of the three-line display that bounds Var[(*)] and of the four lines of text below it. A red box marks, in the third line, the sum over i of n to the minus 1 times the squared norm of x_i times the square of e_j(1) minus e_j(0). The text below ends with the identity for the sum over i and j of (x_i prime x_j a_j) squared, which equals n times the sum over j of a_j squared times the squared norm of x_j.
Appendix B.1.1, p. 1514 (PDF p. 13), the bound for Var⁡[(∗)]\operatorname{Var}[(*)] and the explanation below it. In the marked sum the index of summation and the leverage carry ii, while the residuals carry jj.

The control-arm covariance whose coefficient is collected is hy(0)‾C−hˉC y(0)‾C\overline{hy(0)}_C-\bar h_C\,\overline{y(0)}_C; the coefficient 1/(n−2)1/(n-2) is correct.

Appendix B.2, proof of Theorem 3.2, p. 1516 (PDF p. 15), the second sentence that begins “Collecting the constants in front of”

See also under Formal statements (Lean): P005-T15

As printed

“Collecting the constants in front of hy(0)‾C−hy(0)y(0)‾C\overline{hy(0)}_C-\colorbox{#ffe58a}{$\overline{hy(0)y(0)}_C$} gives

1n−1nC(n−1)(nC−1)n−(nT−nC)(n−1)(n−2)nTnT(n−1)(nC−1)n=1n−2.”\frac1{n-1}\frac{n_C(n-1)}{(n_C-1)n}-\frac{(n_T-n_C)}{(n-1)(n-2)n_T}\frac{n_T(n-1)}{(n_C-1)n}=\frac1{n-2}.\text{''}
The problem

The second term is printed as one overline over hy(0)y(0)hy(0)y(0). The sentence collects the coefficient of the control-arm covariance in equations (11) and (12). The second term of that covariance is the product of the sample means of hh and y(0)y(0), as in the parallel sentence for the treated arm.

Evidence a check of the printed page

The evidence is a check of the page against equations (7), (11) and (12), which print hy(0)‾C−hˉCy(0)‾C\overline{hy(0)}_C-\bar h_C\overline{y(0)}_C, and a recalculation of the coefficient. With n=nT+nCn=n_T+n_C, the left side of the display is

nC(nC−1)n−nT−nC(n−2)(nC−1)n=nC(n−2)−nT+nC(n−2)(nC−1)n=1n−2.\frac{n_C}{(n_C-1)n}-\frac{n_T-n_C}{(n-2)(n_C-1)n}=\frac{n_C(n-2)-n_T+n_C}{(n-2)(n_C-1)n}=\frac1{n-2}.
What survives

The coefficient, the estimator of Theorem 3.2 and the rest of the proof are unchanged.

Corrected

“Collecting the constants in front of hy(0)‾C−hˉC y(0)‾C\overline{hy(0)}_C-\colorbox{#ffe58a}{$\bar h_C\,\overline{y(0)}_C$} gives

1n−1nC(n−1)(nC−1)n−(nT−nC)(n−1)(n−2)nTnT(n−1)(nC−1)n=1n−2.”\frac1{n-1}\frac{n_C(n-1)}{(n_C-1)n}-\frac{(n_T-n_C)}{(n-1)(n-2)n_T}\frac{n_T(n-1)}{(n_C-1)n}=\frac1{n-2}.\text{''}
Crop of the first lines of page 1516: the sentence 'Collecting the constants in front of' the treated-arm covariance with its display, which equals minus 1 over n minus 2, then the sentence 'Collecting the constants in front of' the control-arm expression with its display, which equals 1 over n minus 2. A red box marks the second term of the control-arm expression, a single overline over hy(0)y(0) with subscript C.
Proof of Theorem 3.2, p. 1516 (PDF p. 15). The marked term is printed as a single mean of hy(0)y(0)hy(0)y(0); the parallel sentence for the treated arm, two lines above, has the product of two sample means.

Six covariate means lack a transpose, one control-arm sum runs over [T][T] where [C][C] is meant, and Remark 2 prints v2v_2 for ν2\nu_2.

Appendix B.2, proof of Theorem 3.2, p. 1516 (PDF p. 15), display for ATE^Debiased\widehat{\mathrm{ATE}}_{\mathrm{Debiased}}; Appendix B.4, p. 1518 (PDF p. 17), last display; p. 1515 (PDF p. 14), first sentence of the proof of Theorem 3.2; Remark 2, p. 1507 (PDF p. 6)

See also under Formal statements (Lean): P005-T10, P005-T11, P005-T14

As printed

P. 1516, first and third lines of the display:

ATE^Debiased=(y(1)‾T−y(0)‾C−(xˉT−xˉC)L^−1N^)−(xˉC−xˉT)′(L^−1−Id−1)N^+⋯=1nT∑i∈[T](yi(1)−xi′N)−1nC∑i∈[T](yi(0)−xi′N)−⋯\begin{aligned} \widehat{\mathrm{ATE}}_{\mathrm{Debiased}}&=\bigl(\overline{y(1)}_T-\overline{y(0)}_C-\colorbox{#ffe58a}{$\displaystyle (\bar x_T-\bar x_C)$}\widehat L^{-1}\hat N\bigr)-(\bar x_C-\bar x_T)'\bigl(\widehat L^{-1}-I_d^{-1}\bigr)\hat N+\cdots\\ &=\frac1{n_T}\sum_{i\in[T]}\bigl(y_i(1)-x_i'N\bigr)-\frac1{n_C}\sum_{\colorbox{#ffe58a}{$\displaystyle i\in[T]$}}\bigl(y_i(0)-x_i'N\bigr)-\cdots \end{aligned}

P. 1518, last display:

ATE^T,I,Debiased=y(1)‾T−xˉTL^T−1N^T−(−xˉT′(L^T−1−Id−1)N^T−nT(n−2)nC(hy(1)‾T−hˉTy(1)‾T))=y(1)‾T−xˉTNT−xˉT(N^T−NT)+nT(n−2)nC(hy(1)‾T−hˉTy(1)‾T)=y(1)‾T−xˉTNT+Op(κn),\begin{aligned} \widehat{\mathrm{ATE}}_{T,I,\mathrm{Debiased}}&=\overline{y(1)}_T-\colorbox{#ffe58a}{$\displaystyle \bar x_T$}\widehat L_T^{-1}\hat N_T-\Bigl(-\bar x_T'\bigl(\widehat L_T^{-1}-I_d^{-1}\bigr)\hat N_T-\frac{n_T}{(n-2)n_C}\bigl(\overline{hy(1)}_T-\bar h_T\overline{y(1)}_T\bigr)\Bigr)\\ &=\overline{y(1)}_T-\colorbox{#ffe58a}{$\displaystyle \bar x_T$}N_T-\colorbox{#ffe58a}{$\displaystyle \bar x_T$}(\hat N_T-N_T)+\frac{n_T}{(n-2)n_C}\bigl(\overline{hy(1)}_T-\bar h_T\overline{y(1)}_T\bigr)\\ &=\overline{y(1)}_T-\colorbox{#ffe58a}{$\displaystyle \bar x_T$}N_T+O_p\Bigl(\sqrt{\frac\kappa n}\Bigr), \end{aligned}

P. 1515: “We first propose estimators for the bias E[(xˉC−xˉT)(ν1+ν2+ν3)]\mathbb E[\colorbox{#ffe58a}{$(\bar x_C-\bar x_T)$}(\nu_1+\nu_2+\nu_3)].”

P. 1507, Remark 2: “The bias in E[(xˉC−xˉT)′v2]E[(\bar x_C-\bar x_T)'\colorbox{#ffe58a}{$v_2$}] has been discussed previously. (xˉC−xˉT)′v2(\bar x_C-\bar x_T)'\colorbox{#ffe58a}{$v_2$} contains no unknowns and hence can be subtracted directly for debiasing purposes.”

The problem

Since the covariates xix_i are column vectors (Section 2), each of these scalar adjustments needs the transpose of the covariate mean. The same expressions carry it in Theorems 3.1, 3.2 and 4.2. In the second equality on p. 1516, the sum with factor 1/nC1/n_C expands y(0)‾C−xˉC′N\overline{y(0)}_C-\bar x_C'N and must run over the control group. Remark 2 refers to the component ν2\nu_2 that Theorem 3.1 defines immediately above it.

Evidence a check of the printed page

The evidence is a check of the pages against Section 2 and the statements of Theorems 3.1, 3.2 and 4.2. With the transposes restored, the inverse terms on p. 1516 cancel:

−(xˉT−xˉC)′L^−1N^−(xˉC−xˉT)′(L^−1−Id−1)N^=−(xˉT−xˉC)′N^.-(\bar x_T-\bar x_C)'\widehat L^{-1}\hat N-(\bar x_C-\bar x_T)'\bigl(\widehat L^{-1}-I_d^{-1}\bigr)\hat N=-(\bar x_T-\bar x_C)'\hat N.

Further, y(0)‾C−xˉC′N=nC−1∑i∈[C](yi(0)−xi′N)\overline{y(0)}_C-\bar x_C'N=n_C^{-1}\sum_{i\in[C]}(y_i(0)-x_i'N).

What survives

No result changes. The weights in the last display on p. 1518 are a separate misprint, corrected under P005-E013.

Corrected

P. 1516, first and third lines of the display:

ATE^Debiased=(y(1)‾T−y(0)‾C−(xˉT−xˉC)′L^−1N^)−(xˉC−xˉT)′(L^−1−Id−1)N^+⋯=1nT∑i∈[T](yi(1)−xi′N)−1nC∑i∈[C](yi(0)−xi′N)−⋯\begin{aligned} \widehat{\mathrm{ATE}}_{\mathrm{Debiased}}&=\bigl(\overline{y(1)}_T-\overline{y(0)}_C-\colorbox{#ffe58a}{$\displaystyle (\bar x_T-\bar x_C)'$}\widehat L^{-1}\hat N\bigr)-(\bar x_C-\bar x_T)'\bigl(\widehat L^{-1}-I_d^{-1}\bigr)\hat N+\cdots\\ &=\frac1{n_T}\sum_{i\in[T]}\bigl(y_i(1)-x_i'N\bigr)-\frac1{n_C}\sum_{\colorbox{#ffe58a}{$\displaystyle i\in[C]$}}\bigl(y_i(0)-x_i'N\bigr)-\cdots \end{aligned}

P. 1518, last display: write xˉT′\colorbox{#ffe58a}{$\bar x_T'$} for xˉT\bar x_T before L^T−1N^T\widehat L_T^{-1}\hat N_T in the first line, before NTN_T and before (N^T−NT)(\hat N_T-N_T) in the second line, and before NTN_T in the third line. The display with these transposes and with the corrected weights is given under P005-E013.

P. 1515: “We first propose estimators for the bias E[(xˉC−xˉT)′(ν1+ν2+ν3)]\mathbb E[\colorbox{#ffe58a}{$(\bar x_C-\bar x_T)'$}(\nu_1+\nu_2+\nu_3)].”

P. 1507, Remark 2: “The bias in E[(xˉC−xˉT)′ν2]E[(\bar x_C-\bar x_T)'\colorbox{#ffe58a}{$\nu_2$}] has been discussed previously. (xˉC−xˉT)′ν2(\bar x_C-\bar x_T)'\colorbox{#ffe58a}{$\nu_2$} contains no unknowns and hence can be subtracted directly for debiasing purposes.”

Crop of the sentence 'Now we derive the stochastic expansion for the debiased estimator:' and the four-line display for the debiased ATE estimator. One red box marks the factor (x-bar_T minus x-bar_C), printed without a prime, before L-hat inverse N-hat in the first line. A second red box marks the index set 'i in [T]' under the second sum of the third line, the sum of y_i(0) minus x_i prime N with factor one over n_C.
Proof of Theorem 3.2, p. 1516 (PDF p. 15), the expansion of ATE^Debiased\widehat{\mathrm{ATE}}_{\mathrm{Debiased}}. The first marked factor has no transpose; the second marked index set belongs to a sum of control outcomes with factor 1/nC1/n_C.
Crop of the sentence 'We can characterize the stochastic expansion for the debiased estimator of the treated group as' and the three-line display for the treated-arm debiased estimator. Red boxes mark four occurrences of x-bar_T printed without a prime: before L-hat_T inverse N-hat_T in the first line, before N_T and before (N-hat_T minus N_T) in the second line, and before N_T in the third line.
Proof of Theorem 4.2, p. 1518 (PDF p. 17), last display. The four marked factors xˉT\bar x_T have no transpose; the factor inside the large parentheses of the first line has one.
Crop of the heading 'B.2. Proof of Theorem 3.2' and the first three lines of the proof. A red box marks the factor (x-bar_C minus x-bar_T), printed without a prime, in the expectation E[(x-bar_C minus x-bar_T)(nu_1 + nu_2 + nu_3)].
Proof of Theorem 3.2, p. 1515 (PDF p. 14), first sentence. The marked factor has no transpose; item 1, two lines below, writes (xˉC−xˉT)′ν1(\bar x_C-\bar x_T)'\nu_1.
Crop of Remark 2 with one line of text above and one below. Red boxes mark the symbol v_2, in a Latin letter, in both of its occurrences: in 'The bias in E[(x-bar_C minus x-bar_T) prime v_2] has been discussed previously' and in '(x-bar_C minus x-bar_T) prime v_2 contains no unknowns'.
Remark 2, p. 1507 (PDF p. 6). Both marked symbols are a Latin v2v_2; Theorem 3.1, above the remark, defines the Greek ν2\nu_2.

The estimator of the control-arm bias in the proof of Theorem 4.2 should have L^C−1\widehat L_C^{-1}, not L^T−1\widehat L_T^{-1}.

Appendix B.4, proof of Theorem 4.2, p. 1518 (PDF p. 17), the display after “Similarly, an unbiased estimator for”

See also under Formal statements (Lean): P005-T12, P005-T13

As printed

“Similarly, an unbiased estimator for E[xˉC′(ν1C+ν2C+ν3C)]\mathbb E[\bar x_C'(\nu_{1C}+\nu_{2C}+\nu_{3C})] is

nT(n−2)nC(hy(0)‾C−hˉCy(0)‾C)+xˉC′(L^T−1−Id−1)N^C.”\frac{n_T}{(n-2)n_C}\bigl(\overline{hy(0)}_C-\bar h_C\overline{y(0)}_C\bigr)+\bar x_C'\bigl(\widehat L_{\colorbox{#ffe58a}{$\displaystyle T$}}^{-1}-I_d^{-1}\bigr)\hat N_C.\text{''}
The problem

The display is the control-arm analogue of the treated-arm estimator printed above it. By Theorem 4.1, ν2C=(L^C−1−Id−1)N^C\nu_{2C}=(\widehat L_C^{-1}-I_d^{-1})\hat N_C, so the term that is subtracted directly must use the control-arm matrix L^C\widehat L_C. With L^T−1\widehat L_T^{-1} the expression differs from the intended one by xˉC′(L^T−1−L^C−1)N^C\bar x_C'(\widehat L_T^{-1}-\widehat L_C^{-1})\hat N_C. Since the expectation of this difference need not vanish, the expression as printed is not in general unbiased.

Evidence an exact counterexample

The evidence is a check of the page against Theorems 4.1 and 4.2 and an exact counterexample. Let n=6n=6, nT=2n_T=2, d=1d=1, x=3/20 (−3,−2,−1,0,1,5)x=\sqrt{3/20}\,(-3,-2,-1,0,1,5) and y(0)=(9,4,1,0,1,25)y(0)=(9,4,1,0,1,25), with hi=xi2h_i=x_i^2. Then xˉ=0\bar x=0 and x2‾=1\overline{x^2}=1, and L^T\widehat L_T and L^C\widehat L_C are invertible for each of the 15 assignments. The control-arm term xˉC′β^I,C=xˉC′L^C−1N^C\bar x_C'\widehat\beta_{I,C}=\bar x_C'\widehat L_C^{-1}\hat N_C of ATE^I\widehat{\mathrm{ATE}}_I has mean 31085815448171/17062566567774≈1.82231085815448171/17062566567774\approx1.822 over the assignments. Since E[xˉC]=0\mathbb E[\bar x_C]=0, this mean is the bias E[xˉC′(ν1C+ν2C+ν3C)]\mathbb E[\bar x_C'(\nu_{1C}+\nu_{2C}+\nu_{3C})] to be estimated. The expression with L^C−1\widehat L_C^{-1} has the same mean. The expression as printed has mean 12010469/846720≈14.18512010469/846720\approx14.185.

What survives

Theorem 4.2 prints L^C−1\widehat L_C^{-1} in the control-arm term and is unaffected, as is the definition of ν2C\nu_{2C} in Theorem 4.1. Only this display of the proof changes.

Corrected

“Similarly, an unbiased estimator for E[xˉC′(ν1C+ν2C+ν3C)]\mathbb E[\bar x_C'(\nu_{1C}+\nu_{2C}+\nu_{3C})] is

nT(n−2)nC(hy(0)‾C−hˉCy(0)‾C)+xˉC′(L^C−1−Id−1)N^C.”\frac{n_T}{(n-2)n_C}\bigl(\overline{hy(0)}_C-\bar h_C\overline{y(0)}_C\bigr)+\bar x_C'\bigl(\widehat L_{\colorbox{#ffe58a}{$\displaystyle C$}}^{-1}-I_d^{-1}\bigr)\hat N_C.\text{''}
Crop of two sentences with their displays: 'Thus, an unbiased estimator for E[minus x-bar_T prime (nu_1T + nu_2T + nu_3T)] is' with the treated-arm estimator, and 'Similarly, an unbiased estimator for E[x-bar_C prime (nu_1C + nu_2C + nu_3C)] is' with the control-arm estimator. A red box marks L-hat_T inverse in the control-arm display, in the factor (L-hat_T inverse minus I_d inverse) before N-hat_C.
Proof of Theorem 4.2, p. 1518 (PDF p. 17). The marked inverse in the control-arm estimator carries the subscript TT; the treated-arm estimator above it is correct.

Read “an OLS regression” on p. 1505 and “respectively” on p. 1509.

p. 1505 (PDF p. 4), the sentence before equation (1); p. 1509 (PDF p. 8), Section 4, the sentence after the display for ATE^I\widehat{\mathrm{ATE}}_I

As printed

p. 1505: “The first estimator results from a OLS regression:”

p. 1509: “for the interacted case, where β^I,T\widehat\beta_{I,T} and β^I,C\widehat\beta_{I,C} are the OLS coefficients on covariates DixiD_ix_i and xix_i, repsectively.”

The problem

The indefinite article before “OLS” should be “an”, and “repsectively” is a misspelling of “respectively”.

Evidence a check of the printed page

The evidence is a check of the two pages.

What survives

Nothing else changes. The description of the two coefficients in the second sentence is the subject of P005-E004.

Corrected

p. 1505: “The first estimator results from an OLS regression:”

p. 1509: “… on covariates DixiD_ix_i and xix_i, respectively.”

Crop of three lines of text on page 1505, followed by equation (1), Y_i ~ alpha + tau D_i + x_i' beta. The third line reads 'results from a OLS regression:'. A red box marks the words 'a OLS'.
p. 1505 (PDF p. 4), the sentence before equation (1). The marked words are “a OLS”.
Crop from page 1509. It shows the display for the interacted estimator, the sentence 'for the interacted case, where beta-hat I,T and beta-hat I,C are the OLS coefficients on covariates D_i x_i and x_i, repsectively.', and the first three lines of Theorem 4.1. A red box marks the word 'repsectively'.
p. 1509 (PDF p. 8), Section 4, the sentence after the display for ATE^I\widehat{\mathrm{ATE}}_I. The marked word is “repsectively”.

In the final expansion of the treated-arm debiased estimator, the weight on the treated-arm covariance should be nC/((n−2)nT)n_C/((n-2)n_T), not nT/((n−2)nC)n_T/((n-2)n_C).

Appendix B.4, proof of Theorem 4.2, p. 1518 (PDF p. 17), last display, first and second lines

See also under Formal statements (Lean): P005-T10, P005-T11

As printed
ATE^T,I,Debiased=y(1)‾T−xˉTL^T−1N^T−(−xˉT′(L^T−1−Id−1)N^T−nT(n−2)nC(hy(1)‾T−hˉTy(1)‾T))=y(1)‾T−xˉTNT−xˉT(N^T−NT)+nT(n−2)nC(hy(1)‾T−hˉTy(1)‾T)=y(1)‾T−xˉTNT+Op(κn),\begin{aligned} \widehat{\mathrm{ATE}}_{T,I,\mathrm{Debiased}}&=\overline{y(1)}_T-\bar x_T\widehat L_T^{-1}\hat N_T-\Bigl(-\bar x_T'\bigl(\widehat L_T^{-1}-I_d^{-1}\bigr)\hat N_T-\colorbox{#ffe58a}{$\displaystyle \frac{n_T}{(n-2)n_C}$}\bigl(\overline{hy(1)}_T-\bar h_T\overline{y(1)}_T\bigr)\Bigr)\\ &=\overline{y(1)}_T-\bar x_TN_T-\bar x_T(\hat N_T-N_T)+\colorbox{#ffe58a}{$\displaystyle \frac{n_T}{(n-2)n_C}$}\bigl(\overline{hy(1)}_T-\bar h_T\overline{y(1)}_T\bigr)\\ &=\overline{y(1)}_T-\bar x_TN_T+O_p\Bigl(\sqrt{\frac\kappa n}\Bigr), \end{aligned}

Two displays earlier on the same page: “Collecting the constants in front of (hy(1)‾T−hˉTy(1)‾T)(\overline{hy(1)}_T-\bar h_T\overline{y(1)}_T) gives

nCn(nT−1)−(n−nT)(n−2nT)(n−1)(n−2)nT2×nT(n−1)(nT−1)n=nC(n−2)nT.”\frac{n_C}{n(n_T-1)}-\frac{(n-n_T)(n-2n_T)}{(n-1)(n-2)n_T^2}\times\frac{n_T(n-1)}{(n_T-1)n}=\frac{n_C}{(n-2)n_T}.\text{''}
The problem

The display expands the debiased estimator for the treated arm by subtracting the bias estimator derived just above it, whose covariance weight is nC/((n−2)nT)n_C/((n-2)n_T). Both lines print the weight with nTn_T and nCn_C interchanged. The two weights agree only when nT=nCn_T=n_C. In an unbalanced design the expression as printed is not unbiased for y(1)‾\overline{y(1)}.

Evidence an exact counterexample

The evidence is a recalculation and an exact counterexample. With NTTTN_{\mathrm{TTT}} as defined on p. 1510, the coefficient collected on p. 1518 is

nCn(nT−1)−NTTTnT(n−1)(nT−1)n=nCn(nT−1)(1−nC−nT(n−2)nT)=nC(n−2)nT.\frac{n_C}{n(n_T-1)}-N_{\mathrm{TTT}}\frac{n_T(n-1)}{(n_T-1)n}=\frac{n_C}{n(n_T-1)}\Bigl(1-\frac{n_C-n_T}{(n-2)n_T}\Bigr)=\frac{n_C}{(n-2)n_T}.

For the counterexample, let n=6n=6, nT=2n_T=2, d=1d=1, x=3/20 (−3,−2,−1,0,1,5)x=\sqrt{3/20}\,(-3,-2,-1,0,1,5), y(1)=(9,4,1,0,1,25)y(1)=(9,4,1,0,1,25) and y(0)=0y(0)=0, with hi=xi2h_i=x_i^2. Over the 15 assignments, the second line of the display has mean 4913/1200≈4.0944913/1200\approx4.094 with the printed weight 1/81/8, and mean 20/320/3 with the weight 1/21/2 derived on the page. The population mean y(1)‾\overline{y(1)} is 20/320/3.

What survives

Theorem 4.2 states the correct weight, and the coefficient derived two displays earlier is correct. Only the two repetitions of the weight in this display change. The same display also lacks four transposes, listed under P005-E010.

Corrected

With the weight restored, and with the transposes of P005-E010:

ATE^T,I,Debiased=y(1)‾T−xˉT′L^T−1N^T−(−xˉT′(L^T−1−Id−1)N^T−nC(n−2)nT(hy(1)‾T−hˉTy(1)‾T))=y(1)‾T−xˉT′NT−xˉT′(N^T−NT)+nC(n−2)nT(hy(1)‾T−hˉTy(1)‾T)=y(1)‾T−xˉT′NT+Op(κn).\begin{aligned} \widehat{\mathrm{ATE}}_{T,I,\mathrm{Debiased}}&=\overline{y(1)}_T-\bar x_T'\widehat L_T^{-1}\hat N_T-\Bigl(-\bar x_T'\bigl(\widehat L_T^{-1}-I_d^{-1}\bigr)\hat N_T-\colorbox{#ffe58a}{$\displaystyle \frac{n_C}{(n-2)n_T}$}\bigl(\overline{hy(1)}_T-\bar h_T\overline{y(1)}_T\bigr)\Bigr)\\ &=\overline{y(1)}_T-\bar x_T'N_T-\bar x_T'(\hat N_T-N_T)+\colorbox{#ffe58a}{$\displaystyle \frac{n_C}{(n-2)n_T}$}\bigl(\overline{hy(1)}_T-\bar h_T\overline{y(1)}_T\bigr)\\ &=\overline{y(1)}_T-\bar x_T'N_T+O_p\Bigl(\sqrt{\frac\kappa n}\Bigr). \end{aligned}

After the cancellation, the treated component is

y(1)‾T−xˉT′N^T+nC(n−2)nT(hy(1)‾T−hˉTy(1)‾T),N^T=y(1)x‾T−y(1)‾TxˉT.\overline{y(1)}_T-\bar x_T'\hat N_T+\frac{n_C}{(n-2)n_T}\bigl(\overline{hy(1)}_T-\bar h_T\overline{y(1)}_T\bigr),\qquad\hat N_T=\overline{y(1)x}_T-\overline{y(1)}_T\bar x_T.
Crop of the sentence 'We can characterize the stochastic expansion for the debiased estimator of the treated group as' and the three-line display for the treated-arm debiased estimator. Red boxes mark the fraction n_T over (n minus 2) n_C in front of the treated-arm covariance of h and y(1), once in the first line and once in the second line.
Proof of Theorem 4.2, p. 1518 (PDF p. 17), last display. The two marked weights have nTn_T over nCn_C; the weight derived two displays earlier on the same page, and stated in Theorem 4.2, is nC/((n−2)nT)n_C/((n-2)n_T).

The expansion of Theorem 4.1, which the paper cites from Lei and Ding (2021) without proof, holds with the stated remainder for d≥2d\ge2 under the printed condition, and for d=1d=1 only if κ=o(1)\kappa=o(1) is added.

Theorem 4.1, p. 1510 (PDF p. 9), the expansion with remainder Op(κd/n)O_p(\sqrt{\kappa d/n}) and footnote 8; its proof, Appendix B.3, p. 1517 (PDF p. 16)

See also under Formal statements (Lean): P005-T9

As printed

Theorem 4.1, p. 1510: “If κlog⁡d=o(1)\kappa\colorbox{#ffe58a}{$\log d$}=o(1),” with footnote 8 attached, followed by the display

ATE^I=ATE+1nT∑i∈[T](yi(1)−y(1)‾−xi′βI,T)−1nC∑i∈[C](yi(0)−y(0)‾−xi′βI,C)+Op(κdn).\widehat{\mathrm{ATE}}_I=\mathrm{ATE}+\frac{1}{n_T}\sum_{i\in[T]}\bigl(y_i(1)-\overline{y(1)}-x_i'\beta_{I,T}\bigr)-\frac{1}{n_C}\sum_{i\in[C]}\bigl(y_i(0)-\overline{y(0)}-x_i'\beta_{I,C}\bigr)+O_p\Bigl(\sqrt{\frac{\kappa d}{n}}\Bigr).

Footnote 8: “The upper bound on the stochastic order of the bias of the interacted case is characterized in equation (15) in Lei and Ding (2021).”

Appendix B.3, p. 1517: “The decomposition of the bias is similar to the one in Theorem 3.1. We omit the details. The stochastic order of the bias is derived in Lei and Ding (2021).”

The problem

The paper gives no proof of this expansion. Appendix B.3 omits the details and refers to Lei and Ding (2021), and footnote 8 does the same. The question is whether the cited order holds under Assumptions 1–3 with the condition κlog⁡d=o(1)\kappa\log d=o(1). It holds for d≥2d\ge2. It does not hold for d=1d=1, where the condition is empty. This is the defect described in P005-E001, and it is the only failure of this expansion that I found. The proofs also rely on results from other papers: Lemma A.5 and (B.6) of Lei and Ding (2021), Proposition 1 of Freedman (2008b) and Proposition 1 of Wu and Ding (2021). I found no failure in the use of these.

Evidence an exact counterexample

The evidence is a derivation and an exact counterexample. For the derivation, suppose that Assumptions 1–3 hold and that κlog⁡(2d)=o(1)\kappa\log(2d)=o(1). Let SS be an arm of size mm, and define GS=m−1∑i∈Sxixi′G_S=m^{-1}\sum_{i\in S}x_ix_i'. Note that 0⪯xixi′⪯nκId0\preceq x_ix_i'\preceq n\kappa I_d and xx′‾=Id\overline{xx'}=I_d. By a Chernoff bound for sums of positive semidefinite matrices, which also holds for sampling without replacement, I have

P{λmin⁡(GS)≤12}≤dexp⁡(−m/n8κ),P\bigl\{\lambda_{\min}(G_S)\le\tfrac12\bigr\}\le d\exp\Bigl(-\frac{m/n}{8\kappa}\Bigr),

and the right-hand side tends to zero, because κlog⁡(2d)=o(1)\kappa\log(2d)=o(1) and m/nm/n is bounded below by Assumption 3. Since E∥xˉS∥2=O(d/n)E\|\bar x_S\|^2=O(d/n) and d/n≤κd/n\le\kappa, I have L^S=GS−xˉSxˉS′⪰Id/4\widehat L_S=G_S-\bar x_S\bar x_S'\succeq I_d/4 with probability tending to one. Let yy be the potential outcome of the arm, β=xy‾\beta=\overline{xy} and ei=yi−yˉ−xi′βe_i=y_i-\bar y-x_i'\beta, so that eˉ=0\bar e=0, xe‾=0\overline{xe}=0 and e2‾≤K\overline{e^2}\le K. The fitted intercept of the arm is

yˉ+eˉS−xˉS′L^S−1(xe‾S−xˉSeˉS),\bar y+\bar e_S-\bar x_S'\widehat L_S^{-1}\bigl(\overline{xe}_S-\bar x_S\bar e_S\bigr),

with ∥xˉS∥=Op(d/n)\|\bar x_S\|=O_p(\sqrt{d/n}), eˉS=Op(n−1/2)\bar e_S=O_p(n^{-1/2}) and ∥xe‾S∥=Op(κ)\|\overline{xe}_S\|=O_p(\sqrt\kappa). The last term is Op(κd/n)+Op(d/n3/2)=Op(κd/n)O_p(\sqrt{\kappa d/n})+O_p(d/n^{3/2})=O_p(\sqrt{\kappa d/n}). Since ATE^I\widehat{\mathrm{ATE}}_I is the difference of the two fitted intercepts, I obtain the expansion. For d≥2d\ge2, the inequality log⁡(2d)≤2log⁡d\log(2d)\le2\log d shows that the printed condition suffices.

The counterexample for d=1d=1 is a second sequence, different from the one in P005-E001. Let r=2,4,6,…r=2,4,6,\ldots, n=r2+1n=r^2+1 and ℓ=(n−1)/2\ell=(n-1)/2. One unit has the covariate value n−1n-1 before scaling and both potential outcomes equal to 00. The other 2ℓ2\ell units have the labels ti∈{±1/ℓ,±2/ℓ,…,±1}t_i\in\{\pm1/\ell,\pm2/\ell,\ldots,\pm1\}, the covariate values −1+ϵti-1+\epsilon t_i before scaling and the potential outcomes yi(1)=yi(0)=tiy_i(1)=y_i(0)=t_i. Here ϵ=2rn−3/(1−qn−6)\epsilon=2rn^{-3}/(1-qn^{-6}) with q=(ℓ+1)(2ℓ+1)/(3nℓ)q=(\ell+1)(2\ell+1)/(3n\ell), so that ϵ\epsilon is asymptotic to 2n−5/22n^{-5/2}. The arm sizes are nT=ℓn_T=\ell and nC=ℓ+1n_C=\ell+1. Assumptions 1–3 hold with K=1K=1, every regression is invertible, and κ→1\kappa\to1. Under every assignment the remainder satisfies ∣Rn∣≥1/ϵ−6|R_n|\ge1/\epsilon-6. At n=5n=5, where ϵ=1000/31249\epsilon=1000/31249, the bound is 25249/100025249/1000, and enumeration of the 10 assignments agrees. At n=17n=17 the bound is 191213957/314432191213957/314432, and enumeration of the 24,310 assignments agrees.

The identities and inequalities that the proofs take from the other cited results were derived directly: the mean and the variance of the quadratic forms under sampling without replacement that are used on pp. 1511, 1514 and 1517, the mean identities behind equation (5), and the leverage inequality on p. 1517. I did not compare these with the cited papers, and I do not confirm the wording or the numbering of the cited results.

What survives

The algebraic decomposition of the bias in Theorem 4.1, the expansion for d≥2d\ge2 under the printed condition, and the exact unbiasedness of the two corrections are unaffected. The asymptotic statements for the debiased estimators already assume κ=o(1)\kappa=o(1), which excludes the example. What changes is the condition for d=1d=1, as in P005-E001. This entry adds no second error.

Corrected

Theorem 4.1, last paragraph. Let Assumptions 1–3 hold, and let all design matrices be invertible, as footnote 4 assumes. If κlog⁡max⁡{d,2}=o(1)\kappa\colorbox{#ffe58a}{$\log\max\{d,2\}$}=o(1), then

ATE^I=ATE+1nT∑i∈[T](yi(1)−y(1)‾−xi′βI,T)−1nC∑i∈[C](yi(0)−y(0)‾−xi′βI,C)+Op(κdn).\widehat{\mathrm{ATE}}_I=\mathrm{ATE}+\frac{1}{n_T}\sum_{i\in[T]}\bigl(y_i(1)-\overline{y(1)}-x_i'\beta_{I,T}\bigr)-\frac{1}{n_C}\sum_{i\in[C]}\bigl(y_i(0)-\overline{y(0)}-x_i'\beta_{I,C}\bigr)+O_p\Bigl(\sqrt{\frac{\kappa d}{n}}\Bigr).

This is the statement given under P005-E001. The condition κlog⁡(2d)=o(1)\kappa\log(2d)=o(1), under which the derivation above is written, is equivalent to it: both reduce to the printed condition for d≥2d\ge2 and to κ=o(1)\kappa=o(1) for d=1d=1. The reference to Lei and Ding (2021) in Appendix B.3 and in footnote 8 can stay, with the condition as corrected.

Crop of the top of page 1510. The first line reads 'If kappa log d = o(1),' with the footnote mark 8. The display below gives ATE-hat_I as ATE plus the treated-arm average of y_i(1) minus its mean minus x_i' beta_{I,T}, minus the corresponding control-arm average, and its second line is 'plus O_p of the square root of kappa d over n'. Red boxes mark the condition 'kappa log d = o(1)' and the remainder term.
Theorem 4.1, continued, p. 1510 (PDF p. 9). The marked terms are the condition κlog⁡d=o(1)\kappa\log d=o(1) and the remainder Op(κd/n)O_p(\sqrt{\kappa d/n}).
Crop of section B.3, Proof of Theorem 4.1, on page 1517. The section has three sentences: 'The decomposition of the bias is similar to the one in Theorem 3.1. We omit the details. The stochastic order of the bias is derived in Lei and Ding (2021).' A red box marks the last sentence.
Appendix B.3, p. 1517 (PDF p. 16): the proof of Theorem 4.1 in full. The marked sentence refers the stochastic order to Lei and Ding (2021).

The second line of the display that rewrites the term (∗)(*) has one closing parenthesis too many.

Appendix B.1.1, p. 1514 (PDF p. 13), first display, second line

See also under Formal statements (Lean): P005-T18

As printed
=1pCxˉT′(1n∑i∈[T](xi(ei(1)−ei(0))+1pT1n∑i=1nxiei(0))))=\frac1{p_C}\bar x_T'\Bigl(\frac1n\sum_{i\in[T]}\Bigl(x_i\bigl(e_i(1)-e_i(0)\bigr)+\frac1{p_T}\frac1n\sum_{i=1}^nx_ie_i(0)\Bigr)\Bigr)\colorbox{#ffe58a}{$\displaystyle )$}
The problem

The line closes one parenthesis more than it opens. Nothing else in the display is wrong. On the second and third lines the population average stands inside the parenthesis that opens after the sum over i∈[T]i\in[T]. It is added nTn_T times and multiplied by 1/n1/n, which supplies the factor pTp_T.

Evidence a derivation

The evidence is a check of the page and a derivation. Let δi=ei(1)−ei(0)\delta_i=e_i(1)-e_i(0), A=n−1∑i=1nxiδiA=n^{-1}\sum_{i=1}^nx_i\delta_i, B=n−1∑i=1nxiei(0)B=n^{-1}\sum_{i=1}^nx_ie_i(0) and U=n−1∑i∈[T]xiδiU=n^{-1}\sum_{i\in[T]}x_i\delta_i. The relation pT∑ixiei(1)+pC∑ixiei(0)=0p_T\sum_ix_ie_i(1)+p_C\sum_ix_ie_i(0)=0, quoted below the display, gives B=−pTAB=-p_TA. The three bracketed expressions are U+BU+B, n−1∑i∈[T](xiδi+B/pT)n^{-1}\sum_{i\in[T]}(x_i\delta_i+B/p_T) and n−1∑i∈[T](xiδi−A)n^{-1}\sum_{i\in[T]}(x_i\delta_i-A). The last two equal U+BU+B because nT/n=pTn_T/n=p_T.

What survives

The algebra for (∗)(*), its expectation and its stated order are unchanged, and no factor needs to be added.

Corrected

The second line, with its last parenthesis deleted:

=1pCxˉT′(1n∑i∈[T](xi(ei(1)−ei(0))+1pT1n∑i=1nxiei(0))))=\frac1{p_C}\bar x_T'\Bigl(\frac1n\sum_{i\in[T]}\Bigl(x_i\bigl(e_i(1)-e_i(0)\bigr)+\frac1{p_T}\frac1n\sum_{i=1}^nx_ie_i(0)\Bigr)\Bigr)\del{)}
Crop of the sentence 'We bound the stochastic order of (*):' and the three-line display below it. Each line is one over p_C times x-bar_T prime times a bracketed sum over the treated group. A red box marks the small closing parenthesis at the very end of the second line, after the two large closing parentheses.
Appendix B.1.1, p. 1514 (PDF p. 13), the three-line display that rewrites the term (∗)(*). The marked parenthesis at the end of the second line closes nothing.

The stochastic order estimates used at the end of the proof of Theorem 4.2 are derived in the proof of Theorem 3.2, not of Theorem 4.1.

Appendix B.4, end of the proof of Theorem 4.2, first line of p. 1519 (PDF p. 18)

As printed

“using the stochastic order estimates we derived in the proof of Theorem 4.1 and the fact that κ∈[dn,1]\kappa\in[\frac dn,1].”

The problem

The proof of Theorem 4.1 (Appendix B.3, p. 1517) is three sentences long. It omits the details and refers to Lei and Ding (2021) for the stochastic order of the bias; it derives no estimates. The estimates used here are items 1–3 of the proof of Theorem 3.2 (Appendix B.2, pp. 1516–1517).

Evidence a check of the printed page

The evidence is a check of pp. 1516–1519.

What survives

The estimates and the step that uses them are unaffected, and only the reference changes.

Corrected

“using the stochastic order estimates we derived in the proof of Theorem 3.2 and the fact that κ∈[dn,1]\kappa\in[\frac dn,1].”

Crop of the running head of page 1519 and the two lines that end the proof of Theorem 4.2: 'using the stochastic order estimates we derived in the proof of Theorem 4.1 and the fact that kappa is in [d/n, 1].' A red box marks 'Theorem 4.1'.
End of the proof of Theorem 4.2, first line of p. 1519 (PDF p. 18). The marked reference points to Theorem 4.1, whose proof derives no stochastic order estimates.

The authors of An Introduction to the Bootstrap are Efron and Tibshirani, in that order; the citation and the reference entry reverse them.

References, p. 1519 (PDF p. 18), the entry for An Introduction to the Bootstrap; cited in the Introduction, p. 1504 (PDF p. 3)

As printed

P. 1519, reference list: TIBSHIRANI, ROBERT J., AND BRADLEY EFRON (1993): “An Introduction to the Bootstrap,” Monographs on statistics and applied probability, 57, 1–436. [1504]

P. 1504: “Tibshirani and Efron (1993) have warned that the bias correction could have costs in practice due to its high variability in finite samples.”

The problem

The book An Introduction to the Bootstrap (Chapman & Hall, 1993, Monographs on Statistics and Applied Probability 57) is by Bradley Efron and Robert J. Tibshirani, in that order. The reference entry and the citation in the Introduction give the two authors in the reverse order. With the order corrected, the entry belongs between Deaton and Finucan in the alphabetical list.

Evidence a check of the printed page

The evidence is a check of pp. 1504 and 1519 and the WorldCat catalogue listing of the book (OCLC 481704221), which gives Bradley Efron before Robert J. Tibshirani. I read the listing at https://search.worldcat.org/title/An-introduction-to-the-bootstrap/oclc/481704221. The catalogue does not show whether the book contains the warning that the Introduction attributes to it; I did not check that.

What survives

The book is identified by its title and year, and nothing in the argument depends on the order of its authors. Only the citation and the reference list change.

Corrected

P. 1519, reference list, between the entries for Deaton and Cartwright (2018) and for Finucan, Galbraith, and Stone (1974): EFRON, BRADLEY, AND ROBERT J. TIBSHIRANI (1993): “An Introduction to the Bootstrap,” Monographs on statistics and applied probability, 57, 1–436. [1504]

P. 1504: “Efron and Tibshirani (1993) have warned that the bias correction could have costs in practice due to its high variability in finite samples.”

Crop of three entries of the reference list: Tan (2014), the entry 'Tibshirani, Robert J., and Bradley Efron (1993): An Introduction to the Bootstrap, Monographs on statistics and applied probability, 57, 1-436. [1504]', and White (1980). A red box marks the author heading 'Tibshirani, Robert J., and Bradley Efron'.
Reference list, p. 1519 (PDF p. 18). The marked heading gives Tibshirani before Efron; the entry stands between Tan and White.
Crop of four lines of the Introduction, at the start of the paragraph on the practice of debiasing estimators. A red box marks the citation 'Tibshirani and Efron (1993)' in the sentence 'Tibshirani and Efron (1993) have warned that the bias correction could have costs in practice due to its high variability in finite samples.'
Introduction, p. 1504 (PDF p. 3). The marked citation gives the two authors in the same reversed order.

Clarity notes

Imprecise or ambiguous wording whose intended meaning is correct; not an error.

In Section 4, β^I,T\widehat\beta_{I,T} and β^I,C\widehat\beta_{I,C} are the slopes fitted within the treatment arm and within the control arm; under equation (2) as printed, the coefficient on DixiD_ix_i is the difference of these two slopes.

Equation (2), p. 1506 (PDF p. 5); Section 4, p. 1509 (PDF p. 8), the definitions of β^I,T\widehat\beta_{I,T} and β^I,C\widehat\beta_{I,C} and the sentence after the display for ATE^I\widehat{\mathrm{ATE}}_I

See also under Formal statements (Lean): P005-T22

As printed

Equation (2), p. 1506:

Yi∼αI+τIDi+xi′βI,C+Dixi′βI,T.(2)Y_i\sim\alpha_I+\tau_ID_i+\colorbox{#ffe58a}{$\displaystyle x_i'\beta_{I,C}+D_ix_i'\beta_{I,T}$}.\qquad\text{(2)}

Section 4, p. 1509: “We write the regression coefficient estimators of the pretreatment covariates in the interacted case as β^I,T=L^T−1N^T\widehat\beta_{I,T}=\widehat L_T^{-1}\widehat N_T and β^I,C=L^C−1N^C\widehat\beta_{I,C}=\widehat L_C^{-1}\widehat N_C …” and, after the display

ATE^I=y(1)‾T−y(0)‾C−(xˉT′β^I,T−xˉC′β^I,C)\widehat{\mathrm{ATE}}_I=\overline{y(1)}_T-\overline{y(0)}_C-\bigl(\bar x_T'\widehat\beta_{I,T}-\bar x_C'\widehat\beta_{I,C}\bigr)

“for the interacted case, where β^I,T\widehat\beta_{I,T} and β^I,C\widehat\beta_{I,C} are the OLS coefficients on covariates DixiD_ix_i and xix_i, repsectively.”

Intended meaning

Section 4 defines the two estimators as L^T−1N^T\widehat L_T^{-1}\widehat N_T and L^C−1N^C\widehat L_C^{-1}\widehat N_C. These are the least-squares slopes within the treatment arm and within the control arm. Every formula that follows, including Theorems 4.1 and 4.2, uses these definitions, and the display for ATE^I\widehat{\mathrm{ATE}}_I is correct with them. This is the intended meaning. The labels alone do not match. In equation (2) as printed, the fitted line is αI+xi′βI,C\alpha_I+x_i'\beta_{I,C} in the control arm and αI+τI+xi′(βI,C+βI,T)\alpha_I+\tau_I+x_i'(\beta_{I,C}+\beta_{I,T}) in the treatment arm. The OLS coefficient on xix_i is the control slope, and the coefficient on DixiD_ix_i is the difference of the two slopes, L^T−1N^T−L^C−1N^C\widehat L_T^{-1}\widehat N_T-\widehat L_C^{-1}\widehat N_C. Substituting that interaction coefficient for β^I,T\widehat\beta_{I,T} in the display gives a different number. For example, let x=3/20 (−3,−2,−1,0,1,5)x=\sqrt{3/20}\,(-3,-2,-1,0,1,5) with the first two units in the treatment arm, and let yi(0)=xiy_i(0)=x_i and yi(1)=2xiy_i(1)=2x_i. The coefficients of (2) are (0,0,1,1)(0,0,1,1), and the slopes within the treatment arm and within the control arm are 22 and 11. The display equals 00 with these two slopes and −15/4-\sqrt{15}/4 with the two coefficients of (2). The parameterization below makes the labels agree and changes neither the fitted values nor τ^I\widehat\tau_I.

Corrected

Equation (2):

Yi∼αI+τIDi+(1−Di)xi′βI,C+Dixi′βI,T.(2)Y_i\sim\alpha_I+\tau_ID_i+\colorbox{#ffe58a}{$\displaystyle (1-D_i)$}x_i'\beta_{I,C}+D_ix_i'\beta_{I,T}.\qquad\text{(2)}

Section 4: “for the interacted case, where β^I,T\widehat\beta_{I,T} and β^I,C\widehat\beta_{I,C} are the OLS slopes within the treatment arm and within the control arm, that is, the coefficients on DixiD_ix_i and (1−Di)xi(1-D_i)x_i in (2), respectively.”

Crop from page 1506. Two lines introduce the interacted OLS regression. Equation (2) follows: Y_i ~ alpha_I + tau_I D_i + x_i' beta_{I,C} + D_i x_i' beta_{I,T}. Two further lines name the OLS estimators of the interacted case. A red box marks the last two terms of the equation, x_i' beta_{I,C} + D_i x_i' beta_{I,T}.
Equation (2), p. 1506 (PDF p. 5). The marked terms are xi′βI,C+Dixi′βI,Tx_i'\beta_{I,C}+D_ix_i'\beta_{I,T}.
Crop of the opening of Section 4 on page 1509. The first lines define beta-hat I,T as L-hat T inverse times N-hat T and beta-hat I,C as L-hat C inverse times N-hat C. Below the display for the interacted estimator, the sentence reads 'where beta-hat I,T and beta-hat I,C are the OLS coefficients on covariates D_i x_i and x_i, repsectively.' Red boxes mark the words 'OLS coefficients on covariates D_i x_i' and, on the next line, 'and x_i'.
Section 4, p. 1509 (PDF p. 8): the definitions of β^I,T\widehat\beta_{I,T} and β^I,C\widehat\beta_{I,C}, the display for ATE^I\widehat{\mathrm{ATE}}_I and the sentence after it. The marked words call the two estimators the coefficients on DixiD_ix_i and xix_i.

In Assumption 1 the constant KK is one bound for all nn; the printed order of the quantifiers lets it depend on nn.

Assumption 1, p. 1505 (PDF p. 4), opening words

As printed

“ASSUMPTION 1: For all nn, there exists a finite constant KK such that

1n∑i=1nyi(1)2≤K,1n∑i=1nyi(0)2≤K,1n∑i=1nxik2≤K,\frac1n\sum_{i=1}^n y_i(1)^2\le K,\qquad \frac1n\sum_{i=1}^n y_i(0)^2\le K,\qquad \frac1n\sum_{i=1}^n x_{ik}^2\le K,

for all k=1,…,dk=1,\ldots,d and d≤nd\le n.”

Intended meaning

The intended statement is that there exists a single finite constant KK that bounds the three second moments for every nn. This is the standard form of the assumption and the form that the proofs use. For example, the bounds n−1∑i=1nei2(1)=O(1)n^{-1}\sum_{i=1}^n e_i^2(1)=O(1) and n−1∑i=1nei2(0)=O(1)n^{-1}\sum_{i=1}^n e_i^2(0)=O(1) on p. 1513 need it. Read literally, the printed order lets KK depend on nn, and the condition then holds for every sequence of finite populations. For instance, let n=4mn=4m, and let the population consist of the four units with x=(−1,−1,1,1)x=(-1,-1,1,1) and q=(−1,1,−1,1)q=(-1,1,-1,1), repeated mm times, with y(1)=nqy(1)=nq, y(0)=0y(0)=0 and pT=1/2p_T=1/2. Assumptions 2 and 3 hold, the printed Assumption 1 holds with K=n2K=n^2, and the second moment of the residuals ei(1)e_i(1) is n2n^2. Assumption 3, on the same page, places its constants before the words “for all nn”. The asymptotic arguments of the paper are made under the uniform bound. The finite-sample identities for the bias and for unbiasedness do not need a bound that is uniform in nn.

Corrected

“ASSUMPTION 1: There exists a finite constant KK such that, for all nn,

1n∑i=1nyi(1)2≤K,1n∑i=1nyi(0)2≤K,1n∑i=1nxik2≤K,\frac1n\sum_{i=1}^n y_i(1)^2\le K,\qquad \frac1n\sum_{i=1}^n y_i(0)^2\le K,\qquad \frac1n\sum_{i=1}^n x_{ik}^2\le K,

for all k=1,…,dk=1,\ldots,d and d≤nd\le n.”

Crop of Assumption 1 on page 1505. The first line reads 'Assumption 1: For all n, there exists a finite constant K such that'. Three displayed bounds follow, each an average of squares that is at most K, and then the line 'for all k = 1, ..., d and d <= n.' A red box marks the words 'For all n, there exists a finite constant K'.
Assumption 1, p. 1505 (PDF p. 4). The marked words give the order of the quantifiers.

Formal statements (Lean)

Formal results: 24 whole; 0 restricted; 2 refuted; 1 omitted.

Coverage concerns the identified claim under its stated assumptions. A checked proof establishes the formal statement; correspondence to the published text was reviewed by AI. Repository access is currently required to open the source links.

Each result links to its current formal statement and proof. “Whole” covers the identified claim under its assumptions; “restricted” covers the stated narrower scope; “refuted” gives a counterexample to the identified assertion; “omitted” has no current theorem. Any named published theorem used as a premise remains an assumption. Browse the formal results for this work.

Lemma A.1, the variance bound, as printed for arbitrary nn-vectors aa, bb. The witness is the validator's and is not in the paper

p. 1511 (PDF p. 10), Appendix A.2; the vectors aa, bb and the covariance estimators are introduced on p. 1510 (PDF p. 9)

Appendix A.2, Lemma A.1, pp. 1510–1511 (PDF pp. 9–10). The six-unit counterexample has all the stated means, coefficients, moments, expectation, variance, bound and positive gap. Covariance and its variance are unchanged by constant shifts; the printed bound changes under centering, and its centered value bounds the variance.

Historical component credits
  • Counterexample proved AronowAudit.P005.covariance_counterexample Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; This row is a witness refuting the variance inequality, not a positive proof of that inequality; ancillary moment diagnostics are not required for that credited component.
  • Proved AronowAudit.P005.univ_six Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Not invoked separately: its relevant content is already incorporated in the selected primary proof; no additional conclusion is asserted from this auxiliary.
  • Proved AronowAudit.P005.design_six_four Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Not invoked separately: its relevant content is already incorporated in the selected primary proof; no additional conclusion is asserted from this auxiliary.
  • Proved AronowAudit.P005.expectation_six_four Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Not invoked separately: its relevant content is already incorporated in the selected primary proof; no additional conclusion is asserted from this auxiliary.

Lemma A.1, as repaired: the variance bound with centred vectors (Sol's smallest repair and the validator's derivation)

p. 1511 (PDF p. 10), Appendix A.2

Appendix A.2, Lemma A.1, p. 1511 (PDF p. 10). For either nonempty arm, the printed expectation and the variance bound with both vectors centered hold. Covariance is location invariant, the centered sample-product mean has the simple-random-sampling variance, the product of centered sums has the stated exact expectation and variance and their bound, and the generic variance-difference inequality gives the repaired bound. The printed bound is recovered when both population means are zero.

Historical component credits
  • Proved, conditional on a published theorem AronowAudit.P005.Wave1.corrected_covariance_lemma_conditional Assumes as a hypothesis: L. Lei and P. Ding, "Regression adjustment in completely randomized experiments with a diverging number of covariates", Biometrika 108 (2021), Supplementary Material, Lemma A.5 Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Its literature premise is not a canonical hypothesis; the unconditional centered bound and expectation are instead supplied by existing supporting declarations.
  • Proved AronowAudit.P005.covariance_location_invariant Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; This harmless generalization includes exactly the centering operation needed by the correction.
  • Proved AronowAudit.P005.variance_difference_bound Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Empty-design totalization adds cases but does not replace the nonempty sampling case the target needs.

Proof of Theorem 3.2 (Appendix B.2), item 2: the chain “First notice, by Lemma A.1 and Assumption 1, …”, as printed. The witness is the validator's and is not in the paper

p. 1517 (PDF p. 16), Appendix B.2, item 2

Appendix B.2, item 2, p. 1517 (PDF p. 16). The standardized regular sixteen-unit counterexample satisfies all stated moment and allocation conditions. Its leverage vector, mean and constant leverage-product, three-category probabilities and covariance values, exact variance, both failed bounds and positive gaps, and the valid third-expression and centered-bound comparisons have the stated numerical values.

Historical component credits
  • Proved AronowAudit.P005.Wave1.leverage_variance_counterexample_proof Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; The credited component is the finite failure of the first two bounds. To satisfy sequence language, insert this n=16 population into the standardized scalar-grid sequence of R037-15; K=1 and fixed allocation bounds remain valid, and all-assignment regularity holds on the relevant tail.

Proof of Theorem 3.2 (Appendix B.2), item 2, as repaired: the variance chain with hh and y(1)y(1) centred (Sol's smallest repair and the validator's derivation)

p. 1517 (PDF p. 16), Appendix B.2, item 2

Appendix B.2, item 2, p. 1517 (PDF p. 16). For either arm the centered leverage and outcome moments give every inequality in the repaired finite variance chain, including the intermediate raw leverage second moment. The two allocation coefficients obey the stated bounds. Under Assumptions 1–3 the numerical right-hand side and the actual variance are O(nκ²+κd/n), and the variance after division by n is O(κ²/n+κd/n³). Dimension zero is allowed, including along a sequence.

Historical component credits
  • Proved AronowAudit.P005.Wave1.corrected_leverage_variance_chain_proof Limited support; baseline fidelity: narrower; manifest: used; used in Solution; {'source': 'adjudication+second review', 'adjudicator': 'At P005/Wave1/Gap/GP005B4c.lean:500, the conclusion includes mean(u²) = mean(h²) − d² and mean(u²) ≤ nκd, but omits mean(u²) ≤ mean(h²) and mean(h²) ≤ nκd. P005-T4(b) explicitly asserts both inequalities, and this row claims the whole fixed-n component T4(a)–(e). In particular, the raw-second-moment bound is a separate, stronger conclusion than the exported centered bound; its derivability from the hypotheses does not supply the missing conclusion. The centering, finite-sample assumptions and quantifier over both arms otherwise match the corrected claim.', 'suggested_fix': 'Extend the conclusion with popMean (fun i => u i^2) ≤ popMean (fun i => leverage P i^2) and popMean (fun i => leverage P i^2) ≤ (n : ℝ) * kappa P * d, retaining the existing identity and variance chain.', 'second_review': 'P005/Wave1/Gap/GP005B4c.lean:500 exports the centered second-moment identity and terminal bound but omits the two intermediate inequalities expressly required by P005-T4(b), mean(u²) ≤ mean(h²) ≤ nκd. The omission needs a statement repair, but it is minor: the already exported mean(h) = d and 0 ≤ h_i ≤ nκ give mean(h²) ≤ nκ mean(h) = nκd by averaging h_i² ≤ nκh_i, while the exported identity and d² ≥ 0 give the other inequality. The fixed-n assumptions, both-arm quantifier, and centered variance chain otherwise match the credited T4(a)–(e) component.', 'severity': 'minor'}
  • Proved AronowAudit.P005.Wave1.corrected_leverage_variance_order_proof Limited support; baseline fidelity: narrower; manifest: not used; not used in Solution; {'source': 'adjudication+second review', 'adjudicator': 'At P005/Wave1/Gap/GP005B5.lean:350, the conclusion gives Big-O bounds only for the actual unscaled and scaled covariance variances. P005-T4(f) additionally asserts that the explicit right-hand side of T4(e) is O(nκ² + κd/n), and states two coefficient comparisons using the allocation lower bound; none of these conclusions is present. Calling these assertions proof details in the earlier record does not remove them from the supplied target. The restriction to positive covariate dimension excludes a trivial zero-leverage case, and finite initial sequence indices do not affect the asymptotic assertions.', 'suggested_fix': 'For a fixed uniform outcome-moment bound K, add IsBigO atTop U_t (fun n => (n : ℝ) * kappa (P n)^2 + kappa (P n) * d n / n), where U_t is the final numerical right-hand side of T4(e) with arm size s_n = armSize n (m n) t. Also export the comparisons 2(n−s)/(s(n−1)) ≤ 2/(a(n−1)) and 2(n−s)n/(s³(n−1)) ≤ 2/(a³n(n−1)) when 0 < a < s/n and n ≥ 4; take a = p_min for treatment and a = 1−p_max for control. Retain the existing variance conclusions.', 'second_review': 'P005/Wave1/Gap/GP005B5.lean:350 exports the actual covariance-variance orders, whereas P005-T4(f) also expressly requires the order of the numerical right-hand side U of (e) and the two allocation coefficient comparisons. Those conclusions are absent, but their repair is elementary: take a = lo for treatment or a = 1−hi for control from P005/P005_Formalization.lean:332; s ≥ an and n−s ≤ n give the stated coefficient bounds, and for n ≥ 4 they yield 0 ≤ U ≤ 4K(a⁻¹+a⁻³)(nκ²+κd/n). Thus the missing order is immediate deterministic arithmetic under the existing assumptions, warranting minor severity; the additional positive-dimension restriction also excludes only the trivial zero-leverage case.', 'severity': 'minor'}
  • Proved AronowAudit.P005.mean_add Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Not invoked separately: its relevant content is already incorporated in the selected primary proof; no additional conclusion is asserted from this auxiliary.
  • Proved AronowAudit.P005.mean_sub Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Not invoked separately: its relevant content is already incorporated in the selected primary proof; no additional conclusion is asserted from this auxiliary.
  • Proved AronowAudit.P005.mean_mul Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Not invoked separately: its relevant content is already incorporated in the selected primary proof; no additional conclusion is asserted from this auxiliary.
  • Proved AronowAudit.P005.mean_const Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Not invoked separately: its relevant content is already incorporated in the selected primary proof; no additional conclusion is asserted from this auxiliary.
  • Proved AronowAudit.P005.mean_nonneg Historical support retained; baseline fidelity: ok; manifest: not used; not used in Solution; Not invoked separately: its relevant content is already incorporated in the selected primary proof; no additional conclusion is asserted from this auxiliary.
  • Proved AronowAudit.P005.mean_mono Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Not invoked separately: its relevant content is already incorporated in the selected primary proof; no additional conclusion is asserted from this auxiliary.
  • Proved AronowAudit.P005.mean_square_centering Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Not invoked separately: its relevant content is already incorporated in the selected primary proof; no additional conclusion is asserted from this auxiliary.
  • Proved AronowAudit.P005.leverage_nonneg Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Not invoked separately: its relevant content is already incorporated in the selected primary proof; no additional conclusion is asserted from this auxiliary.
  • Proved AronowAudit.P005.leverage_le_maximum Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Not invoked separately: its relevant content is already incorporated in the selected primary proof; no additional conclusion is asserted from this auxiliary.
  • Proved AronowAudit.P005.leverage_population_mean Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Not invoked separately: its relevant content is already incorporated in the selected primary proof; no additional conclusion is asserted from this auxiliary.
  • Proved AronowAudit.P005.centered_leverage_moment_bounds Limited support; baseline fidelity: narrower; manifest: used; used in Solution; Not invoked separately: its relevant content is already incorporated in the selected primary proof; no additional conclusion is asserted from this auxiliary.

Theorem 4.1, last display on p. 1509 (the third bias component E[xˉC′ν3C]−E[xˉT′ν3T]E[\bar x_C'\nu_{3C}] - E[\bar x_T'\nu_{3T}]), as printed. The witness is the validator's and is not in the paper

p. 1509 (PDF p. 8), Section 4, Theorem 4.1, last display on the page

Theorem 4.1, last display, p. 1509 (PDF p. 8). The printed claim is false: the specified six-unit population satisfies the finite-sample assumptions, has positive variances under all fifteen assignments, and gives 217/2500 for the third bias component while the printed formula gives -217/2500. All individual means, moments, coefficients and expectations are included; reversing both printed signs gives the actual component.

Historical component credits
  • Counterexample proved AronowAudit.P005.interacted_sign_counterexample Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; The finite third-component identity is contradicted under every required fixed-n condition; insertion at n=6 into a standardized distinct-grid sequence with K=28 also supplies the standing sequence interpretation.
  • Proved AronowAudit.P005.design_six_two Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Not invoked separately: its relevant content is already incorporated in the selected primary proof; no additional conclusion is asserted from this auxiliary.
  • Proved AronowAudit.P005.expectation_six_two Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Not invoked separately: its relevant content is already incorporated in the selected primary proof; no additional conclusion is asserted from this auxiliary.

Theorem 4.1, last display on p. 1509, as repaired: both signs of the right-hand side reversed (Sol's smallest repair)

p. 1509 (PDF p. 8), Section 4, Theorem 4.1, last display on the page

Theorem 4.1, last display, p. 1509 (PDF p. 8). For centered covariates, both third-moment identities, their signed bias components and the corrected control-minus-treatment formula hold exactly.

Historical component credits
  • Proved AronowAudit.P005.Wave1.corrected_interacted_third_bias_proof Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; The negative arm identities omitted as separate conjuncts are algebraic restatements of the two exported moments, so no independent conclusion is lost. No corrected-sign assertion is mistaken for the printed identity.

Theorem 4.1, final paragraph: the stochastic expansion under “κlog⁡d=o(1)\kappa\log d = o(1)”, as printed, at d=1d = 1. The sequence is the validator's and is not in the paper

p. 1510 (PDF p. 9), continuation of Theorem 4.1 (the theorem begins on p. 1509, PDF p. 8), with footnote 8

Theorem 4.1, pp. 1509--1510 (PDF pp. 8--9), footnote 8. The printed claim is false: the explicit one-covariate spike sequence satisfies Assumptions 1--3 and every-assignment regularity, yet its remainder is not of the printed stochastic order. The statement includes all grid identities, pointwise bounds, exact leverage and slopes, fitted-line calculations, sharp bounds, probability-one even-size tails and both exact finite minima.

Historical component credits
  • Proved AronowAudit.P005.Wave1.univariate_endpoint_counterexample_proof Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Eventual hypotheses and the even-subsequence lower bound give a genuine failure of full-sequence tightness. The fixed-n exact maxima and illustrative enumerations in the target are diagnostics rather than additional requirements on this witness.
  • Proved AronowAudit.P005.univariate_printed_condition Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; A simple auxiliary identity can be faithful even though proving it is elementary; the actual asymptotic counterexample is separately exported by R037-13.

Theorem 4.1, final paragraph, as repaired: the condition κlog⁡max⁡{d,2}=o(1)\kappa\log\max\{d,2\} = o(1) (Sol's smallest repair for P005-E001)

p. 1510 (PDF p. 9), continuation of Theorem 4.1, with footnote 8; proof B.3 on p. 1517 (PDF p. 16)

No current theorem is supplied for this target.

Historical component credits
  • Proved, conditional on a published theorem AronowAudit.P005.Wave1.corrected_interacted_expansion_max_conditional Assumes as a hypothesis: J. A. Tropp, "Improved analysis of the subsampled randomized Hadamard transform", Advances in Adaptive Data Analysis 3 (2011), Lemma 3.4, pp. 115-126 Historical support retained; baseline fidelity: ok; manifest: not used; Solution use unverified; The only credited expansion theorem requires the unproved proposition Tropp2011RowSampling. The canonical claim has no such hypothesis, and no unconditional estimator expansion is available from this row. Do not turn the cited proposition into an assumption. The separately targeted logarithm equivalences are retained in T9.

Theorem 4.1, final paragraph, as repaired in the form given by the validator of P005-N004: the condition κlog⁡(2d)=o(1)\kappa\log(2d) = o(1), with its equivalence to the form of P005-T8

p. 1510 (PDF p. 9), continuation of Theorem 4.1, with footnote 8; proof B.3 on p. 1517 (PDF p. 16)

Theorem 4.1, p. 1510 (PDF p. 9), and Appendix B.3, p. 1517 (PDF p. 16). Under Assumptions 1--3 and every-assignment invertibility, the repaired condition kappa log(2d) tending to zero implies the full interacted expansion with remainder O_p(sqrt(kappa d/n)). The two repaired logarithms have the stated inequalities and equivalent limits. The repaired condition implies vanishing leverage and the printed condition, and is equivalent to the printed condition plus vanishing leverage on the dimension-one subsequence.

Historical component credits
  • Proved, conditional on a published theorem AronowAudit.P005.Wave1.corrected_interacted_expansion_two_conditional Assumes as a hypothesis: J. A. Tropp, "Improved analysis of the subsampled randomized Hadamard transform", Advances in Adaptive Data Analysis 3 (2011), Lemma 3.4, pp. 115-126 Historical support retained; baseline fidelity: ok; manifest: not used; not used in Solution; Requires unproved Tropp2011RowSampling; the stochastic expansion is dropped and only the independently proved canonical log-equivalence clauses are retained.
  • Proved AronowAudit.P005.repaired_log_bounds Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Fidelity sweep: ok
  • Proved AronowAudit.P005.repaired_log_conditions Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Allowing an arbitrary finite prefix is a true generalization, with no loss of target cases.

Proof of Theorem 4.2 (Appendix B.4), last display on p. 1518: the weight nT(n−2)nC\frac{n_T}{(n-2)n_C} on the treated-arm covariance, as printed. The witness is the validator's and is not in the paper

p. 1518 (PDF p. 17), Appendix B.4, last display (it ends on p. 1519, PDF p. 18)

Appendix B.4, last display, pp. 1518--1519 (PDF pp. 17--18). The printed claim is false: the six-unit standardized regular population has printed treated expectation 4913/1200 instead of 20/3, while the derived weight is unbiased. All fifteen-assignment positivity, leverage, population covariance, assignmentwise and expected gaps, and rational scaling identities are included.

Historical component credits
  • Counterexample proved AronowAudit.P005.interacted_weight_counterexample Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Judged as the finite witness described by this row: it violates unbiasedness of the printed wrong-weight expression and verifies the corrected-weight expectation. No growing-population stochastic-rate refutation is claimed here. The auxiliary S_1 value and pointwise P-Q identity in the target are not necessary to this witness test.
  • Proved AronowAudit.P005.sampleCov_scale_left Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Not invoked separately: its relevant content is already incorporated in the selected primary proof; no additional conclusion is asserted from this auxiliary.
  • Proved AronowAudit.P005.sampleCov_scale_both Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Not invoked separately: its relevant content is already incorporated in the selected primary proof; no additional conclusion is asserted from this auxiliary.
  • Proved AronowAudit.P005.scalar_dot_armN Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Not invoked separately: its relevant content is already incorporated in the selected primary proof; no additional conclusion is asserted from this auxiliary.
  • Proved AronowAudit.P005.scalar_leverage Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Not invoked separately: its relevant content is already incorporated in the selected primary proof; no additional conclusion is asserted from this auxiliary.
  • Proved AronowAudit.P005.scalar_armL_det Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Not invoked separately: its relevant content is already incorporated in the selected primary proof; no additional conclusion is asserted from this auxiliary.
  • Proved AronowAudit.P005.standardized_scalar Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Not invoked separately: its relevant content is already incorporated in the selected primary proof; no additional conclusion is asserted from this auxiliary.

Proof of Theorem 4.2 (Appendix B.4), last display on p. 1518, as repaired: weight nC(n−2)nT\frac{n_C}{(n-2)n_T} (P005-E013), with the transposes of P005-E010 restored

p. 1518 (PDF p. 17), Appendix B.4, last display, and its last line on p. 1519 (PDF p. 18)

Appendix B.4, corrected last display, pp. 1518--1519 (PDF pp. 17--18). The corrected arm expressions cancel the inverse assignmentwise, have the exact generic expectation, and are unbiased with the derived arm-size weights. The cancelling treated weight equals its unsimplified expression and is unique for arms of size at least two; singleton expectations require no division by s-1. The printed treated weight has the stated bias. Standardization gives d/n <= kappa <= 1 and h_i <= n. Under Assumptions 1--3 both corrected arm remainders are O_p(sqrt(kappa/n)), from any starting size, with no extra rate assumption.

Historical component credits
  • Proved AronowAudit.P005.treated_arm_cancellation Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Fidelity sweep: ok
  • Proved AronowAudit.P005.Wave1.treated_arm_expectation_proof Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Fidelity sweep: ok
  • Proved AronowAudit.P005.Wave1.control_arm_expectation_proof Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; The target says the analogous control statements hold, so the nC>=2 restriction is the counterpart of the explicit nT>=2 restriction in T11(b). The iff concerns cancellation of the bias multiplier, not uniqueness of unbiasedness when leverageCov=0.
  • Proved AronowAudit.P005.Wave1.corrected_arm_debiased_order_proof Historical support retained; baseline fidelity: ok; manifest: not used; not used in Solution; The inverse-free form needs no OLS inverse hypothesis; it certifies precisely the order component assigned to this row. Uniform K and the finite tail convention match the claim reading.
  • Proved AronowAudit.P005.dot_comm Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Not invoked separately: its relevant content is already incorporated in the selected primary proof; no additional conclusion is asserted from this auxiliary.
  • Proved AronowAudit.P005.leverage_le_population_size Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Not invoked separately: its relevant content is already incorporated in the selected primary proof; no additional conclusion is asserted from this auxiliary.
  • Proved AronowAudit.P005.kappa_bounds Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; The standalone leverage-range conclusion is not retained; the rate theorem is used directly.

Proof of Theorem 4.2 (Appendix B.4), the display after “Similarly, an unbiased estimator for E[xˉC′(ν1C+ν2C+ν3C)]\mathbf{E}[\bar x_C'(\nu_{1C}+\nu_{2C}+\nu_{3C})] is”, as printed with L^T−1\widehat L_T^{-1}. The witness is the validator's and is not in the paper

p. 1518 (PDF p. 17), Appendix B.4

Appendix B.4, display introduced by “Similarly”, p. 1518 (PDF p. 17). The printed claim is false: for the six-unit population with a=(-3,-2,-1,0,1,5), x=sqrt(3/20)a, y(1)=0 and y(0)=a², all 15 assignments have positive treated and control Gram matrices. The population is standardized, has bounded second moments and allocation 1/3, and has h_i=(3/20)a_i² and mean leverage one. The control slope decomposes into its population slope and the three nu terms; the mean control covariate and its population-slope product have expectation zero. The nuisance-product and fitted-slope-product expectations both equal 31085815448171/17062566567774 (approximately 1.822). The printed estimator has expectation 12010469/846720 (approximately 14.18), so is biased; replacing the treated inverse by the control inverse gives exactly the nuisance expectation. The arm sizes, variance scaling, coefficient 1/8 and all rational-coordinate identities hold assignment by assignment.

Historical component credits
  • Counterexample proved AronowAudit.P005.interacted_inverse_counterexample Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; This is a witness for T12, not proof that all printed formulas are unbiased. The scalar outcome is used as yC; weightPopulation, which places it in yT for another target, is not used in this statement. Centering gives E[xbar_C]=0, so the slope-product expectation is the nuisance bias specified by the target.
  • Proved AronowAudit.P005.scalar_slope_product_scale Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Not invoked separately: its relevant content is already incorporated in the selected primary proof; no additional conclusion is asserted from this auxiliary.
  • Proved AronowAudit.P005.scalar_inverse_product_scale Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Not invoked separately: its relevant content is already incorporated in the selected primary proof; no additional conclusion is asserted from this auxiliary.

Proof of Theorem 4.2 (Appendix B.4), the control-arm bias estimator, as repaired: L^C−1\widehat L_C^{-1} in place of L^T−1\widehat L_T^{-1} (P005-E012)

p. 1518 (PDF p. 17), Appendix B.4, the display introduced by “Similarly”

Appendix B.4, corrected display introduced by “Similarly”, p. 1518 (PDF p. 17). The control bias estimator with the control inverse has the required expectation chain, component expectations and coefficient identities.

Historical component credits
  • Proved AronowAudit.P005.Wave1.corrected_control_bias_estimator_proof Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; All required unbiasedness and component equalities are exported using the control inverse. Positive-dimensional nondegenerate examples exist; any empty-covariate cases are additional harmless cases.

Proof of Theorem 3.2 (Appendix B.2), the expansion of ATE^Debiased\widehat{\mathrm{ATE}}_{\mathrm{Debiased}} on p. 1516, as repaired: transpose restored and the control sum taken over [C][C] (P005-E010); with the same finding's corrections on pp. 1515 and 1507

p. 1516 (PDF p. 15), Appendix B.2, display after “Now we derive the stochastic expansion for the debiased estimator:”; also p. 1515 (PDF p. 14), first sentence of the proof, and p. 1507 (PDF p. 6), Remark 2

Appendix B.2, pp. 1515–1516 (PDF pp. 14–15), and Remark 2, p. 1507 (PDF p. 6). The corrected debiased expansion, inverse cancellation, arbitrary-vector residual identities, centered arm-mean identities and actual bias decomposition hold. A standardized everywhere regular four-unit example shows that the printed treated-set control sum can differ from the control residual mean. One function of the assignment, covariates and observed outcomes, chosen before the potential outcomes, gives the inverse bias component.

Historical component credits
  • Proved AronowAudit.P005.noninteracted_debiased_expansion Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Fidelity sweep: ok
  • Proved AronowAudit.P005.control_minus_treated_mean_identities Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Fidelity sweep: ok
  • Proved AronowAudit.P005.inverse_component_observable Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; The function is chosen before the population. Although the proof can ignore some hypotheses, they remain in the theorem statement; unused hypotheses do not themselves export a stronger theorem.
  • Proved AronowAudit.P005.Wave1.noninteracted_exact_decomposition_proof Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; The registry shares the Theorem 3.1 exact decomposition with T14; the exported bias identity supplies T14(d). The sole public description also mentions the constant-effect and balance conclusions, both of which are exported.
  • Proved AronowAudit.P005.mean_dot Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Not invoked separately: its relevant content is already incorporated in the selected primary proof; no additional conclusion is asserted from this auxiliary.
  • Proved AronowAudit.P005.mean_congr Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Not invoked separately: its relevant content is already incorporated in the selected primary proof; no additional conclusion is asserted from this auxiliary.

Proof of Theorem 3.2 (Appendix B.2), the second sentence “Collecting the constants in front of …” on p. 1516, as repaired: the control-arm covariance hy(0)‾C−hˉCy(0)‾C\overline{hy(0)}_C - \bar h_C\overline{y(0)}_C (P005-E009)

p. 1516 (PDF p. 15), Appendix B.2, top of the page; equations (11) and (12) are on p. 1515 (PDF p. 14)

Appendix B.2, p. 1516 (PDF p. 15), using (11)–(12) on p. 1515. The corrected control covariance and the treatment covariance have coefficients 1/(n-2) and -1/(n-2), including the printed intermediate fraction and their combined expression.

Historical component credits
  • Proved AronowAudit.P005.collected_covariance_coefficients Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; The stronger algebraic statement covers the target by substitution; it does not independently assert that equations (11) and (12) are unbiased, which is not this row's component.

Proof of Lemma A.2, as repaired: E[DiDj]\mathbf{E}[D_iD_j] in the first display (p. 1511) and upper limit nn in the last display (p. 1512) (P005-E005)

p. 1511 (PDF p. 10), proof of Lemma A.2, first display; p. 1512 (PDF p. 11), last display of the proof

proof of Lemma A.2, pp. 1511–1512 (PDF pp. 10–11). The corrected finite indicator calculations, coefficient simplification, and complement relation give both the treated third moment and the mixed treated-control third moment.

Historical component credits
  • Proved AronowAudit.P005.Wave1.corrected_third_moment_calculation_proof Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; This is the corrected calculation, not a proof of the malformed printed displays. The standalone coefficient equality is a separately credited statement in R040-08; the current statement exports both the raw and simplified moment formulas, without cancelling a possibly zero sum of triple products.
  • Proved AronowAudit.P005.third_moment_coefficient Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; This is algebraic coefficient simplification, so the larger m domain is meaningful without pretending there is a randomization law for m>n.
  • Proved AronowAudit.P005.inclusion_count Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Supporting sampling or linearity fact already incorporated in the aggregate third-moment row; not separately invoked.
  • Proved AronowAudit.P005.indicator_expectation Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Supporting sampling or linearity fact already incorporated in the aggregate third-moment row; not separately invoked.
  • Proved AronowAudit.P005.expectation_sum Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Supporting sampling or linearity fact already incorporated in the aggregate third-moment row; not separately invoked.
  • Proved AronowAudit.P005.expectation_mul Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Supporting sampling or linearity fact already incorporated in the aggregate third-moment row; not separately invoked.
  • Proved AronowAudit.P005.expectation_congr Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Supporting sampling or linearity fact already incorporated in the aggregate third-moment row; not separately invoked.
  • Proved AronowAudit.P005.indicator_sum Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Supporting sampling or linearity fact already incorporated in the aggregate third-moment row; not separately invoked.

Appendix B.1.1, the bound on Var[(∗)]\mathrm{Var}[(*)] on p. 1514, third line, as repaired: matching summation index (P005-E007)

p. 1514 (PDF p. 13), Appendix B.1.1, the display bounding Var[(∗)]\mathrm{Var}[(*)] and the sentence after it

Appendix B.1.1, p. 1514 (PDF p. 13), corrected matching summation index. The variance of the actual common-residual term (*) is bounded by the centered double sum, then by the raw contraction. The exact Gram contraction and leverage bound give deterministic order O(kappa/n), with bounded residual-difference second moments, and (*) is O_p(sqrt(kappa*d/n)), including dimension zero.

Historical component credits
  • Proved AronowAudit.P005.corrected_contraction_chain Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; The row exports the deterministic part of the chain only. R040-12 separately gives the unscaled contraction identity (b), and R040-09 supplies the rate (e); no variance inequality is inferred merely from this deterministic statement.
  • Proved AronowAudit.P005.Wave1.corrected_contraction_order Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; No positive lower bound on d_n, inverse regularity, or assumed order bound is hidden in the hypotheses. The target concerns the corrected deterministic part (e); the printed variance bound preceding it is contextual.
  • Proved AronowAudit.P005.covariate_contraction Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Removing the n>=2 restriction is a harmless generalization; the leverage and the squared residual coefficient carry the same summation index.
  • Proved AronowAudit.P005.dot_population_slope Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; The contraction-chain row already includes the needed dot/average contraction; this helper is not separately invoked.
  • Proved AronowAudit.P005.common_residual_difference_second_moment Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; The same fitted slope appears in both residuals and cancels, leaving a centered outcome difference; the 4K bound is not a field or hypothesis in disguise.

Appendix B.1.1, the three-line equality for the term (∗)(*) at the top of p. 1514, as repaired: the unmatched closing parenthesis of the second line deleted (the part of P005-N005 that is established)

p. 1514 (PDF p. 13), Appendix B.1.1, first display and the sentence after it

Appendix B.1.1, top of p. 1514 (PDF p. 13), corrected brackets. The weighted normal equation gives all three bracketed vectors and identifies their first expression with the actual common-residual term (*).

Historical component credits
  • Proved AronowAudit.P005.corrected_residual_brackets Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Covers T18(a)-(b). The normal equation is the explicit premise of the generic residual-vector claim, and R041-04 derives it for the actual paper residuals; it is not an unproved extra premise for the combined target.
  • Proved AronowAudit.P005.corrected_residual_term_identification Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Covers T18(c). Under the stated normalization the paper minimizer has alpha*=bar yC, tau*=ATE, beta*=N, so commonResidual is the actual residual, not an arbitrary substitute.
  • Proved AronowAudit.P005.popMean_sum Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Supporting residual algebra already incorporated in the two selected aggregate rows; not separately invoked.
  • Proved AronowAudit.P005.populationSlope_centered Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Supporting residual algebra already incorporated in the two selected aggregate rows; not separately invoked.
  • Proved AronowAudit.P005.populationSlope_projection Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Supporting residual algebra already incorporated in the two selected aggregate rows; not separately invoked.
  • Proved AronowAudit.P005.populationSlope_common_residual Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Supporting residual algebra already incorporated in the two selected aggregate rows; not separately invoked.
  • Proved AronowAudit.P005.common_residual_normal_equation Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Supporting residual algebra already incorporated in the two selected aggregate rows; not separately invoked.
  • Proved AronowAudit.P005.complement_x_mean_identity Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Supporting residual algebra already incorporated in the two selected aggregate rows; not separately invoked.
  • Proved AronowAudit.P005.observed_residual_slope Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Supporting residual algebra already incorporated in the two selected aggregate rows; not separately invoked.

Lemma A.1, as printed

p. 1511 (PDF p. 10), Appendix A.2; definitions on p. 1510 (PDF p. 9)

The printed claim is false: the universal conjunction of the printed expectation identity and the uncentered covariance variance bound fails under complete randomization. Lemma A.1, pp. 1510–1511 (PDF pp. 9–10).

Historical component credits

Theorem 4.1, as printed

pp. 1509–1510 (PDF pp. 8–9), Section 4; proof B.3 on p. 1517 (PDF p. 16)

The printed claim is false: both the universal third-component sign identity and the stochastic expansion under the literal logarithm condition fail; the stated exact slope decompositions, bias expression, and first-component moments hold. Theorem 4.1, pp. 1509–1510 (PDF pp. 8–9).

Historical component credits
  • Proved AronowAudit.P005.Wave1.interacted_exact_decomposition_completion Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Only the valid exact finite-sample portion of T20 is certified here. The n>=2 formulation and the admitted d=0 case exclude no required instance; the nonvacuity example has positive dimension.
  • Counterexample proved AronowAudit.P005.ConfidenceFollowup02.printed_interacted_third_bias_refuted Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; The finite sign-identity component is refuted with the printed negative definition of armNu3. Other valid components of T20 receive no refutation credit from this row.
  • Counterexample proved AronowAudit.P005.Wave1.printed_interacted_expansion_refuted Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Metadata inconsistency: claims.json marks T20 asymptotic=false although its statement includes the expansion and this row is explicitly credited to refute it. The record target note calls T20 finite-sample-only and assigns the expansion to T7/T8, conflicting with the packet statement and row attribution. This scope issue does not change the fidelity of the displayed negation. No claim-stage verdict changed.

Theorem 3.2, first part: exact unbiasedness of Bias^\widehat{\mathrm{Bias}} and of ATE^Debiased\widehat{\mathrm{ATE}}_{\mathrm{Debiased}} (noninteracted case)

pp. 1508–1509 (PDF pp. 7–8), Section 3, equations (7)–(8); proof in Appendix B.2, pp. 1515–1516 (PDF pp. 14–15)

Theorem 3.2, pp. 1508–1509 (PDF pp. 7–8); proof in Appendix B.2. The printed noninteracted bias estimator is exactly unbiased for the bias, and its correction is exactly unbiased for the ATE. The closed-form coefficients are the unique OLS minimizer. The inverse-free formula, bias decomposition, inverse-component identity and both population component expectations hold for all nonempty arms. Expressions (11) and (12), their expectations and their collection into (7) require only their presupposed nonzero arm-size denominators.

Historical component credits
  • Proved AronowAudit.P005.Wave1.noninteracted_exact_unbiasedness_proof Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; The target explicitly incorporates n>=3, nonempty arms, fixed-n Assumption 2 and footnote-4 all-assignment invertibility; none is an added restriction. The separate generalized-inverse extension in the footnote is outside the nonsingular component credited to this row.
  • Proved AronowAudit.P005.mean_unbiased Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; The exact-unbiasedness row already incorporates the sample-mean identity; not separately invoked.

Theorem 4.2, first part: exact unbiasedness of Bias^I\widehat{\mathrm{Bias}}_I and of ATE^I,Debiased\widehat{\mathrm{ATE}}_{I,\mathrm{Debiased}} (interacted case)

p. 1510 (PDF p. 9), Section 4; proof in Appendix B.4, p. 1518 (PDF p. 17)

Theorem 4.2, p. 1510 (PDF p. 9). The interacted bias correction and corrected ATE are exactly unbiased, with the inverse-free identity and both armwise expectations, including the stated weaker centered-covariate hypotheses.

Historical component credits
  • Proved AronowAudit.P005.Wave1.interacted_exact_unbiasedness_proof Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Both armwise conclusions are exported, in addition to the two estimator-unbiasedness conclusions, under the target common normalized nonsingular regime. No asymptotic sequel is credited here.
  • Proved AronowAudit.P005.interacted_debiased_cancellation Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; This is the cancellation component alone, not a positive unbiasedness theorem. The extended algebraic domain loses no target cases.

Theorem 3.1, exact part: the decomposition of β^\widehat\beta and the bias components (5) and (6); with the two exact consequences stated in Remark 1

p. 1507 (PDF p. 6), Section 3; proof in Appendix B.1, pp. 1512–1513 (PDF pp. 11–12), and B.2, p. 1515 (PDF p. 14)

Theorem 3.1 and Remark 1, p. 1507 (PDF p. 6). The exact noninteracted slope and bias decompositions give (5), (6), the covariance interpretation, and the two stated vanishing consequences of Remark 1.

Historical component credits

Theorem 4.1, exact part that stands as printed: the decompositions of β^I,T\widehat\beta_{I,T} and β^I,C\widehat\beta_{I,C}, the expression of the bias, and the first bias component

p. 1509 (PDF p. 8), Section 4; proof B.3 on p. 1517 (PDF p. 16) omits the details

Theorem 4.1, p. 1509 (PDF p. 8), its valid exact part. Both interacted slopes decompose as printed, and the bias expression and separate first-component expectations give their stated difference.

Historical component credits
  • Proved AronowAudit.P005.Wave1.interacted_exact_decomposition_proof Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Covers all of T24, which expressly excludes the separately targeted third-component formula and stochastic expansion. The finite target itself supplies normalization and all-assignment invertibility, so these are not added restrictions.
  • Proved AronowAudit.P005.armN_decomposition Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; The selected decomposition row already contains the two arm slope and numerator identities.
  • Proved AronowAudit.P005.arm_slope_decomposition Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; The selected decomposition row already contains the two arm slope and numerator identities.

Theorem 3.1, last part: the stochastic expansion of ATE^\widehat{\mathrm{ATE}} (noninteracted case)

p. 1507 (PDF p. 6), Section 3; proof in Appendix B.1.1, pp. 1513–1515 (PDF pp. 12–14)

last part of Theorem 3.1, p. 1507 (PDF p. 6). The noninteracted regression remainder is O_p(sqrt(kappa*d/n)) when d/n tends to zero. The dimension convention 1 <= d_n <= n agrees with the canonical order-symbol definitions. No conclusion is omitted.

Historical component credits
  • Proved AronowAudit.P005.Wave1.noninteracted_stochastic_expansion_proof Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; The target definitions explicitly require 1<=d_n, so the positive-dimension field is not an added assumption. Uniform K, eventual standardization and eventual regularity have the required all-sequence meaning; finitely many initial sizes do not affect O_p.

Theorem 3.2, second part: the asymptotic linear expansion of ATE^Debiased\widehat{\mathrm{ATE}}_{\mathrm{Debiased}}

p. 1509 (PDF p. 8), Section 3 (the theorem begins on p. 1508, PDF p. 7); proof in Appendix B.2, pp. 1516–1517 (PDF pp. 15–16)

Theorem 3.2, p. 1509 (PDF p. 8); Appendix B.2, pp. 1516–1517. The debiased noninteracted remainder equals the p. 1516 term (*) exactly and is O_p(sqrt(kappa/n)) under Assumptions 1–3, without leverage decay. If kappa tends to zero, this gives the printed common-slope expansion with o_p(n^(-1/2)) error.

Historical component credits
  • Proved AronowAudit.P005.Wave1.noninteracted_debiased_linear_expansion_proof Limited support; baseline fidelity: narrower; manifest: used; used in Solution; {'source': 'adjudication+second review', 'adjudicator': 'At P005/Wave1/DebiasedLinearTailC.lean:130, the declaration assumes hκ (κ_n → 0) and concludes only that R_n = debiasedATE − ate − commonLeading is o_p(n^−1/2). The final sentence of the supplied P005-T26 claim additionally asserts R_n = O_p(√(κ_n/n)) without that assumption, and identifies R_n exactly with the printed term (*) on p. 1516. Neither the stronger rate without hκ nor the exact identity is included in this declaration’s conclusion. The printed Theorem 3.2 little-o formula is matched, but the supplied target and the row’s full-coverage description assert more.', 'suggested_fix': 'Extend the statement to export stochasticO m R (fun n => Real.sqrt (kappa (P n) / n)) under standingAssumptions and eventual noninteractedRegular without hκ, with the existing stochasticLittleO conclusion conditional on hκ. Also export the fixed-n identity R = −dot (xMean P S − xMean P (control S)) (Nhat P m S − N P m) + (sampleCov S (leverage P) P.yT − sampleCov (control S) (leverage P) P.yC) / (n−2) for n ≥ 3, standardized P, valid arm sizes, S in design n m and nonzero determinant of Lhat.', 'second_review': "P005/Wave1/DebiasedLinearTailC.lean:130 assumes κ_n → 0 and exports only stochasticLittleO at scale sqrt(1/n), with the residual and randomization interpretation matching the printed expansion through P005/P005_Formalization.lean:310 and P005/P005_Formalization.lean:325. P005-T26's claim text additionally asserts O_p(sqrt(κ_n/n)) without κ_n → 0 and an exact identification with (*); neither conclusion is exported. The little-o conclusion cannot recover that finer rate or cover nonvanishing-leverage sequences, so this is a major statement omission, even though the printed Theorem 3.2 formula itself is represented correctly.", 'severity': 'major'}

Theorem 4.2, second part: the asymptotic linear expansion of ATE^I,Debiased\widehat{\mathrm{ATE}}_{I,\mathrm{Debiased}}

p. 1510 (PDF p. 9), Section 4; proof in Appendix B.4, pp. 1518–1519 (PDF pp. 17–18)

Theorem 4.2, p. 1510 (PDF p. 9); Appendix B.4, pp. 1518–1519. The debiased interacted remainder is O_p(sqrt(kappa/n)) under Assumptions 1–3, without leverage decay. If kappa tends to zero, the printed arm-specific linear expansion has o_p(n^(-1/2)) error.

Historical component credits
  • Proved AronowAudit.P005.Wave1.interacted_debiased_linear_expansion_proof Limited support; baseline fidelity: narrower; manifest: used; used in Solution; {'source': 'adjudication+second review', 'adjudicator': 'At P005/Wave1/DebiasedLinearTailC.lean:195, the declaration assumes hκ (κ_n → 0) and concludes only that R_n = interactedDebiasedATE − ate − armLeading is o_p(n^−1/2). The final sentence of the supplied P005-T27 claim also asserts R_n = O_p(√(κ_n/n)) without assuming κ_n → 0. That stronger rate and its wider sequence domain are absent from the declaration, although the printed Theorem 4.2 little-o formula is represented correctly.', 'suggested_fix': 'Extend the statement to export stochasticO m R (fun n => Real.sqrt (kappa (P n) / n)) under standingAssumptions and eventual interactedRegular without hκ, retaining the existing stochasticLittleO conclusion as conditional on hκ.', 'second_review': "P005/Wave1/DebiasedLinearTailC.lean:195 assumes κ_n → 0 and concludes only stochasticLittleO for interactedDebiasedATE − ate − armLeading at scale sqrt(1/n); armLeading uses the target's two population arm slopes (P005/P005_Formalization.lean:302 and P005/P005_Formalization.lean:313). P005-T27's claim text also requires O_p(sqrt(κ_n/n)) without the decay assumption. That finer rate on the wider sequence domain does not follow from the exported little-o statement, so the target needs a substantive additional statement rather than a description edit.", 'severity': 'major'}

Reproduction

What I recalculated or reran from public materials. "Agrees", "Agrees in part" or "Disagrees" compares my result with the printed one. "Not compared" means the comparison could not be made.

Status
Not applicable
Agreement
Not applicable