LLM-generated corrections to the published research of P. M. Aronow

Journal article P023

Corrections to: A Note on Close Elections and Regression Analysis of the Party Incumbency Advantage

P. M. Aronow, David R. Mayhew, and Winston Lin (2014). A Note on Close Elections and Regression Analysis of the Party Incumbency Advantage. Statistics, Politics and Policy 5(1–2):1–11.

DOI
10.1515/spp-2014-0003
Audited edition
Statistics, Politics and Policy, 2014, 5(1–2):1–11; 11 pages in the audited file
SHA-256 of the audited file
db981a5db66ec05548e34d7492d9c02684b23e9fe42168ba23743cefbd90b8dc
Permanent address
https://pmaronow.github.io/llm-audit/works/P023/

Summary

The note asks whether regressions on all elections escape the limitations of close-election studies of the party incumbency advantage. It shows that OLS with the specified vote-share bins as controls equals a regression discontinuity estimate, argues that polynomial controls approximate it, and compares eight estimates for US House elections. 8 entries are classified as errors (4 Moderate, 4 Minor), and 2 are clarity notes; 2 further concerns were not confirmed. With the specified bins, only close-election outcomes determine the coefficient. Under exact polynomial specification and the conditions for consistency of both estimators, polynomial OLS and shrinking-bandwidth RD estimate the same cutoff jump and their difference converges to zero in probability, although distant outcomes enter OLS. Shared concerns about causal identification and extrapolation can survive (P023-E001).

What was and was not checked

I checked the following points, which held up with the qualifications stated.

  • Proposition 1 and Appendix A. With sums indexed by election pairs and restricted to nonempty bins, the proof’s localization argument holds: the demeaned win indicator vanishes in every bin except the central one, and the slope on a binary regressor within UbU_b is the difference in means.
  • Condition 2. The number J=2⌈(1−k)/(2k)⌉J=2\lceil(1-k)/(2k)\rceil is the smallest even integer with (J+1)k≥1(J+1)k\ge1, the bins j=0,…,Jj=0,\ldots,J, with the reference bin closed on the left as in Appendix A, cover [−1,1][-1,1] for every kk in (0,1)(0,1), and the central bin is (−k,k]=Ub(-k,k]=U_b. This was checked in exact arithmetic for k=1/1000,…,999/1000k=1/1000,\ldots,999/1000.
  • Proposition 1 on constructed data, with observations at the edges of the window and with empty bins: the OLS coefficient with the bin indicators equals the difference in means on UbU_b, and it does not move when outcomes outside UbU_b are changed.
  • Table 1 as printed. Rows (d) and (e) both read 10.54, as Proposition 1 requires; the bandwidths in the text of Section 4 agree with the note to the table; and the descriptions of estimators (a)–(h) agree with the row labels.
  • The Remark to Condition 3 and footnote 5: a local regression of degree 0 with a rectangular kernel is the difference in means within the window, and with the coarsening of Condition 2 only the central bin contains both winners and losers.
  • Appendix B. The conditional mean equals α+βI[DemVot≥0]+h(DemVot)\alpha+\beta I[\mathit{DemVot}\ge0]+h(\mathit{DemVot}) with the printed hh, and hh is continuous with h(0)=0h(0)=0 given the finite left limit of gg that the definition of α\alpha presupposes. The Weierstrass step with no constant term is valid because h(0)=0h(0)=0.
  • Proposition 2 when hh is exactly a polynomial of degree at most a fixed JJ and the population design is nonsingular: the population coefficient is the jump β\beta. Under the sampling, support and moment conditions for consistency of both estimators, with kN→0k_N\to0 and NkN→∞Nk_N\to\infty, polynomial OLS and shrinking-bandwidth RD converge to this jump, so their difference converges to zero in probability. This does not settle the separate approximation issue in P023-E002.
  • Appendix B does not attach a causal interpretation to the jump β\beta, and the target of the close-election estimate is this jump of the conditional mean under the usual RD conditions.
  • Section 2. Treatment is determined by the sign of the margin, so winners and losers do not overlap away from the threshold, which supports the caution about extrapolation.
  • Every citation in the text has an entry in the reference list and every entry is cited. Apart from the spelling in P023-E008, no mismatch of references or equation numbers was found.
  • The codebook of the replication data of Caughey and Sekhon (2011) supplies a margin, a win indicator and the Democratic percentage in the next election. Its margin is Democratic minus leading non-Democratic vote share; it agrees with the theoretical Democratic-minus-Republican definition under the two-party supposition. Section 4 does not identify the columns actually used.

I independently recalculated the estimates from the corrected release of 10 April 2014, using DifDPct, DemWin and DPctNxt for 1942–2008. These calculations give 10.5429 points for both rows (d) and (e) and 13.1478 for row (g). On 8,610 complete elections, row (b) rounds to its printed value; adding the source study’s Use=1 restriction gives 8,594 elections and reproduces rows (a) and (c) to rounding. Neither sample reproduces every row. With the printed bandwidths, separate fits on each side and triangular weights max⁡(1−∣DifDPct∣/k,0)\max(1-|\texttt{DifDPct}|/k,0) in percentage-point units, rows (f) and (h) give 13.08 and 15.30 points, rather than 10.57 and 12.38 (P023-E003). These comparisons are conditional on this release, variable mapping and sample rules. Four next-election outcomes are one hundredth of their linked percentages at storage precision; replacing them by those percentages changes rows (d) and (e) to 9.32 points and row (g) to 10.40 as a sensitivity calculation. The correctness of the links and percentages and their historical use remain unverified (P023-E004). A recount for 1944–2006 finds 103 recorded close elections among 13,923, a fraction of 0.7% rounded and a lower bound on the full close-election share; 587 Democratic margins are missing (P023-E005). For the linear and degree-7 regressions on the 8,610 elections, 1.75% and 3.97% of absolute outcome weight lies within 0.5 points of the cutoff, respectively; the Use=1 subset gives 1.75% and 3.98%. Every outside election has nonzero weight in both specifications under both sample rules (P023-E001).

The following remain unestablished. The observed fits do not establish whether the linear and degree-7 controls adequately approximate the population conditional mean in the application. The cited works were not compared with what the paper attributes to them (Wooldridge 2002, p. 579; Caughey and Sekhon 2011, Section 5.2; Gelman and King 1990, Eq. 6). The suggestion in Section 5 that the findings carry over to the estimator of Gelman and King (1990) rests on no result in the paper. The authors' analysis code for Section 4 was not found, and the paper does not name the release of the data that it used. The available copy of the codebook is dated 22 December 2025.

The comparison in P023-E001 keeps the threshold-jump target distinct from the observations used to estimate it. Appendix B already supplies the common-target argument; nonzero distant weights establish outcome dependence, not the frequency of substantive estimator gaps or different causal bias or external validity in the application. Shared concerns about identifying assumptions and extrapolation can survive, and no causal interpretation away from the cutoff follows from that comparison.

Headline claims and related corrections

  1. An OLS regression on all elections that controls for vote share through indicator variables for bins of width 2k2k, one of them centred on the threshold, returns exactly the RD estimate defined as the difference in means within bandwidth kk (degree-0 local regression with a rectangular kernel), whether or not the outcome model is correct.

    Proposition 1; Appendix A; Table 1 rows (d) and (e); abstract ('exactly reproduces'); Section 3.1, pp. 5–6

    See P023-E006, P023-N001, P023-N004.

  2. An OLS regression on all elections with a polynomial in vote share approximates the RD estimate in large samples, provided the polynomial degree is large enough to capture the conditional expectation function; sufficient richness is described as no meaningful remaining improvement in model fit.

    Proposition 2 and its Remark (Section 3.2, pp. 6–7); Appendix B; Table 1 rows (b), (c) and (e)–(h); abstract ('or approximates')

    See P023-E002.

  3. All flexibly specified OLS studies of the party incumbency advantage are mathematically equivalent to studies of close elections; with a covariate control for vote share the resulting estimates rely solely on data from close elections.

    Propositions 1 and 2 taken together; Section 1, p. 3; end of Section 3.2, p. 7; first sentence of Section 5, p. 8

    See P023-E001.

  4. The paper argues that these equivalences make concerns about close elections, including sorting at the threshold and limited external validity, equally applicable to regression analyses of all elections that control for vote share. It describes a focus on close elections as, in a sense, unavoidable for causal inference about the party incumbency advantage.

    Propositions 1 and 2; Table 1; abstract; Section 1, pp. 1–3; Section 5, p. 8

    See P023-E001, P023-E002.

  5. In the Caughey–Sekhon data for US House elections, 1942–2008, every estimator except the naive one (34.4034.40 percentage points) gives a substantively similar party incumbency effect on next-election Democratic vote share (9.979.97 to 13.1513.15 percentage points), and coarsened-control OLS equals degree-0 rectangular-kernel RD (10.5410.54 percentage points).

    Table 1; Section 4, pp. 7–8

    See P023-E003, P023-E004, P023-N002.

  6. Close House elections are rare: 0.6%0.6\% of elections between 1944 and 2006 were decided by less than 0.50.5 percentage points.

    Section 1, p. 1; no table or figure (a count from the Caughey–Sekhon data)

    See P023-E005, P023-N002.

  7. The findings may carry over, as a first approximation, to related estimands such as the Gelman–King estimator of the personal incumbency advantage.

    Section 5, pp. 8–9; no result in the paper; rests on Caughey and Sekhon (2011, §5.2)

  8. Without stronger modelling assumptions, vote-share adjustment offers little basis for estimating the party incumbency effect away from close elections, because winning and losing parties do not overlap on vote margin there.

    Section 2, pp. 3–4; Section 5, pp. 8–9; the deterministic treatment setup underlying Conditions 1–3 and Propositions 1–2

    See P023-E001.

Corrections

Moderate (4)

A real substantive error with limited reach.

Full-sample OLS with the coarsened control of Proposition 1 relies solely on outcomes from close elections; a polynomial regression can estimate the same jump at the threshold while also using distant outcomes.

Section 1, p. 3 (PDF p. 3), paragraph continued from p. 2; repeated in the last paragraph of Section 3.2, p. 7, and in the second sentence of Section 5, p. 8

Classification before my review (the classification when the audit was first completed, before I reviewed it): Error, Major (entry P023-E001).

See also under Formal statements (Lean): P023-T1, P023-T2, P023-T3, P023-T10

I disputed this classification, but as a rule, deferred to the models’ final judgment: see my comment and the history of this entry.

As printed

[p. 3] “In fact, we demonstrate that all flexibly specified empirical studies of the party incumbency advantage using ordinary least squares (OLS) regression are mathematically equivalent to studies of close elections. The mechanics of linear regression with a covariate control for vote share are such that the resulting estimates rely solely on data from close elections. It follows that any concerns about the study of close elections are equally applicable to regression analyses including the entire dataset of all elections.”

[p. 7] “Since the RD estimator only uses information from close elections to estimate causal effects, it is also generally the case that the OLS estimator, when well-specified, will also only use information from close elections to estimate causal effects.”

[p. 8] “We have demonstrated that OLS estimation of the party incumbency advantage may produce estimates that rely solely on data from close elections. The limitations of studying close elections to estimate causal effects – both in terms of bias and of external validity – are therefore equally applicable to regression analyses that include the entire dataset.”

The problem

The paper distinguishes two results. Proposition 1 concerns the regression whose controls are indicators for bins of width 2k2k of the margin DemVotit\mathit{DemVot}_{it}, the “coarsened control” of Table 1; I call it the coarsened regression. Its OLS coefficient equals the difference in means within the window (−k,k](-k,k], and every outcome outside the window has weight zero in it. Proposition 2 concerns regressions with a polynomial in the margin, such as the linear and degree-7 controls of Table 1. Appendix B compares the polynomial and shrinking-window RD estimates through the cutoff jump β=f(0)−lim⁡x↑0g(x)\beta=f(0)-\lim_{x\uparrow0}g(x), rather than through their observation weights.

Read as a whole, the paper separates exact coarsened equivalence from approximate polynomial equivalence in large samples. The phrase “mathematically equivalent” on p. 3 should be read in that context. Nevertheless, the explanation in terms of the mechanics of regression, followed by “rely solely on data” on p. 3 and “only use information” on p. 7, naturally asserts exclusive dependence on close-election outcomes. That assertion is false for the permitted finite polynomial controls. Its failure does not demonstrate failure of either equivalence result. The identified coefficient of a polynomial regression of degree JJ is a weighted sum ∑iwi DVi\sum_i w_i\,\mathit{DV}_i over all elections. The weight wiw_i is proportional to the residual of DemWin\mathit{DemWin} on the polynomial terms, and this residual is nonzero at all but at most 2J2J distinct margins. Raising the outcome of a distant election with nonzero weight then changes the estimate, even when the polynomial model is exactly correct, while the RD estimate and the coefficient of the coarsened regression do not move.

Two estimators with the same limit need not have the same weights, the same sampling variance or the same bias at a fixed bandwidth. Under shared consistency their difference nevertheless converges to zero in probability; nonzero distant weights do not refute that approximation. For the coarsened regression, equality of the estimators transfers the properties of the specified RD estimate directly. For polynomial controls, Appendix B already supplies the common-target argument, and Section 2 describes assumptions needed for its causal interpretation. Different outcome weights do not remove concerns that arise from that common target and those assumptions. They establish neither different causal bias nor broader external validity in the application.

Evidence an exact counterexample

The evidence is a derivation, two exact counterexamples and a recalculation of the weights on the available House replication data. Let rr be the residual of the vector DemWin\mathit{DemWin} after least-squares projection on the constant and the powers DemVot,…,DemVotJ\mathit{DemVot},\ldots,\mathit{DemVot}^J. For an identified coefficient in equation (2), I obtain from the normal equations

β^OLS2=∑iwi DVi(t+1),wi=ri∑jrj2,\hat\beta_{OLS2}=\sum_i w_i\,\mathit{DV}_{i(t+1)},\qquad w_i=\frac{r_i}{\sum_j r_j^2},

which implies that raising one outcome by δ\delta changes the estimate by wiδw_i\delta.

For the linear control (J=1J=1), take six elections with margins −3/4-3/4, −1/4-1/4, −1/400-1/400, 1/4001/400, 1/41/4, 3/43/4 and outcomes DV=1/2+DemWin/10+DemVot/20\mathit{DV}=1/2+\mathit{DemWin}/10+\mathit{DemVot}/20. Equation (2) then holds exactly with β=1/10\beta=1/10. In the order of the margins, the weights are

w=1139202 (20299, −59901, −99600, 99600, 59901, −20299).w=\frac{1}{139202}\,(20299,\,-59901,\,-99600,\,99600,\,59901,\,-20299).

With k=1/200k=1/200, only the elections at ±1/400\pm1/400 lie in the window. For the degree-7 control, take sixteen elections with margins ±1/8,±2/8,…,±1\pm1/8,\pm2/8,\ldots,\pm1 and outcomes 1/2+DemWin/10+DemVot/20+DemVot7/1001/2+\mathit{DemWin}/10+\mathit{DemVot}/20+\mathit{DemVot}^7/100. Equation (2) with J=7J=7 holds exactly, again with β=1/10\beta=1/10, and the sixteen weights, in increasing order of margin, are

w=11607 (−175, 725, −685, −643, 554, 1289, 239, −2911,2911, −239, −1289, −554, 643, 685, −725, 175),\begin{aligned} w=\frac{1}{1607}\,(&{-}175,\,725,\,-685,\,-643,\,554,\,1289,\,239,\,-2911,\\ &2911,\,-239,\,-1289,\,-554,\,643,\,685,\,-725,\,175), \end{aligned}

none of them zero. With k=1/5k=1/5, only the elections at ±1/8\pm1/8 lie in the window. The table shows what happens when the outcome of the election with the largest margin (3/43/4 in the first example, 11 in the second) is raised by 1/1001/100.

Estimates before and after one distant outcome is raised by 1/1001/100.
EstimateBeforeAfterChange
Polynomial regression, J=1J=11/101/101371721/139202001371721/13920200−20299/13920200-20299/13920200
RD, coarsened regression, k=1/200k=1/200401/4000401/4000401/4000401/400000
Polynomial regression, J=7J=71/101/103249/321403249/321407/64287/6428
RD, coarsened regression, k=1/5k=1/511796481/10485760011796481/10485760011796481/10485760011796481/10485760000

In each example the two outcome vectors are realizations of one correctly specified model. Take errors independent of one another and of the margins, with probabilities 1/41/4, 1/21/2 and 1/41/4 at −1/100-1/100, 00 and 1/1001/100. Conditional on the stated margins, the baseline and perturbed error vectors have probabilities 1/641/64 and 1/1281/128 in the six-election example, and 1/655361/65536 and 1/1310721/131072 in the sixteen-election example. These probabilities establish that the outcomes are possible under the same conditional-mean model; they do not measure the probability of an OLS–RD discrepancy exceeding a fixed positive amount. The finite designs themselves do not test a shrinking-bandwidth asymptotic claim.

The targets do agree. For margins uniform on [−1,1][-1,1] and the same two conditional means, the population coefficient of equation (2) is 1/101/10, and the difference in means within bandwidth kk is 1/10+k/201/10+k/20 for J=1J=1 and 1/10+k/20+k7/4001/10+k/20+k^7/400 for J=7J=7, which tends to 1/101/10 as k→0k\to0. With independent observations, the bounded mean-zero errors just specified and, for example, kN=N−1/3k_N=N^{-1/3}, both estimators are consistent for 1/101/10. The finite grids are used for conditional sensitivity calculations; no positive probability of drawing those exact grids from a continuous distribution is asserted.

More generally, whenever both estimators converge in probability to the same β\beta, for each fixed ϵ>0\epsilon>0 the triangle inequality gives

P(∣β^OLS2−τ^RD∣>ϵ)≤P(∣β^OLS2−β∣>ϵ/2)+P(∣τ^RD−β∣>ϵ/2)⟶0.\begin{aligned} P\bigl(|\hat\beta_{OLS2}-\hat\tau_{RD}|>\epsilon\bigr) &\le P\bigl(|\hat\beta_{OLS2}-\beta|>\epsilon/2\bigr)\\ &\quad+P\bigl(|\hat\tau_{RD}-\beta|>\epsilon/2\bigr)\longrightarrow0. \end{aligned}

This requires no independence between the estimators. It does not assert equality at finite sample sizes, a probability for a particular sample size, or equivalence after division by a shrinking standard error.

Their variance contributions can still differ. With homoskedastic errors, elections whose margins have absolute value at least 1/21/2 contribute 1/81/8 of the leading error variance of the coefficient of equation (2) for J=1J=1 and 572158921/10276044800572158921/10276044800 (about 5.6%) for J=7J=7. The leading contribution from the errors to the variance is 16σ2/N16\sigma^2/N for J=1J=1 and (65536/1225)σ2/N(65536/1225)\sigma^2/N for J=7J=7, against 800σ2/N800\sigma^2/N for the difference in means with k=1/200k=1/200. The polynomial contributions vanish at order 1/N1/N, so their positive distant shares do not imply a persistent discrepancy between the estimates.

On the available House replication data, the two polynomial specifications of Table 1 also put most of their weight on distant elections. In the 2014 release of the replication data of Caughey and Sekhon (2011), 8,610 elections from 1942–2008 have the outcome (DPctNxt), the margin (DifDPct) and the winner (DemWin) recorded, and a recalculation in exact arithmetic gives the weights wiw_i for the specifications of rows (b) and (c) on these elections. The available codebook defines this margin as the leading Democrat’s percentage minus the leading non-Democrat’s, rather than a two-party renormalization. The 85 elections within 0.5 points of the threshold form the window of rows (d) and (e). They carry 1.7% of ∑i∣wi∣\sum_i|w_i| for the linear control and 4.0% for the degree-7 control. Each of the other 8,525 elections has a nonzero weight in both regressions, and the elections decided by more than 10 points carry 70% and 47% of ∑i∣wi∣\sum_i|w_i|. In the coarsened specification of row (d), the 85 elections carry all of the weight. The three coefficients are nonetheless close: 11.15, 9.95 and 10.54 points. With the sample restricted to the 8,594 elections flagged Use=1 for Caughey and Sekhon’s (2011) RD analysis, the two shares are 1.8% and 4.0%. These are shares of absolute outcome weights, not probabilities of an OLS–RD discrepancy or causal population weights. These calculations do not establish the authors' exact sample or code, the population fit of either polynomial, or a difference in causal bias or external validity.

What survives

Proposition 1 and Section 5’s statement that OLS “may” rely solely on close-election outcomes are unaffected. When the conditional mean has exactly the form of equation (2), its coefficient and a consistent shrinking-bandwidth RD estimator estimate the same jump; under shared consistency their difference converges to zero in probability. The paper’s distinction between exact and approximate equivalence and Appendix B’s common-target argument are compatible with the weight calculations. Those calculations do not adjudicate the general conditions for polynomial approximation; see also P023-E002.

This clarification does not change any entry of Table 1 (for the entries, see P023-E003 and P023-E004), and the advice to examine regression assumptions stands. The exclusive-data explanation requires qualification for polynomial controls. Concerns about causal identification and external validity can remain shared when they arise from the common cutoff target and the same identifying assumptions; the weight calculation establishes neither different causal bias nor broader causal scope in the application.

Corrected

The sentences on p. 3 should read: “In fact, under Conditions 1–3 of Proposition 1, the OLS estimate from all elections equals the degree-0, rectangular-kernel RD estimate and relies solely on outcomes from close elections. When equation (2) exactly specifies the conditional mean, under conditions giving shared consistency, the polynomial OLS and shrinking-bandwidth RD estimates converge to the same cutoff jump and their difference converges to zero in probability. Outcomes of elections outside the close-election window can also enter the polynomial OLS estimate.”

The sentence on p. 7 should read: “The OLS estimator with the coarsened control of Proposition 1 uses outcomes from close elections only. An exactly specified polynomial regression can also use distant outcomes. Under shared consistency, its difference from a shrinking-bandwidth RD estimate converges to zero in probability; this does not imply equal observation weights, sampling variance or finite-sample bias.”

The second sentence of Section 5, p. 8, should read: “The limitations of studying close elections apply in full to the coarsened regression. For a polynomial regression, concerns about causal interpretation and scope can be shared when they arise from the common cutoff target and the same identifying assumptions; equal targets alone do not imply equal bias.”

Screenshot of seven lines of the paragraph continued from page 2 onto page 3. Red boxes mark the phrases: are mathematically equivalent to studies of close elections; rely solely on data from close elections.
Section 1, p. 3 (PDF p. 3), paragraph continued from p. 2. The two marked phrases say that all flexibly specified OLS studies are mathematically equivalent to studies of close elections, and that the estimates rely solely on data from close elections. Only the exclusive-outcome-use assertion is rejected here; the equivalence results are not refuted.
Screenshot of four lines at the end of Section 3.2. A red box marks the phrase: will also only use information from close elections.
Section 3.2, p. 7 (PDF p. 7), last paragraph. The marked phrase draws the same conclusion for any well-specified OLS estimator.
Screenshot of the first six lines of Section 5. A red box marks the words: therefore equally applicable.
Section 5, p. 8 (PDF p. 8), first two sentences. The first sentence says only that OLS may rely solely on close elections, which is correct; the second broadly transfers concerns about bias and external validity to full-sample regressions. Shared-cutoff concerns can survive clarification of the claim about exclusive outcome use.
Two panels of vertical stems, one pair per election, ordered by vote margin. Blue circles (polynomial regression) sit away from zero at every election, including the most distant ones; in the left panel they range from about minus 0.72 to 0.72 and in the right panel from about minus 1.8 to 1.8. Orange squares (RD estimate and coarsened regression) are at minus 1 and plus 1 for the two elections in the shaded close-election window and exactly at zero for every other election.
Weights of the outcomes in the two exact examples. Left: linear control, six elections, window (−1/200,1/200](-1/200,1/200]. Right: degree-7 control, sixteen elections, window (−1/5,1/5](-1/5,1/5]. Circles are the weights in the coefficient of the polynomial regression, equation (2), which are nonzero at every election. Squares are the weights in the RD estimate, which equals the coefficient of the coarsened regression of Proposition 1; they are ±1\pm1 at the two elections inside the window (shaded) and zero elsewhere.
Line chart with a logarithmic horizontal axis, the absolute vote margin m from 0.02 to 100 percentage points, and a vertical axis, the share of the absolute weight on elections with margin at most m, from 0 to 100 per cent. A solid blue line (linear control) and a dashed orange line (degree-7 control) stay below 5 per cent up to m equal to 0.5, where circles mark 1.7 and 4.0 per cent. They rise to about 30 and 53 per cent at 10 points and to about 83 and 87 per cent at 50 points, and step up to 100 per cent at 100 points. A green dash-dotted line at 100 per cent, starting from a square at m equal to 0.5, is the coarsened regression. A dotted vertical line at 0.5 is labelled: window of rows (d) and (e).
The 8,610 complete House-election observations in this calculation, using the 2014 release of Caughey and Sekhon’s (2011) replication data: the share of the absolute weight ∑i∣wi∣\sum_i|w_i| that falls on elections with absolute margin at most mm percentage points. Solid line: linear specification of row (b) of Table 1. Dashed line: degree-7 specification of row (c). At m=0.5m=0.5, the window of rows (d) and (e), the two shares are 1.7% and 4.0% (circles). Dash-dotted line and square: the coarsened specification of row (d), whose weight lies entirely on the 85 elections within 0.5 points. The step at m=100m=100 is the 922 elections with a margin of exactly 100 points.
My comment and the history of this entry

I disagree. I think this is a wording issue. Below is a response from a conversation with an LLM.

The literal claim that finite-degree polynomial OLS uses solely close-election outcomes is false. That fact is a property of the design weights, not a rare outcome realization. With residualized treatment r, the coefficient is r'Y/(r'r); a remote outcome with r_i != 0 enters for every realized outcome vector. The exact House-data certificates were independently rerun during this review and passed for both specifications and both sample conventions.

The handpicked outcome vectors in the original illustration can themselves be rare. They demonstrate data dependence and do not measure the frequency of a substantively large OLS–RD discrepancy. Under the exactly specified model and shared-consistency assumptions used in E001, for every fixed positive tolerance epsilon, P(|OLS - RD| > epsilon) tends to zero. Nonzero remote weights do not contradict that conclusion.

On the full-paper reading, the explicit separation of exact coarsened equivalence from approximate polynomial equivalence, and Appendix B's common-cutoff-target argument, support treating the “solely” sentences as loose wording. E001 does not establish a failure of those equivalence results, a changed application estimate, or different causal bias or external validity. In particular, the finished block's claim that the unqualified transfer of concerns “falls with it” exceeds what its weight calculation proves: concerns arising from the common cutoff target and its identifying assumptions can still be shared.

Recommendation: reclassify E001 as a clarity note with a targeted wording correction. Major is not justified by E001 alone. This reassessment is saved separately; canonical ratings, validation records, and generated publication files have not been changed by this chat.

Suggested wording: “The binned-control OLS estimate equals the close-election RD estimate. An exactly specified polynomial regression estimates the same cutoff jump asymptotically while also using distant outcomes. Concerns arising from that cutoff target and its causal interpretation can apply to both approaches.”

This recommendation is limited to E001. The separate approximation-condition issue in E002 is unaffected.

Suggested classification: clarity note.

My position My comment above; I suggested a clarity note.

The models’ position Under its natural reading, the claim that polynomial regression uses only close-election outcomes is false and can mislead readers about which data the estimate depends on, although the equivalence results, the reported estimates and the shared causal concerns survive: Moderate.

  1. Classification before my review (the classification when the audit was first completed, before I reviewed it): Major error.
  2. I commented and suggested a clarity note.
  3. Independent evaluation. Incorporated in part. The rating was lowered from Major to Moderate, the claim that the concerns shared with close-election studies fall with this point was withdrawn, and the entry was redrafted. My suggested classification (clarity note) was not adopted.

A small error in the polynomial approximation of the conditional mean does not by itself make the coefficient on DemWin\mathit{DemWin} close to the jump β\beta: Proposition 2 holds for a sufficiently large degree under a density condition and a Lipschitz condition, and the test of fit in its Remark does not certify a given degree.

Appendix B, p. 10 (PDF p. 10), the sentence beginning “E[u∣DemVot]≈0E[u\mid \mathit{DemVot}]\approx0 and therefore”; Proposition 2 and its Remark, p. 7 (PDF p. 7)

See also under Formal statements (Lean): P023-T4, P023-T5, P023-T6, P023-T7, P023-T8, P023-T12

As printed

[p. 7] “Proposition 2. Under weak regularity conditions, if N→∞N\to\infty, k→0k\to0, Nk→∞Nk\to\infty, and JJ is “sufficiently large,” the OLS estimator of β\beta in (2), β^OLS2≈τ^RD\hat\beta_{OLS2}\approx\hat\tau_{RD}. Remark. … Put simply, in order for the result to hold, we require that the model fit cannot be meaningfully improved by including additional terms in the polynomial expansion of DemVotit\mathit{DemVot}_{it}.”

[p. 10] “Our assumptions about g()g() and f()f() imply that h()h() is continuous on [−1,1][-1,1] and h(0)=0h(0)=0. By the Weierstrass Approximation Theorem, for any ϵ>0\epsilon>0, there exist some J∗J^* and γ1∗,…,γJ∗∗\gamma_1^*,\ldots,\gamma_{J^*}^* such that ∣h(x)−∑j=1J∗γj∗xj∣<ϵ|h(x)-\sum_{j=1}^{J^*}\gamma_j^*x^j|<\epsilon for all x∈[−1,1]x\in[-1,1]. We assume that JJ in (2) is sufficiently large to ensure that there exist γ1,…,γJ\gamma_1,\ldots,\gamma_J such that ∣h(x)−∑j=1Jγjxj∣≈0|h(x)-\sum_{j=1}^{J}\gamma_jx^j|\approx0 for all x∈[−1,1]x\in[-1,1]. Then

E[DV∣DemVot]≈α+βI[DemVot≥0]+∑j=1JγjDemVotj,E[\mathit{DV}\mid \mathit{DemVot}]\approx\alpha+\beta I[\mathit{DemVot}\ge0]+\sum_{j=1}^{J}\gamma_j\mathit{DemVot}^j,

E[u∣DemVot]≈0E[u\mid \mathit{DemVot}]\approx0 and therefore E[β^OLS2]≈βE[\hat\beta_{OLS2}]\approx\beta. If the sample is drawn i.i.d. from a population UU with Supp⁡(DemVot)⊇[−k,k]\operatorname{Supp}(\mathit{DemVot})\supseteq[-k,k], where k>0k>0, then for large enough NN, we have β^OLS2≈β\hat\beta_{OLS2}\approx\beta.”

The problem

Appendix B writes the conditional mean of the outcome as α+βD+h(X)\alpha+\beta D+h(X), with X=DemVotX=\mathit{DemVot}, D=I[X≥0]D=I[X\ge0] and hh continuous, approximates hh uniformly by a polynomial, and concludes that the coefficient on DD is close to the jump β\beta. The step marked above leaves out a factor. The error of the coefficient is the approximation error weighted by the part of DD that the polynomial terms do not explain, divided by the variance of that part. It is bounded by κJ\kappa_J times the uniform approximation error, where the factor κJ≥2\kappa_J\ge2 depends on the degree and on the distribution of the margin. For uniform margins it grows without bound in JJ. The continuity assumptions on ff and gg do not imply Proposition 2. Indeed, for uniform margins there exists a continuous hh with h(0)=0h(0)=0 such that the coefficient does not converge to β\beta as the degree grows.

The test of fit in the Remark, which the surrounding text and Appendix B use as a sufficient condition, measures a different quantity from the approximation error of hh, and it does not certify a given degree. With uniform margins and no jump, the linear and the degree-7 regression can have a coefficient about 10 percentage points from β\beta while no further terms could lower the mean squared error by more than 1/12,000,0001/12{,}000{,}000. Rows (b) and (c) of Table 1 use these two degrees. Whether they are adequate for the data of the application cannot be determined from the paper.

Evidence an exact counterexample

The evidence is a derivation and exact counterexamples. Let X=DemVotX=\mathit{DemVot}, D=I[X≥0]D=I[X\ge0] and Y=DVY=\mathit{DV}, with E[Y∣X]=α+βD+h(X)E[Y\mid X]=\alpha+\beta D+h(X) as in Appendix B. Let rJr_J be the residual of DD after projection in L2L^2 on 1,X,…,XJ1,X,\ldots,X^J, and set vJ=E[rJ2]v_J=E[r_J^2], which I assume positive. Then E[rJ p(X)]=0E[r_J\,p(X)]=0 for every polynomial pp of degree at most JJ, and E[rJD]=vJE[r_JD]=v_J. Let bJb_J be the coefficient on DD in the population regression (2). Subtracting from the normal equation for DD the combination of the other normal equations that defines the projection, I obtain E[rJ(Y−bJD)]=0E[r_J(Y-b_JD)]=0. Then

bJ−β=E[rJ h(X)]vJ=E[rJ (h(X)−p(X))]vJ.b_J-\beta=\frac{E[r_J\,h(X)]}{v_J}=\frac{E[r_J\,(h(X)-p(X))]}{v_J}.

By the triangle inequality and the Cauchy–Schwarz inequality, I have

∣bJ−β∣≤κJ ∥h−p∥∞,κJ=E∣rJ∣vJ,and∣bJ−β∣≤∥h−p∥2vJ.|b_J-\beta|\le\kappa_J\,\|h-p\|_\infty,\qquad \kappa_J=\frac{E|r_J|}{v_J},\qquad\text{and}\qquad |b_J-\beta|\le\frac{\|h-p\|_2}{\sqrt{v_J}}.

Since E∣rJ∣≥E[rJ(2D−1)]=2vJE|r_J|\ge E[r_J(2D-1)]=2v_J, the factor κJ\kappa_J is at least 2. For fixed JJ and an i.i.d. sample with finite second moments, β^OLS2\hat\beta_{OLS2} converges in probability to bJb_J, and bJ−βb_J-\beta is then the difference between the two estimators in large samples.

For margins uniform on [−1,1][-1,1], I find by a direct computation that vJ=cn2/4v_J=c_n^2/4 with cn=(2nn)4−nc_n=\binom{2n}{n}4^{-n} and n=⌊(J+1)/2⌋n=\lfloor(J+1)/2\rfloor, so that vJv_J is of order 1/J1/J, and that κJ=(4/π)log⁡J+O(1)\kappa_J=(4/\pi)\log J+O(1). The table lists these constants for the two degrees of Table 1, together with the following example. Let hη(x)=a clip⁡(x/η,−1,1)h_\eta(x)=a\,\operatorname{clip}(x/\eta,-1,1) with a=1/20a=1/20 and η=1/10000\eta=1/10000, and let Y=1/2+hη(X)+UY=1/2+h_\eta(X)+U, where U=±1/10U=\pm1/10 with equal probability, independently of XX. Then hηh_\eta is Lipschitz, hη(0)=0h_\eta(0)=0, the jump is β=0\beta=0, and the RD estimate converges to 0. The predictor 1/2+a(2D−1)1/2+a(2D-1) lies in the span of the regressors of (2), and its mean squared error exceeds the noise variance 1/1001/100 by a2η/3=1/12,000,000a^2\eta/3=1/12{,}000{,}000. No further terms can lower the mean squared error by more than this amount.

Uniform margins on [−1,1][-1,1]: the constants, and the coefficient bJb_J in percentage points for the example with β=0\beta=0, a=1/20a=1/20 and η=1/10000\eta=1/10000, with the largest reduction in mean squared error that further terms could give.
DegreevJv_JκJ\kappa_J1/vJ1/\sqrt{v_J}bJb_J (points)Gain in fit at most
J=1J=11/161/1610/310/3449.9989.9981/12,000,0001/12{,}000{,}000
J=7J=71225/655361225/655364.76424.7642256/35256/359.9939.9931/12,000,0001/12{,}000{,}000

In exact terms, b1=99980001/1000000000b_1=99980001/1000000000. As η→0\eta\to0 with JJ fixed, the bound a2η/3a^2\eta/3 tends to zero and bJb_J tends to 2a=1/102a=1/10. A second example concentrates the margins: all but a fraction 10−1210^{-12} of the mass lies in two windows of half-width 1/20001/2000 around ±1/2\pm1/2, the density is continuous and positive on [−1,1][-1,1], and hh is Lipschitz with sup⁡∣h∣=1/2000\sup|h|=1/2000 and vanishes near 0. Then β=0\beta=0, further terms can lower the mean squared error by at most 1/4,000,0001/4{,}000{,}000, and yet b1=−499999999999503/500000999999500b_1=-499999999999503/500000999999500. With the fraction 10−9610^{-96}, the degree-7 coefficient lies between −1001/1000-1001/1000 and −999/1000-999/1000.

Continuity alone fails even for one fixed design. Since κJ\kappa_J is unbounded for uniform margins, a uniformly convergent series of polynomials defines a continuous hh with h(0)=0h(0)=0 and sup⁡∣h∣≤1/12\sup|h|\le1/12 such that bJm≥m/4b_{J_m}\ge m/4 along a sequence of degrees Jm→∞J_m\to\infty, while β=0\beta=0.

The corrected statement below rests on two estimates. Comparing with uniform margins on [−δ,δ][-\delta,\delta], I have vJ≥c δ/(4(J+1))v_J\ge c\,\delta/(4(J+1)) under its density condition. Under its Lipschitz condition, convolution with a Jackson kernel yields a polynomial pJp_J of degree at most JJ with pJ(0)=0p_J(0)=0 and ∥h−pJ∥∞≤4KL/(J+1)\|h-p_J\|_\infty\le4KL/(J+1), where K=3(1+π4)/(4π)K=3(1+\pi^4)/(4\pi). Inserting these into the second bound above, I obtain the rate of the corrected statement. The limit of τ^RD\hat\tau_{RD} follows from ∣E[h(X)∣0<X≤k]−E[h(X)∣−k<X<0]∣≤2Lk|E[h(X)\mid0<X\le k]-E[h(X)\mid-k<X<0]|\le2Lk and from the growth of the number of observations in the window on each side of the threshold, which has expectation at least NckNck on each side.

What survives

Proposition 1 and Appendix A do not use this step. If hh is exactly a polynomial of degree at most JJ, then bJ=βb_J=\beta. Proposition 2 holds as a statement about a sufficiently large degree under the conditions of the corrected statement, which are of the kind its “weak regularity conditions” ordinarily cover. No entry of Table 1 is shown to be wrong, and the similarity of the printed estimates stands as a description. What changes is the proof in Appendix B, the assumptions of Proposition 2, and the Remark. Rows (b) and (c) of Table 1 are instances of Proposition 2 only under a quantitative condition on the degrees 1 and 7, which the paper does not check.

Corrected

Proposition 2 should read as follows. Let the observations (X,Y)=(DemVotit,DVi(t+1))(X,Y)=(\mathit{DemVot}_{it},\mathit{DV}_{i(t+1)}) be i.i.d. with E[Y2]<∞E[Y^2]<\infty, and let D=I[X≥0]D=I[X\ge0]. Suppose that the law of XX is supported on [−1,1][-1,1], has no atom at 00, and satisfies P(X∈A)≥c ∣A∣P(X\in A)\ge c\,|A| for every Borel set A⊆[−δ,δ]A\subseteq[-\delta,\delta], for some c>0c>0 and δ>0\delta>0, where ∣A∣|A| is the Lebesgue measure of AA; that E[Y∣X=x]=α+βI[x≥0]+h(x)E[Y\mid X=x]=\alpha+\beta I[x\ge0]+h(x) with h(0)=0h(0)=0 and ∣h(x)−h(y)∣≤L∣x−y∣|h(x)-h(y)|\le L|x-y| for all x,y∈[−1,1]x,y\in[-1,1]; and that Var⁡(Y∣X)\operatorname{Var}(Y\mid X) is bounded on a neighbourhood of 00. Let bJb_J be the coefficient on DD in the population least-squares regression of YY on D,1,X,…,XJD,1,X,\ldots,X^J. Then for every J≥1J\ge1,

∣bJ−β∣≤8KLc δ (J+1),K=3(1+π4)4π.\colorbox{#ffe58a}{$\displaystyle |b_J-\beta|\le\frac{8KL}{\sqrt{c\,\delta\,(J+1)}},\qquad K=\frac{3(1+\pi^4)}{4\pi}.$}

For each fixed JJ, β^OLS2→bJ\hat\beta_{OLS2}\to b_J in probability as N→∞N\to\infty, and τ^RD→β\hat\tau_{RD}\to\beta in probability as N→∞N\to\infty, k→0k\to0 and Nk→∞Nk\to\infty. Hence for every ϵ>0\epsilon>0 there exists J0J_0 such that, for each fixed J≥J0J\ge J_0, the difference β^OLS2−τ^RD\hat\beta_{OLS2}-\hat\tau_{RD} converges in probability to bJ−βb_J-\beta, and ∣bJ−β∣<ϵ|b_J-\beta|<\epsilon. If J=JNJ=J_N grows with NN, the difference converges in probability to zero provided JN→∞J_N\to\infty and (JN+2)2/(NλJN3)→0(J_N+2)^2/(N\lambda_{J_N}^3)\to0, where λJ\lambda_J is the smallest eigenvalue of the second-moment matrix of (1,D,X,…,XJ)(1,D,X,\ldots,X^J).

The Remark should read: if hh is a polynomial of degree at most JJ, then bJ=βb_J=\beta. If sup⁡x∣h(x)−p(x)∣≤ϵ\sup_x|h(x)-p(x)|\le\epsilon for some polynomial pp of degree at most JJ, then ∣bJ−β∣≤κJϵ|b_J-\beta|\le\kappa_J\epsilon, where κJ=E∣rJ∣/E[rJ2]\kappa_J=E|r_J|/E[r_J^2] and rJr_J is the residual of DD on 1,X,…,XJ1,X,\ldots,X^J; for margins uniform on [−1,1][-1,1], κ1=10/3\kappa_1=10/3 and κ7≈4.764\kappa_7\approx4.764. That the fit cannot be meaningfully improved by further terms does not imply that bJb_J is close to β\beta.

In Appendix B, the sentence should read: “E[u∣DemVot]≈0E[u\mid \mathit{DemVot}]\approx0, and the coefficient bJb_J satisfies bJ−β=E[rJ(h−pJ)]/E[rJ2]b_J-\beta=E[r_J(h-p_J)]/E[r_J^2], which is small when ∥h−pJ∥2\|h-p_J\|_2 is small relative to ∥rJ∥2\|r_J\|_2.”

Screenshot of a displayed approximation of the conditional expectation and the four lines after it. A red box marks the sentence: E[u given DemVot] is approximately 0 and therefore E of the OLS estimator is approximately beta.
Appendix B, p. 10 (PDF p. 10). The marked sentence passes from a small approximation error of the conditional mean to a small error of the coefficient.
Screenshot of the Remark to Proposition 2 and two lines of the next paragraph. Red boxes mark the words: model fit cannot be meaningfully improved by including additional terms.
Remark to Proposition 2, p. 7 (PDF p. 7). The marked words state the test of fit.
Line chart with a logarithmic horizontal axis, the upper bound on the gain in fit from further terms, from about 0.00001 to 0.8 squared percentage points, and a vertical axis, the OLS coefficient on DemWin, from 0 to 10 percentage points. A solid blue line (linear control) and a dashed orange line (degree-7 control) lie at about 10 for small values of the bound and fall to about 8 and 4.5 at the right edge. A grey dashed line at 0 is labelled as the jump at the threshold and the limit of the RD estimate. An open circle at a bound of 1/1200 marks coefficients of 9.998 and 9.993.
The population coefficient on DemWin\mathit{DemWin} in the linear and the degree-7 regression (2), for margins uniform on [−1,1][-1,1], no jump at the threshold and smooth part hη(x)=(1/20)clip⁡(x/η,−1,1)h_\eta(x)=(1/20)\operatorname{clip}(x/\eta,-1,1), as η\eta runs from 10−610^{-6} to 10−110^{-1}. The horizontal axis is the bound 104a2η/310^4a^2\eta/3, in squared percentage points, on the reduction in mean squared error that any further terms could give. The coefficient tends to 10 percentage points as the bound tends to zero, while the jump, to which the RD estimate converges, is 0 (dashed line). The circle marks the example of the text, η=1/10000\eta=1/10000.

On the replication data of Caughey and Sekhon (2011), the estimators with a triangular kernel that are described for rows (f) and (h) of Table 1 give 13.08 and 15.30 percentage points, not the printed 10.57 and 12.38.

Table 1, rows (f) and (h), p. 8 (PDF p. 8), and the paragraph below the table

As printed
Table 1, p. 8: the rows for the RD estimators.
Estimated effect
Regression discontinuity (close elections)
(e) Degree 0, Rectangular kernel10.54 pp
(f) Degree 0, Triangular kernel10.57 pp
(g) Degree 1, Rectangular kernel13.15 pp
(h) Degree 1, Triangular kernel12.38 pp

Table note. “Bandwidth k=0.5k=0.5 percentage points for Degree 0 RD estimates and coarsened control OLS, k=1.0k=1.0 percentage points for Degree 1 RD estimates.”

[p. 8] “Estimator (f) replaces the rectangular kernel in τ^RD\hat\tau_{RD} with a triangular kernel, so that observations closer to the discontinuity receive greater weight. … Estimator (h) uses both a triangular kernel and a Degree 1 polynomial.”

The problem

Row (f) is described as the difference in means τ^RD\hat\tau_{RD} of row (e) with a triangular kernel in place of the rectangular one, and row (h) as the local linear estimate of row (g) with the same change. I read these descriptions in the standard way. An election with margin xx has weight max⁡(1−∣x∣/k,0)\max(1-|x|/k,0), with k=0.5k=0.5 points and a constant fitted on each side of the threshold in row (f), and with k=1.0k=1.0 point and a line fitted on each side in row (h). On the replication data of Caughey and Sekhon (2011), I find 13.08 and 15.30 points for these two estimators. From the same data and the same elections, I obtain rows (e) and (g) as printed, 10.54 and 13.15, and a coarsened regression equal to row (e), as in row (d). The two printed entries are thus lower by 2.51 and 2.92 points than the values that the described estimators take on the data that reproduce the neighbouring rows.

In the printed table the estimates with the triangular kernel are close to those with the rectangular kernel: the differences are +0.03+0.03 and −0.77-0.77 points. Recalculated, the triangular estimates exceed the rectangular ones by 2.54 and 2.16 points, and, with the other entries as printed, the estimates other than the naive one range from 9.97 to 15.30 points, where the printed ones range from 9.97 to 13.15. I do not know the cause of the two differences. A different release of the data, a choice of weights, bandwidth or sample that the paper does not describe, and a slip in computation or reporting are all consistent with the evidence; the paper names no release, and its analysis code was not available.

Evidence a recalculation from the source

The evidence is a recalculation from the data in exact rational arithmetic on the stored values; a second, independent computation agrees with it to 10−1010^{-10} points. The data are the release of 10 April 2014, and the sample is the 8,610 elections with the outcome, the margin and the winner recorded. Let xix_i be the margin of election ii in points and yiy_i its outcome. Row (f) is the difference between the two sides of the threshold in the weighted mean ∑iwiyi/∑iwi\sum_i w_iy_i/\sum_i w_i, with wi=1−∣xi∣/0.5w_i=1-|x_i|/0.5 over the elections with ∣xi∣<0.5|x_i|<0.5. The weighted means are 40.99 for the Democratic losses and 54.08 for the Democratic wins. Row (h) is the difference at x=0x=0 between two weighted least-squares lines, one on each side, with wi=1−∣xi∣w_i=1-|x_i| over the elections with ∣xi∣<1|x_i|<1. The two intercepts are 38.86 and 54.16.

The four RD rows of Table 1, in percentage points, as printed and as recalculated.
RowElections (losses + wins)PrintedRecalculatedDifference
(e) Degree 0, rectangular, k=0.5k=0.585 (42 + 43)10.5410.540.00
(f) Degree 0, triangular, k=0.5k=0.585 (42 + 43)10.5713.082.51
(g) Degree 1, rectangular, k=1.0k=1.0168 (86 + 82)13.1513.150.00
(h) Degree 1, triangular, k=1.0k=1.0168 (86 + 82)12.3815.302.92

No margin equals 00, ±0.5\pm0.5 or ±1.0\pm1.0 points, so the treatment of ties and of the endpoints of a window cannot account for the differences. If the sample is restricted to the elections that Caughey and Sekhon (2011) flag for their RD analysis, the same elections lie in both windows, and the four rows do not change.

The four outcomes of P023-E004 are one hundredth of their linked next-election percentages at storage precision. All four elections lie within 0.3 points of the threshold, and two of them within 0.06 points, where the triangular weights are largest. With those linked percentages substituted, I obtain 10.36 and 10.91 points for rows (f) and (h). Neither computation returns the printed 10.57 and 12.38; the accuracy of the links and percentages remains unverified.

What survives

Rows (e) and (g) are reproduced as printed, and the coarsened regression of row (d) equals row (e) exactly, as Proposition 1 requires. The propositions and their proofs do not use Table 1. Every estimate other than the naive one remains positive. What changes is two entries of the table and the comparison drawn from them: the sentence below the table that all estimates other than the naive one are “substantively similar” then covers a range from 9.97 to 15.30 points. The paper gives no threshold for this phrase, and I draw no conclusion on whether it still applies.

Corrected
Table 1, rows (f) and (h), recalculated.
Estimated effect
(f) Degree 0, Triangular kernel13.08 pp
(h) Degree 1, Triangular kernel15.30 pp

These are the values for the release of 10 April 2014 of the data, the 8,610 elections with the outcome, the margin and the winner recorded, and the weights max⁡(1−∣x∣/k,0)\max(1-|x|/k,0), with a constant on each side for k=0.5k=0.5 and a line on each side for k=1.0k=1.0. Section 4 should state the release, the sample and the weights, and the comparison below the table should be drawn from the corrected entries. If the four outcomes of P023-E004 are also replaced by their linked next-election percentages, rows (f) and (h) read 10.36 and 10.91.

Screenshot of the lower part of Table 1: row (d) Coarsened control 10.54 pp, the heading Regression discontinuity (close elections), rows (e) to (h), and the note giving the bandwidths 0.5 and 1.0 percentage points. Red boxes mark the entries 10.57 pp of row (f) and 12.38 pp of row (h).
Table 1, p. 8 (PDF p. 8), rows (d) to (h) and the note on bandwidths. The marked entries are the two RD estimates with a triangular kernel.
Screenshot of the paragraph that describes the four RD estimators, followed by the first two lines of the next paragraph. Red boxes mark the words: tor (f) replaces the rectangular kernel in tau-hat RD with a triangular kernel; and the sentence: Estimator (h) uses both a triangular kernel and a Degree 1 polynomial.
Section 4, p. 8 (PDF p. 8), the paragraph below Table 1. The marked sentences describe estimators (f) and (h).

Four next-election outcomes in the 10 April 2014 release of the Caughey and Sekhon (2011) data have a 100-fold scale inconsistency with their linked percentages; replacing only those outcomes in the calculation below lowers rows (d), (e) and (g) from 10.54, 10.54 and 13.15 to 9.32, 9.32 and 10.40 percentage points.

Section 4, first paragraph, p. 7 (PDF p. 7), and Table 1, p. 8 (PDF p. 8)

As printed

[p. 7] “We use the replication data provided by Caughey and Sekhon (2011), restricting our estimates to all elections with available data. Our outcome measure, DVi(t+1)\mathit{DV}_{i(t+1)} is Democratic vote share in election t+1t+1 in region ii.”

Table 1, p. 8: rows (d), (e) and (g).
Estimated effect
(d) Coarsened control10.54 pp
(e) Degree 0, Rectangular kernel10.54 pp
(g) Degree 1, Rectangular kernel13.15 pp
The problem

In the replication data of Caughey and Sekhon (2011) the outcome is the variable DPctNxt, which the codebook defines as the “Democratic percentage of the vote in the next election”, and the variable NxtElcOb gives the observation number of that election. For four elections of 2000 the recorded outcome is one hundredth of the Democratic percentage at the linked observation, to the precision of the stored numbers. The linked observation is the election of 2002 with the same state and district number. I call this percentage the linked percentage. No other positive outcome shows this ratio.

The four elections were decided by margins of −0.28-0.28, −0.05-0.05, −0.05-0.05 and 0.220.22 points. They are therefore among the 85 elections in the 0.5-point window of rows (d) to (f) and among the 168 elections in the 1.0-point window of rows (g) and (h). In the smaller window, the three proportions recorded for Democratic losses lower the mean outcome of the losing side by 2.62 points, and the proportion recorded for the Democratic win lowers the mean of the winning side by 1.41 points. The difference in means of rows (d) and (e) is then higher by 1.22 points than with the linked percentages. With the four outcomes replaced by the linked percentages and nothing else changed, rows (d) and (e) fall from 10.54 to 9.32 points and row (g) falls from 13.15 to 10.40. The printed entries of these three rows agree to the second decimal with the values computed from the four outcomes as recorded.

Two points are not established. The first is that the linked percentages are the right outcomes for the four elections. The codebook codes the outcome as missing when the seat was redistricted between the two elections, and the linked elections of 2002 are not among the elections that Caughey and Sekhon (2011) flag for their RD analysis and carry no link back to a previous election. The data alone do not show that the two elections are in the same district. The second is that the published analysis read these four values. The paper names no release of the data and its analysis code was not available. Agreement of the printed rows (d), (e) and (g) with calculations from the release of 10 April 2014 does not establish historical use.

Evidence a recalculation from the source

I recalculated the estimates from the data (the release of 10 April 2014, with 16,968 observations, of which 8,980 have an outcome and a linked percentage). The four observations listed in the first table below are the only ones with a positive outcome at which 100 times the outcome equals the linked percentage, to the precision of the stored numbers. Their recorded outcomes also equal, to storage precision, the Democratic shares at the linked observations: 83265/21711583265/217115, 70920/23059770920/230597, 121121/286860121121/286860 and 104806/171713104806/171713.

The four elections of 2000 with inconsistent outcome scales.
ObservationDistrictMargin (points)Recorded outcomeLinked percentage
3123Florida 22−0.28-0.280.383538.35
7243Michigan 8−0.05-0.050.307530.75
7687Minnesota 2−0.05-0.050.422242.22
9374New Jersey 120.220.220.610461.04

The eight Table 1 specifications were translated using DifDPct as the margin and a common sample of 8,610 elections with the outcome, margin and winner recorded. Each was computed twice with the stored numbers treated as exact binary fractions: once with the outcomes as recorded, and once with the four outcomes replaced by the linked percentages. The second table reports both computations in percentage points; the changes are computed before rounding.

Table 1 recalculated, with the outcomes as recorded and with the four outcomes replaced by the linked percentages.
RowPrintedAs recordedFour replacedChange
(a) Naive (no control)34.4034.3834.37−0.02-0.02
(b) Linear control11.1511.1511.13−0.02-0.02
(c) Polynomial (Degree 7) control9.979.959.87−0.08-0.08
(d) Coarsened control10.5410.549.32−1.22-1.22
(e) Degree 0, Rectangular kernel10.5410.549.32−1.22-1.22
(f) Degree 0, Triangular kernel10.5713.0810.36−2.73-2.73
(g) Degree 1, Rectangular kernel13.1513.1510.40−2.75-2.75
(h) Degree 1, Triangular kernel12.3815.3010.91−4.40-4.40

With the sample restricted to the 8,594 elections that Caughey and Sekhon (2011) flag for their RD analysis, rows (a) to (c) are 34.40, 11.14 and 9.97 with the outcomes as recorded and 34.38, 11.12 and 9.89 with the four replaced, and rows (d) to (h) are as in the table. Neither sample reproduces all eight printed entries. Row (d) equals row (e) exactly in every computation. For rows (f) and (h), whose printed entries neither computation returns, see P023-E003.

What survives

The equality of rows (d) and (e) holds for every vector of outcomes and is unaffected, and the propositions do not use the table. Rows (a) to (c) move by less than 0.1 point. In this calculation, with the four outcomes replaced, rows (b) to (h) lie between 9.32 and 11.13 points, and their numerical agreement stands. What changes is the size of the close-election estimates: rows (d), (e) and (g) fall by 1.22, 1.22 and 2.75 points. The four values are in the data as Caughey and Sekhon released them, and nothing shows that the authors of the paper introduced them.

Corrected

[p. 7] After “restricting our estimates to all elections with available data”, Section 4 should identify the data release and explain how the outcomes at observations 3123, 7243, 7687 and 9374 are treated if that release contains these scale inconsistencies.

Sensitivity calculation for Table 1, rows (d), (e) and (g), on the 8,610 complete elections, replacing only the four outcomes by their linked percentages.
Estimated effect
(d) Coarsened control9.32 pp
(e) Degree 0, Rectangular kernel9.32 pp
(g) Degree 1, Rectangular kernel10.40 pp

The other estimates change as in the second table of the evidence. These are separate sensitivity results for the stated sample and estimators. Replacing the printed entries additionally requires verification of the intended same-district links, linked percentages, and the authors' historical data, sample, transformations and estimator implementation.

Screenshot of the five lines of the first paragraph of Section 4. Red boxes mark the words: the replication data provided by Caughey and Sekhon (2011).
Section 4, p. 7 (PDF p. 7), first paragraph. The marked words identify the source study’s replication data; the outcome is the Democratic vote share in the next election.
Screenshot of the body of Table 1: rows (a) to (d) under the heading Ordinary least squares (full data), rows (e) to (h) under the heading Regression discontinuity (close elections), and the note on bandwidths. Red boxes mark the entries 10.54 pp of row (d), 10.54 pp of row (e) and 13.15 pp of row (g).
Table 1, p. 8 (PDF p. 8), the eight rows and the note on bandwidths. The marked entries of rows (d), (e) and (g) agree, after rounding, with calculations from the 10 April 2014 release before changing the four outcomes.

Minor (4)

Real but inconsequential, for example a misprint that does not change a result.

In the data of Caughey and Sekhon (2011), 103 of the 13,923 House elections of 1944–2006 have a recorded absolute Democratic margin below 0.5 percentage points, which rounds to 0.7%, not 0.6%.

Section 1, first paragraph, p. 1 (PDF p. 1)

As printed

“In the case of the US House of Representatives, close elections are quite rare (0.6% of elections between 1944 and 2006 were determined by <0.5<0.5 percentage points), and characterizing a causal effect that is only applicable to a tiny, unrepresentative sample of elections may seem undesirable on substantive grounds.”

The problem

The paper gives no numerator, denominator or counting rule for this figure. The replication data of Caughey and Sekhon (2011), which Section 4 uses for the application, contain 13,923 observations for 1944–2006, one for each seat and election. In 103 of them the recorded margin between the leading Democrat and the leading non-Democrat is below 0.5 points in absolute value, that is, in about 0.74% of them. A share that rounds to 0.6% would require between 77 and 90 such elections.

Evidence a recalculation from the source

I recalculated the share from the data (the release of 10 April 2014; the paper names no release). The margin is missing for 587 of the 13,923 elections, and the missing margins cannot restore the printed figure. By the codebook’s definition of the margin, each of the 103 elections was decided by less than 0.5 points between the winner and the runner-up. The share of all elections is then at least 103/13,923103/13{,}923. Among the elections with a recorded margin the share is 103/13,336≈0.77%103/13{,}336\approx0.77\%. The ratio 85/13,923≈0.61%85/13{,}923\approx0.61\% rounds to the printed figure, but its numerator counts only the close elections that Caughey and Sekhon (2011) flag for their RD analysis and omits 18 others, while its denominator counts all elections. The paper does not say how its figure was computed.

What survives

Each of the recorded close-election shares above is below 1%. The figure enters no proposition, no proof and no entry of Table 1. The data do not determine the exact share of all elections decided by less than 0.5 points, since the margin between winner and runner-up is not recorded for every election; this share rounds to 0.7% if at most one further close election lies outside the 103.

Corrected

“… recorded close elections are quite rare (0.7% of elections between 1944 and 2006 had a recorded absolute Democratic margin of <0.5<0.5 percentage points), …” The count behind the figure is 103 of 13,923 elections in the data of Caughey and Sekhon (2011), release of 10 April 2014, with the margin missing for 587. This fraction is a lower bound for the share decided by less than 0.5 points between winner and runner-up.

Screenshot of five lines of the first paragraph of the introduction. A red box marks the figure 0.6\%, together with the opening parenthesis before it.
Section 1, p. 1 (PDF p. 1), first paragraph. The marked figure is the share of House elections of 1944–2006 decided by less than 0.5 percentage points.

In footnotes 3 and 4, “Caughley” should read “Caughey”.

Footnote 3, p. 3 (PDF p. 3), and footnote 4, p. 4 (PDF p. 4)

As printed

Footnote 3: “… Gelman and King (1990), Lee (2008), Caughley and Sekhon (2011) and Erikson and Titiunik (2012).” Footnote 4: “… Lee (2008), Lee and Lemieux (2010) and Caughley and Sekhon (2011) for greater technical details on the RD design …”

The problem

The surname of the first author of the cited study is misspelled in both footnotes.

Evidence a check of the printed page

I checked the pages: the reference list on p. 11 and the text on pp. 6, 7 and 9 have “Caughey”.

What survives

Nothing depends on the spelling, and the reference list identifies the work.

Corrected

Footnote 3: “… Gelman and King (1990), Lee (2008), Caughey and Sekhon (2011) and Erikson and Titiunik (2012).” Footnote 4: “… Lee (2008), Lee and Lemieux (2010) and Caughey and Sekhon (2011) …”

Screenshot of the three lines of footnote 3. A red box marks the word Caughley in the citation Caughley and Sekhon (2011).
Footnote 3, p. 3 (PDF p. 3). The marked surname is misspelled.
Screenshot of the three lines of footnote 4. A red box marks the word Caughley in the citation Caughley and Sekhon (2011).
Footnote 4, p. 4 (PDF p. 4). The same misspelling.

Section 4 should name the release of the data, the variables, the sample rule and the sample sizes behind Table 1; “all elections with available data” does not determine them.

Section 4, first paragraph, p. 7 (PDF p. 7), and Table 1, p. 8

As printed

“We use the replication data provided by Caughey and Sekhon (2011), restricting our estimates to all elections with available data. Our outcome measure, DVi(t+1)\mathit{DV}_{i(t+1)} is Democratic vote share in election t+1t+1 in region ii.”

The problem

The codebook of the replication data of Caughey and Sekhon (2011) defines a flag, Use, for a narrower “RD incumbency advantage sample”. Its margin variable, DifDPct, is the percentage of the leading Democrat minus that of the leading non-Democrat, while the paper defines DemVotit\mathit{DemVot}_{it} as the difference between Democratic and Republican vote share. Section 4 does not say which release of the data was used, which variables stand for the margin and the outcome, whether the sample was restricted by the flag, or how missing values were treated. Table 1 reports no sample sizes and no standard errors. The table cannot be reproduced exactly from this description. This is a gap in the description, separate from the numerical and data issues in P023-E003 and P023-E004.

Evidence a check of the printed page

I checked pp. 7–8 against the codebook of the data (the copy posted by the first author of the source study, dated 22 December 2025), which defines Use on its p. 1 and DifDPct on its p. 2. Independent recalculations from the corrected release of 10 April 2014 used 8,610 elections complete on DPctNxt, DifDPct and DemWin, or 8,594 when also requiring Use=1. Neither sample reproduces every row to the second decimal. The small differences in rows (a) and (c) do not change the comparison that the table serves.

What survives

The broad comparison between the naive estimator and the others survives, with the numerical qualifications in P023-E003 and P023-E004. The two definitions of the margin agree under the two-party supposition of p. 5. The propositions do not use the table.

Corrected

After the first sentence of Section 4, the text should state the release of the data file, the variables used for the outcome, the margin and the win indicator, whether the sample is restricted by the flag Use of the source study, how missing values are treated in each regression, and the number of elections behind each row of Table 1. I cannot determine the authors' choices from the paper or from the codebook. The separate numerical and data issues are addressed in P023-E003 and P023-E004.

Screenshot of the first paragraph of Section 4 and the two lines after it. A red box marks the words: all elections with available data.
Section 4, p. 7 (PDF p. 7), first paragraph. The marked words state the availability rule for the sample.

In the display after “Therefore,” in Appendix A, both sums should run over it∈Ubit\in U_b, not i∈Ubi\in U_b.

Appendix A, p. 9 (PDF p. 9), the display after “Therefore,”

See also under Formal statements (Lean): P023-T9

As printed

“Therefore, β^OLS=(∑i∈UbDemWin¨it2)−1(∑i∈UbDemWin¨it DV¨i(t+1))\hat\beta_{OLS}=\big(\sum_{\colorbox{#ffe58a}{$i$}\in U_b}\ddot{\mathit{DemWin}}_{it}^{2}\big)^{-1}\big(\sum_{\colorbox{#ffe58a}{$i$}\in U_b}\ddot{\mathit{DemWin}}_{it}\,\ddot{\mathit{DV}}_{i(t+1)}\big), the least squares estimator as applied only to observations in the interval covering the discontinuity (noting that Ub=U~J/2U_b=\tilde U_{J/2}).”

The problem

The set UbU_b consists of pairs itit, and the summands depend on tt, so a sum over ii alone is not defined.

Evidence a check of the printed page

I checked the page: Ub={it:−k<DemVotit≤k}U_b=\{it:-k<\mathit{DemVot}_{it}\le k\} is defined on p. 6, and the display on p. 6 and the next display on p. 9 sum over it∈Ubit\in U_b.

What survives

The proof of Proposition 1 is unaffected; the intended sums are over the pairs in the central bin.

Corrected

“Therefore, β^OLS=(∑it∈UbDemWin¨it2)−1(∑it∈UbDemWin¨it DV¨i(t+1))\hat\beta_{OLS}=\big(\sum_{\colorbox{#ffe58a}{$it$}\in U_b}\ddot{\mathit{DemWin}}_{it}^{2}\big)^{-1}\big(\sum_{\colorbox{#ffe58a}{$it$}\in U_b}\ddot{\mathit{DemWin}}_{it}\,\ddot{\mathit{DV}}_{i(t+1)}\big), the least squares estimator as applied only to observations in the interval covering the discontinuity (noting that Ub=U~J/2U_b=\tilde U_{J/2}).”

Screenshot of three lines of the proof of Proposition 1. Red boxes mark the subscript, i in U sub b, under each of the two summation signs in the formula for the OLS estimator.
Appendix A, p. 9 (PDF p. 9), the display after “Therefore,”. The index of each of the two sums is marked.

Clarity notes

Imprecise or ambiguous wording whose intended meaning is correct; not an error.

Condition 1 is sufficient, not necessary, for the displayed RD estimate; the bin means of Appendix A are taken over nonempty bins; and the 50% threshold on p. 4 is that of a two-party election.

Remark to Condition 1, p. 5 (PDF p. 5); Appendix A, p. 9, definitions of the demeaned variables; Section 2, p. 4, last sentence

See also under Formal statements (Lean): P023-T9

As printed

[p. 5] “Condition 1. There exists at least one value of (i,t)(i,t) s.t. 0<DemVotit<k0<\mathit{DemVot}_{it}<k and there also exists at least one value of (i′,t′)(i',t') s.t. −k<DemVoti′t′<0-k<\mathit{DemVot}_{i't'}<0 … Remark. Condition 1 is a mild regularity condition that requires that there exist at least one observation on each side of the discontinuity in the bandwidth. This condition is necessary for the existence of an RD estimate.”

[p. 9] “where DemWin¨it≡DemWinit−∑j=0J[Xijt ∣U~j∣−1∑i′t′∈U~jDemWini′t′]\ddot{\mathit{DemWin}}_{it}\equiv \mathit{DemWin}_{it}-\sum_{j=0}^{J}\big[X_{ijt}\,\colorbox{#ffe58a}{$|\tilde U_j|^{-1}$}\sum_{i't'\in\tilde U_j}\mathit{DemWin}_{i't'}\big] …”

[p. 4] “… the difference between the predicted outcome at a vote share of 50%+ϵ50\%+\epsilon and the predicted outcome at 50%−ϵ50\%-\epsilon (for ϵ→0\epsilon\to0) can be interpreted as an estimate of the causal effect of the party incumbency advantage.”

Intended meaning

The RD estimate displayed on p. 6 is a difference in means over Ub={it:−k<DemVotit≤k}U_b=\{it:-k<\mathit{DemVot}_{it}\le k\}. It exists as soon as UbU_b contains one Democratic win and one Democratic loss, so the strict inequalities of Condition 1 are sufficient for it and not necessary. For example, with k=1/2k=1/2, margins −3/4,−1/4,1/2,3/4-3/4,-1/4,1/2,3/4 and outcomes 1/10,1/5,4/5,9/101/10,1/5,4/5,9/10, Condition 1 fails and the RD and coarsened OLS estimates both equal 3/53/5. Conditions 1–3 allow a bin to be empty, and ∣U~j∣−1|\tilde U_j|^{-1} is then undefined. I read the intended convention as dropping empty bins; the coefficient on DemWin\mathit{DemWin} is then unique, and Proposition 1 holds. The 50% threshold is that of a two-party election, which the paper supposes from p. 5 on. With three parties a plurality can be below 50% (shares of 40%, 35% and 25%, say).

Corrected

[p. 5] “This condition is sufficient for the existence of the RD estimate displayed below. That estimate exists if and only if UbU_b contains at least one observation with DemWinit=1\mathit{DemWin}_{it}=1 and at least one with DemWinit=0\mathit{DemWin}_{it}=0.”

[p. 9] The sums over jj in the two definitions run over the nonempty bins only, and the indicator of an empty bin is left out of the regression.

[p. 4] “… the difference, in a two-party election, between the predicted outcome at a vote share of 50%+ϵ50\%+\epsilon and the predicted outcome at 50%−ϵ50\%-\epsilon …”

Screenshot of Condition 1 and the Remark that follows it. Red boxes mark the two strict inequalities of the condition, DemVot between 0 and k and DemVot between minus k and 0, and the word necessary in the last sentence of the Remark.
Condition 1 and its Remark, p. 5 (PDF p. 5). The two strict inequalities of the condition and the word “necessary” are marked.
Screenshot of the two definitions of the demeaned variables in Appendix A. Red boxes mark the factor, the inverse of the number of observations in bin j, in each definition.
Appendix A, p. 9 (PDF p. 9), definitions of the demeaned variables. The marked factor ∣U~j∣−1|\tilde U_j|^{-1} is undefined for an empty bin.
Screenshot of four lines at the end of Section 2. Red boxes mark the expressions 50 percent plus epsilon and 50 percent minus epsilon.
Section 2, p. 4 (PDF p. 4), last sentence. The marked vote shares put the threshold at 50%.

Since the theory measures the bandwidth kk as a proportion, “kk percentage points” in the Remark to Condition 3 means 100k100k percentage points, and the 0.5 points of the application is k=0.005k=0.005.

Section 3.1, p. 5 (PDF p. 5), definition of kk and Remark to Condition 3; Section 4, p. 7; note to Table 1, p. 8

See also under Formal statements (Lean): P023-T11

As printed

[p. 5] “Let kk (the bandwidth) be a number between 0 and 1.” … “Remark. Condition 3 is logically equivalent to producing an estimate by taking a difference in means within a bandwidth of kk percentage points of 0 on the forcing variable, DemVotit\mathit{DemVot}_{it}.”

[p. 7] “… with k=0.5k=0.5 percentage points (pp) …”

[p. 8, note to Table 1] “Bandwidth k=0.5k=0.5 percentage points for Degree 0 RD estimates and coarsened control OLS, k=1.0k=1.0 percentage points for Degree 1 RD estimates.”

Intended meaning

In Section 3.1 and Appendix B the margin DemVotit\mathit{DemVot}_{it} lies in [−1,1][-1,1], and the formula J=2⌈(1−k)/(2k)⌉J=2\lceil(1-k)/(2k)\rceil of Condition 2 takes kk on the same scale. The bandwidths of the application are stated in percentage points. I convert 0.5 points to k=0.005k=0.005, for which J=200J=200 in Condition 2, that is, 201 bins one percentage point wide, and 1.0 point to k=0.01k=0.01. Read literally, k=0.5k=0.5 would give J=2J=2 and a window of 50 points on each side of the threshold. No result changes.

Corrected

[p. 5] “… within a bandwidth of kk (that is, 100k100k percentage points) of 0 on the forcing variable …”

[p. 7] “… with k=0.005k=0.005 (0.5 percentage points) …”

[p. 8, note to Table 1] “Bandwidth k=0.005k=0.005 (0.5 percentage points) for Degree 0 RD estimates and coarsened control OLS, k=0.01k=0.01 (1.0 percentage point) for Degree 1 RD estimates.”

Screenshot of the three lines of the Remark to Condition 3. A red box marks the words: k percentage points.
Remark to Condition 3, p. 5 (PDF p. 5). The marked words give the bandwidth as kk percentage points.
Screenshot of four lines of text above Condition 1. Red boxes mark the sentence: Let k (the bandwidth) be a number between 0 and 1.
Section 3.1, p. 5 (PDF p. 5), the definition of the bandwidth. The marked sentence puts kk between 0 and 1.

Formal statements (Lean)

Formal results: 10 whole; 1 restricted; 1 refuted; 0 omitted.

Coverage concerns the identified claim under its stated assumptions. A checked proof establishes the formal statement; correspondence to the published text was reviewed by AI. Repository access is currently required to open the source links.

Each result links to its current formal statement and proof. “Whole” covers the identified claim under its assumptions; “restricted” covers the stated narrower scope; “refuted” gives a counterexample to the identified assertion; “omitted” has no current theorem. Any named published theorem used as a premise remains an assumption. Browse the formal results for this work.

Section 1, last paragraph (‘the resulting estimates rely solely on data from close elections’), and Section 3.2, last paragraph (‘will also only use information from close elections’), as printed; the witness is the validators’ construction (linear control) and is not in the paper

p. 3 (PDF p. 3) and p. 7 (PDF p. 7)

p. 3 (PDF p. 3) and p. 7 (PDF p. 7). The six-election linear design has the stated rank, exact model, weights and estimator values, and changing a distant outcome changes polynomial OLS while preserving the close-window and coarsened estimates.

Historical component credits
  • Counterexample proved AronowAudit.P023.linear_counterexample Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Witness credit only: exact finite data dependence is the target, rather than sampling consistency or causal interpretation.

Section 1, last paragraph, and Section 3.2, last paragraph, as printed (the same statements as P023-T1); the witness is the validators’ construction with the degree-7 control of estimator (c) and is not in the paper

p. 3 (PDF p. 3) and p. 7 (PDF p. 7)

p. 3 (PDF p. 3) and p. 7 (PDF p. 7). The sixteen-election degree-seven design has the stated rank, exact model, nonzero weights and estimator values, and its distant perturbation changes polynomial OLS while preserving both close-window estimates.

Historical component credits
  • Counterexample proved AronowAudit.P023.degree7_counterexample Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Witness credit only; the exact degree-seven baseline and unchanged close outcomes are both exported.

Section 1, last paragraph (p. 3), and Section 3.2, last paragraph (p. 7), as repaired by Sol: sole reliance on close-election outcomes is reserved for the coarsened regression of Proposition 1; for polynomial controls, a common discontinuity target together with non-zero weights on distant outcomes

p. 3 (PDF p. 3) and p. 7 (PDF p. 7); the ‘may’ sentence of Section 5, p. 8 (PDF p. 8), is kept

p. 3 (PDF p. 3) and p. 7 (PDF p. 7); Section 5, p. 8 (PDF p. 8). Coarsened OLS has exactly the localized RD weights and a unique party coefficient. Full-rank polynomial OLS has the residual weights, root-count nonlocality and conditional moments stated in clauses (b)–(d). The uniform degree-one and degree-seven examples share the cutoff target while retaining distant influence. For every positive tolerance the difference-event probability is bounded by the two half-tolerance error probabilities; shared consistency implies convergence of the estimator difference without an independence or sample-admissibility premise.

Historical component credits
  • Proved AronowAudit.P023.corrected_coarsened_weights Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Covers T3(a) in weight form; uniqueness and localization follow immediately for all solutions.
  • Proved AronowAudit.P023.corrected_finite_polynomial_weights Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; The full-rank premise is in T3(b), and guarantees the epsilon choices are genuine unique fits with positive normalization.
  • Proved AronowAudit.P023.corrected_finite_nonlocality Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Distinct margin values, not observations, are counted, and zero margins are excluded as in the target.
  • Proved AronowAudit.P023.corrected_finite_conditional_moments Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; {'source': 'adjudication', 'decision': 'rejected', 'what': 'At P023/P023_Audit.lean:2652, the theorem states the residual-weighted bias, exact-polynomial unbiasedness, centered variance formula, and positive variance contributions required by the assigned T3(d) component. Quantifying over every normalized outcome law P at a fixed full-rank design represents conditioning on that design without losing any conditional-law case. Outcome integrability and integrable squared errors are the existence conditions for the finite means and variances in the claim, and the zero cross-moment premise is precisely uncorrelatedness of the centered errors. The fixed-margin representation is therefore a minor convention, not a material narrowing.'}
  • Proved AronowAudit.P023.Wave1.uniform_common_target_distant_information_proof Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Covers T3(e), not a primitive sampling-consistency theorem. Positive distant information shares are exact population identities.
  • Proved AronowAudit.P023.coarsened_ols_printed_equivalence Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Auxiliary equivalence genuinely needed to identify the bin-intercept estimator with the printed regression; empty nuisance bins do not narrow the statement.
  • Proved AronowAudit.P023.polynomial_rd_shared_consistency Historical support retained; baseline fidelity: ok; manifest: not used; not used in Solution; Accepted generalization, not a derivation of either consistency premise. The missing separately exported probability inequality is recorded at target level.

Remark to Proposition 2 (‘we require that the model fit cannot be meaningfully improved by including additional terms’), read with Appendix B (‘E[u∣DemVot]≈0\mathrm E[u|DemVot]\approx0 and therefore E[β^OLS2]≈β\mathrm E[\hat\beta_{OLS2}]\approx\beta’), as printed; the witness (uniform margins, degrees 1 and 7) is the settling validator's construction and is not in the paper

p. 7 (PDF p. 7) and p. 10 (PDF p. 10)

p. 7 (PDF p. 7) and p. 10 (PDF p. 10). For every positive amplitude and positive width at most one, the uniform-margin clipped linear family has a continuous Lipschitz conditional mean whose centered part is odd, and zero cutoff jump. Its RD means, residuals, degree-one and degree-seven coefficients and numerical outcome bounds are as displayed. At every degree the fitted risk lies between the noise risk and that risk plus a squared amplitude times width divided by three; no measurable predictor, including one with infinite risk, improves it by more. For fixed degree the coefficient tends to twice the amplitude as width vanishes, while the risk bound vanishes. Every family member has the stated fixed-degree sampling limit; the numerical degree-one and degree-seven limits remain separated from shrinking-window RD under IID sampling and the stated bandwidth limits alone.

Historical component credits
  • Proved AronowAudit.P023.Wave1.sigmoid_counterexample_proof Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; This is the specified population witness component, not an assertion that all of Proposition 2 is false for this Lipschitz mean.
  • Proved AronowAudit.P023.Wave1.sigmoid_fit_criterion_proof Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; {'source': 'adjudication', 'decision': 'rejected', 'what': "P023/Wave1/Gap/GP023B1b.lean:1188 gives T4(v)'s irreducible risk 1/100, the fitted-risk upper bound 1/100+a^2*eta/3, the universal improvement bound, and the claimed conditional degree-seven coefficient formula. Requiring competitors to be measurable with integrable squared loss loses no predictor that can improve the finite fitted risk: infinite-risk predictors cannot improve it, and completion-measurable predictors have Borel versions with the same risk. The infimum in fittedRisk (P023/P023_Audit.lean:2714) is the actual least-squares risk of the finite-dimensional regressor span under this bounded probability law, whose minimum is attained. The restrictions noted by the reviewer do not remove a material case of the assigned fit component."}
  • Proved AronowAudit.P023.Wave1.sigmoid_sample_separation_proof Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; This covers fixed degrees one and seven under the one numerical law. The target's asymptotic content is unaffected by initial singular samples or finite bandwidth prefixes.
  • Proved AronowAudit.P023.sigmoid_rational_certificates Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; The population and fit rows already export the exact coefficients and improvement bound; no separate numerical certificate is needed.
  • Proved AronowAudit.P023.Wave1.uniform_residual_symmetry_proof Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Zero is correctly excluded: party(0)=1 prevents oddness there. The residual variance identities are in R147-03.

Appendix B, the step ‘E[u∣DemVot]≈0\mathrm E[u|DemVot]\approx0 and therefore E[β^OLS2]≈β\mathrm E[\hat\beta_{OLS2}]\approx\beta’, as printed; the witness (a margin distribution concentrated near ±12\pm\tfrac12, linear control) is the validators' construction and is not in the paper

p. 10 (PDF p. 10); Proposition 2 and its Remark, p. 7 (PDF p. 7)

p. 10 (PDF p. 10); Proposition 2 and its Remark, p. 7 (PDF p. 7). The clustered continuous positive-density family has continuous Lipschitz conditional means with odd centered parts and zero cutoff jumps, all the displayed moments and RD values, and a coefficient tending to minus one while the uniform zero-polynomial error tends to zero. At the numerical witness the coefficient, outcome bounds and error bound are as displayed. The constant and fitted predictors can be improved by at most the squared half-width by any measurable predictor, even one with infinite risk. Consequently no coefficient-error constant can be uniform over the stated laws.

Historical component credits
  • Proved AronowAudit.P023.Wave1.clustered_counterexample_proof Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; No law-uniform coefficient-error multiplier exists; the assertion does not claim a fixed-law failure as J grows.
  • Proved AronowAudit.P023.Wave1.clustered_fit_bound_proof Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; {'source': 'adjudication', 'decision': 'rejected', 'what': "P023/Wave1/Gap/GP023B2b.lean:647 states the constant predictor's risk as 1/100+E[h^2] and bounds its improvement over every measurable finite-risk predictor by (d/2)^2, matching T5(vi). Taking the competitor to be the bounded conditional mean gives E[h^2] <= (d/2)^2, and d=1/1000 gives the claimed 1/4000000 bound. Infinite-risk predictors cannot improve this finite baseline, while completion-measurable predictors have risk-equivalent Borel versions, so the competitor conditions are harmless. The additional family and fitted-risk conclusions preserve the fixed numerical claim."}
  • Proved AronowAudit.P023.clustered_bias_rational_certificate Historical support retained; baseline fidelity: ok; manifest: not used; not used in Solution; The clustered population row already exports the exact numerical population coefficient.

Proposition 2 with the assumptions Appendix B states for it (continuity of g()g() and f()f()), as printed; the witness (uniform margins and one continuous hh) is the settling validator's construction and is not in the paper

p. 7 (PDF p. 7) and p. 10 (PDF p. 10)

p. 7 (PDF p. 7) and p. 10 (PDF p. 10). For one fixed uniform margin law, logarithmic amplification yields one bounded continuous mean with diverging polynomial coefficients along increasing degrees and a vanishing RD limit; every continuous function satisfying the zero-at-cutoff, size-bound and growing-bias-subsequence conditions has no Lipschitz bound.

Historical component credits
  • Proved AronowAudit.P023.Wave1.continuity_only_counterexample_proof Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; {'source': 'adjudication', 'decision': 'rejected', 'what': "P023/Wave1/ContinuityCounterexampleTailC.lean:10 exports T6's logarithmic amplification asymptotic, continuous-function norm identity, and one fixed bounded continuous h with coefficients at least m/4 along strictly increasing degrees. It also states coefficient divergence along that subsequence, failure of convergence to zero, the RD limit zero, the outcome bounds, and absence of a Lipschitz constant. Representing Y=1/2+h(X) by its mean function is exact for this deterministic outcome, and total real functions restricted to [-1,1] represent the target function class without loss. The eventual absolute bound expresses O(1), and the increasing divergent subsequence implies the claimed infinite limsup; none of these conventions creates a material omission."}
  • Proved AronowAudit.P023.gliding_hump_finite_inequality Historical support retained; baseline fidelity: ok; manifest: not used; not used in Solution; Construction helper is internal to the complete fixed-mean witness.
  • Proved AronowAudit.P023.uniform_law_normalized Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; The normalization/support lemma is an auxiliary part of the uniform-law witness.
  • Proved AronowAudit.P023.central_binomial_wallis_bounds Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Supporting bound is internal to the complete continuity witness, not a separate clause of the target.

Appendix B, the step ‘E[u∣DemVot]≈0\mathrm E[u|DemVot]\approx0 and therefore E[β^OLS2]≈β\mathrm E[\hat\beta_{OLS2}]\approx\beta’, and the Remark to Proposition 2, as repaired by Sol: the exact identity for the coefficient error and its bounds

p. 10 (PDF p. 10) and p. 7 (PDF p. 7)

p. 10 (PDF p. 10) and p. 7 (PDF p. 7). Population and finite-sample residual formulas give the bias identities, approximation bounds, exact-specification and fixed-degree criteria, and the displayed uniform-law constants.

Historical component credits
  • Proved AronowAudit.P023.Wave1.corrected_population_bias_proof Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; {'source': 'adjudication', 'decision': 'rejected', 'what': "P023/Wave1/Gap/GLP023B3.lean:409 supplies the assigned T7(a)-(f) projection identities, positive residual variance, bias identity, both error bounds, amplification lower bound, exact-specification result, and fixed-degree criteria. Its FWL numerator uses the conditional mean under the margin law rather than Y under the joint law; ConditionalMean at P023/P023_Audit.lean:1119 equates these pairings by using a bounded measurable representative of the residual on the supported interval. Boundedness only on [-1,1] covers the whole supported domain, and allowing constant terms in exact polynomial specification includes the target's zero-constant case. The separate finite-sample and uniform-constant components are not part of this row's assigned population component."}
  • Proved AronowAudit.P023.Wave1.uniform_residual_constants_proof Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; The complete T7(h) constants are established; interpreting this auxiliary declaration as completion of T7(a)-(g) would exceed its stated scope. Record disagreement is classification only.
  • Proved AronowAudit.P023.finite_conditional_bias Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; {'source': 'adjudication', 'decision': 'rejected', 'what': "P023/P023_Audit.lean:2560 states exactly T7(g)'s assigned conditional-bias formula and positive residual denominator, with normalized P, full rank, margins in [-1,1], and the explicit d_i=I[x_i>=0] convention. An arbitrary normalized outcome law at each fixed design represents its conditional outcome law, so the absence of a random-margin conditional-expectation operator removes no conditional-bias case. The row covers the conditional-bias component, rather than claiming that this declaration alone supplies the preceding arbitrary-outcome FWL identities. No added material hypothesis or omitted conclusion within that component is present."}
  • Proved AronowAudit.P023.residual_bias_integral_identity Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; The population bias row already includes the residual bias identity.
  • Proved AronowAudit.P023.residual_uniform_error_bound Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; The population bias row already includes the uniform bound.
  • Proved AronowAudit.P023.residual_rms_error_bound Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; The population bias row already includes the RMS bound.
  • Proved AronowAudit.P023.residual_amplification_lower_bound Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; The population bias row already includes the amplification lower bound.

Proposition 2, as repaired by Sol and the settling validator: a fixed law with a density bounded below near the cutoff and a Lipschitz smooth part

p. 7 (PDF p. 7); proof in Appendix B, p. 10 (PDF p. 10)

p. 7 (PDF p. 7); Appendix B, p. 10 (PDF p. 10). Under the stated finite-second-moment IID, local density domination, Lipschitz mean, bounded local conditional variance and shrinking-bandwidth assumptions, all the positive-definite moment, residual-variance, zero-constant polynomial approximation, population bias, fixed-degree, RD and growing-degree conclusions (a)–(g) hold, including existence of a slow degree schedule. The smallest moment eigenvalues and residual normalizations are positive. No separate singular-design or empty-window probability assumptions are required.

Historical component credits
  • Proved AronowAudit.P023.Wave1.corrected_proposition2_proof Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; {'source': 'adjudication', 'decision': 'rejected', 'what': "P023/Wave1/Gap/GLP023B4c.lean:3037 exports all corrected T8(a)-(g) conclusions, including the zero-constant polynomial, population rate, fixed-degree and RD limits, growing-degree tracking, and existence of a valid degree schedule. RepairedRegularity at P023/P023_Audit.lean:1367 contains the target's own primitive assumptions, with local variance expressed equivalently through integrals over all local Borel sets. Positivity at every bandwidth index only constrains an immaterial finite prefix, and the outer-probability formulation in ConvergesInProbability (P023/P023_Audit.lean:1337) agrees asymptotically with a measurable OLS extension because singular-design probabilities vanish under the stated conditions. These are representation and extension conventions, not additional substantive restrictions on the corrected claim."}
  • Proved AronowAudit.P023.repaired_rate_from_finite_bounds Historical support retained; baseline fidelity: ok; manifest: not used; not used in Solution; Supporting result is already subsumed by the complete corrected proposition; it is not added as a hypothesis or separate claim.
  • Proved AronowAudit.P023.central_binomial_lower_bound Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Supporting result is already subsumed by the complete corrected proposition; it is not added as a hypothesis or separate claim.
  • Proved AronowAudit.P023.Wave1.density_residual_comparison_proof Historical support retained; baseline fidelity: ok; manifest: not used; not used in Solution; Supporting result is already subsumed by the complete corrected proposition; it is not added as a hypothesis or separate claim.
  • Proved AronowAudit.P023.Wave1.jackson_kernel_approximation_proof Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Supporting result is already subsumed by the complete corrected proposition; it is not added as a hypothesis or separate claim.
  • Proved AronowAudit.P023.repaired_rd_finite_bounds Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Supporting result is already subsumed by the complete corrected proposition; it is not added as a hypothesis or separate claim.
  • Proved AronowAudit.P023.iid_window_count_bound Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; Supporting result is already subsumed by the complete corrected proposition; it is not added as a hypothesis or separate claim.
  • Proved AronowAudit.P023.Wave1.iid_regression_matrix_bounds_proof Historical support retained; baseline fidelity: ok; manifest: not used; not used in Solution; Supporting result is already subsumed by the complete corrected proposition; it is not added as a hypothesis or separate claim.
  • Proved AronowAudit.P023.repaired_population_rd_limit Historical support retained; baseline fidelity: ok; manifest: not used; not used in Solution; Supporting result is already subsumed by the complete corrected proposition; it is not added as a hypothesis or separate claim.

Appendix A, proof of Proposition 1: the display after ‘Therefore,’, with the summation index corrected from i∈Ubi\in U_b to it∈Ubit\in U_b

p. 9 (PDF p. 9)

p. 9 (PDF p. 9). The corrected pair-indexed Appendix A formula partitions the observed pairs into bins, annihilates the demeaned party indicator outside the central bin, and gives the positive-denominator localized OLS ratio.

Historical component credits
  • Proved AronowAudit.P023.corrected_appendix_pairs Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; The corrected sum runs over election pairs, and Condition1 ensures strictly positive central residual information.

Section 1, last paragraph (‘all flexibly specified … mathematically equivalent to studies of close elections’; ‘rely solely on data from close elections’), with Section 3.2, last paragraph, and Section 5, first two sentences, as printed

p. 3 (PDF p. 3); p. 7 (PDF p. 7); p. 8 (PDF p. 8)

The printed claim is false: P023-T10; p. 3 (PDF p. 3); p. 7 (PDF p. 7); p. 8 (PDF p. 8). The universal localization assertion for positive-degree polynomial vote-share controls fails, while coarsened OLS coefficients agree for outcomes agreeing on the close elections when both close-window counts are positive.

Historical component credits
  • Counterexample proved AronowAudit.P023.printed_polynomial_localization_refuted Historical support retained; baseline fidelity: ok; manifest: not used; not used in Solution; Its negated universal includes degree zero and cannot directly establish the strengthened positive-degree refutation; the credited degree-one witness supplies that refutation.
  • Proved AronowAudit.P023.coarsened_localization Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; This proves the positive coarsened component of T10; no polynomial localization is inferred.

Proposition 1

p. 6 (PDF p. 6); Conditions 1–3 on p. 5 (PDF p. 5); proof in Appendix A, p. 9 (PDF p. 9)

Proposition 1, p. 6 (PDF p. 6); Conditions 1–3, p. 5 (PDF p. 5); Appendix A, p. 9 (PDF p. 9). For finite two-party election data with margins in [-1,1], binary win indicators agreeing with the signs of nonzero margins, bandwidth 0 < k < 1, and the two strictly interior observations required by Condition 1, both party counts in U_b = (-k,k] are positive. Every least-squares solution of the all-election regression with an intercept, the win indicator, and the printed width-2k bin indicators of Condition 2 has win coefficient equal to the degree-zero, rectangular-kernel RD difference in means of Condition 3. Ties may have either binary indicator and nuisance bins may be empty. All sums here are finite.

Historical component credits
  • Proved AronowAudit.P023.proposition1 Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; The printed-design all-solutions theorem directly states Proposition 1; the equivalent bin parametrization is not required separately.
  • Proved AronowAudit.P023.printed_coarsened_proposition1 Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; This is the printed finite-sample identity for arbitrary outcomes and every OLS solution, including singular nuisance designs. No claim-stage change.

Proposition 2, with its Remark and the proof in Appendix B as printed

p. 7 (PDF p. 7); equation (2) on p. 6 (PDF p. 6); Appendix B, p. 10 (PDF p. 10)

p. 7 (PDF p. 7); equation (2) on p. 6 (PDF p. 6); Appendix B, p. 10 (PDF p. 10). The adopted fixed-law reading of Proposition 2, formalized in PrintedPropositionTwo, fails: RD consistency together with the assertion that, for each positive tolerance, every sufficiently large fixed polynomial degree gives an estimator difference converging to a population bias below that tolerance. The formal hypotheses include IID sampling, finite second moments, nondegenerate population moments, local support, and explicit usual-RD regularity; the moment guards are additional formal assumptions.

Historical component credits
  • Counterexample proved AronowAudit.P023.Wave1.printed_proposition2_refuted Historical support retained; baseline fidelity: ok; manifest: used; used in Solution; This is the literal negation of the entire type of printed_proposition2 at the same universe level, not merely a witness lemma or a negation of a Lipschitz repair. The target itself supplies the precise fixed-law reading, so acceptance does not depend on the record calling that reading approved. Extra regularity premises do not weaken a refutation when the bad law satisfies them. The auxiliary bad-mean statement gives a single continuous h with unbounded coefficient subsequence, so the failure concerns the claimed eventual-in-degree bound. No claim-stage change.
  • Proved AronowAudit.P023.appendix_rewriting Historical support retained; baseline fidelity: ok; manifest: not used; not used in Solution; Algebraic step of the printed proof is unnecessary for the complete refutation of the adopted fixed-law reading.
  • Proved AronowAudit.P023.appendix_smooth_zero Historical support retained; baseline fidelity: ok; manifest: not used; not used in Solution; Cutoff normalization helper is unnecessary separately from the complete reading refutation.
  • Proved AronowAudit.P023.appendix_smooth_continuous Historical support retained; baseline fidelity: ok; manifest: not used; not used in Solution; Continuity helper is unnecessary separately from the complete refutation of the adopted fixed-law reading.
  • Proved AronowAudit.P023.weierstrass_without_constant Historical support retained; baseline fidelity: ok; manifest: not used; not used in Solution; Polynomial approximation alone does not establish coefficient consistency; the credited theorem already refutes the complete adopted fixed-law reading.

Reproduction

What I recalculated or reran from public materials. "Agrees", "Agrees in part" or "Disagrees" compares my result with the printed one. "Not compared" means the comparison could not be made.

Status
Selected recalculation
Agreement
Agrees in part
Reported results that were targeted
TargetWhereMethodStatusAgreement
Table 1p. 8 (PDF p. 8)I recalculated the eight printed specifications from the 10 April 2014 Caughey–Sekhon data. Rows (b), (d), (e) and (g) agree to rounding on 8,610 complete elections; the source study’s Use=1 restriction reproduces (a) and (c) but changes (b). Neither sample reproduces all rows, and the triangular-kernel estimates differ (P023-E003). The paper’s analysis code and exact sample rule are unavailable. This agreement uses the outcomes as recorded in that release. Four next-election outcomes are one hundredth of their linked percentages; replacing them lowers rows (d), (e) and (g) to 9.32, 9.32 and 10.40 points as a sensitivity calculation. The correctness of those links and their historical use remain unverified (P023-E004).RecalculatedAgrees in part
Introduction: close-election prevalencep. 1 (PDF p. 1), Introduction, first paragraphI counted 103 recorded close elections among 13,923 elections in 1944–2006, a share that rounds to 0.7% rather than 0.6%. This is a lower bound for the full close-election share; 587 missing margins prevent an exact full-election count (P023-E005).RecalculatedDisagrees