Subject: Re: [EL] reviews of local election administration quality, compliance
From: Vassia Stoilov
Date: 2/21/2011, 12:01 PM
To: Paul Gronke <paul.gronke@gmail.com>, Doug Hess <douglasrhess@gmail.com>
CC: election-law <election-law@mailman.lls.edu>

Doug:

I few years back (in 2009), I did some research on election  performance standards at the state and local levels to see if there was anything comparable in spirit to the federal level performance evaluation efforts (namely those driven by the Government Performance and Results Act (GPRA) and the Program Assessment Rating Tool (PART)). In the research, I used
GPRA and PART's conceptualizations of performance assessment (i.e. the setting up of clear agency/program goals as well as performance measures to track their progress, which are reported at regular intervals of time).



What I found at the time (and this may have changed since 2009) is that:


1. At the state level, state boards of elections issue annual reports that contain statistical data about election activities that report on the number of voting machines in use, the number of problems reported during the year, the length of interruptions in the voting process, the number of registered voters by party, demographic characteristics, or by source of registrations (such as department of motor vehicles, public assistance agencies, etc.).  Virginia, in particular, has built a fairly elaborate overall performance and accountability system, Virginia Performs, and has included the management of elections in the performance evaluation effort.

2.At the county level is where we can find performance measures, similar to those that one might expect to see in a GPRA or PART report, that track the performance of county boards of elections. Looking at a survey of performance standards used by counties, one can make the following conclusions:

  1. Performance goals and measures used by counties in different states vary, but there are some common goals. Some goals are very concrete whereas others are broad. States’ election laws and practices differ and these differences are reflected in the performance goals and standards set by their counties. Some goals resonate across counties in different states, such as providing or increasing voter registration. Furthermore, outcomes/goals vary in terms of how vague or how concrete they are. An example of quite concrete performance goals are those of Fairfax County, Virginia, such as “to provide the legally mandated one voting machine for each 750 registered voters in each precinct with a minimum of three voting machines per precinct and a countywide average of 4.91 voting machines per precinct.” In contrast, New York’s Schuyler County uses the broad goal “ability to fully staff all polling with well trained, knowledgeable election inspectors.”
  2. Performance goals and measures used by counties within the same state also vary. Counties finance the conduct of elections and seem to be determining what outcomes they hope to achieve and how to measure their performance not only across states, but also within states. Counties within the same state may use different performance goals and measures (see North Carolina’s Randolph and Wake counties). Considering this and the previous conclusion as well as the fact that there are about 3,100 counties, it is reasonable to assume that there could possibly be 3,100 different sets of performance goals and measures.
  3. Performance goals and measures used by the same county can change from year to year. For example, the Randolph County Elections Office specifies in its annual report that beginning with the 2005-06 fiscal year, the measure for their goal “to alleviate crowded conditions at polling places on Election Day” will change from “percent of votes cast reconciled with number of voters on Canvass Day” to “number of voters participating in one-stop voting” since it was deemed that the former did not actually measure the goal. Similarly, beginning with the 2005-06 fiscal year, the goal “to inform voters of changes in absentee laws and requirements”  and measure “percent of advertisements which were placed in local media as directed by NC General Statutes” changed to “to inform voters of one-stop voting opportunities” and the measure to “number of local newspapers publishing articles on one-stop voting.” The goal was replaced since informing voters of changes in absentee laws and requirements are required by law and thus, are always done.

 4.              4. Counties and city governments play the central role in assessing election administration performance. The reviewed                         performance assessments appear to be part of annual reports and annual budgets issued by county or in some cases (as in the case of                 Minneapolis City) by city governments.  


Hope the above can be of some assistance!


Best,

Vassia



From: Paul Gronke <paul.gronke@gmail.com>
To: Doug Hess <douglasrhess@gmail.com>
Cc: election-law <election-law@mailman.lls.edu>
Sent: Mon, February 21, 2011 2:18:32 PM
Subject: Re: [EL] reviews of local election administration quality, compliance

Doug

I'm sure you'll get other answers, but here are some reactions.

First, of course, we can repeat the constant call for some sort of comparable metric of policy performance by election officials.  We have performance measures for many aspects of state and local governance, but elections have been lagging. 

This may be because, unlike many areas, there is no agreed upon metric. For instance, if the goal is to deliver a given level of educational services and a given level of expenditure, we can measures outcomes (test scores, graduation rates) against inputs.  In the corrections field, we similarly have generally agreed upon measures of recidivism and, more controversially, crime rates, against spending on public safety, sentencing provisions, prison practices.

For elections, what is the metric?  Costs per vote?  Turnout?  Non-contested election outcomes?  I realize this is redundant to write to this readership, but finding a politically agreed upon metric for this most fundamental of political activities is ... political!  And very hard to do.

Compare the kind of analyses available at the state policy and performance project: http://www.pewtrusts.org/our_work_category.aspx?id=352

I don't think things are all bad, however.  There are initiatives underway and the data quality in 2011 is far superior to what was available in 2001. 

I think the EAVS (EAC's Election Administration and Voting Survey) is a good starting point.

The Election Center has started a benchmarking task force, and Pew's Elections Initiatives has a Performance Index project underway. 

In terms of existing resources, the CRS, under Erik Fischer's guidance, funded at least two national surveys of elections officials (I am not sure if the data are publicly available).  Pew funded a number of surveys of local election officials (Wisconsin, Georgia, Colorado).  Finally, there is a national survey of election performance conducted by the Voting Technology Project, also under Pew's aegi.

I have had conversations with people about taking advantage of election incidence databases, such as those collected by the Brennan Center.  The issue here is that these rely on self-reporting.  If you browse some of these databases, you'll realize that there is a tremendous number of false negatives--citizens reporting a "problem" that is well within legal bounds.

Hope that gets you started!


---
Paul Gronke                Ph:  503-517-7393
                          Fax: 734-661-0801

Professor, Reed College
Director, Early Voting Information Center 3203 SE Woodstock Blvd.
Portland OR 97202

EVIC: http://earlyvoting.net



On Feb 21, 2011, at 7:34 AM, Doug Hess wrote:

> Hi,
>
> Three related questions that different list-members may have thoughts on:
>
> 1) I'm looking for general reviews (academic articles and papers, as
> well as government reports or advocacy reviews, etc.), literature
> summaries, or even reference sections/bibliographies of the quality of
> local election adminstration. Essentially, what do we know about the
> degree of variation across a state or the nation in quality? How has
> that changed with time? Does GAO or CRS report on this in a general
> way on occaision? I know there are lots of studies/reports on
> particular problems (or that reveal variation in compliance quality,
> such as ID requirements), but any general reviews or broader
> summaries?
>
> 2) I know, or assume, no general index has been developed (no?), but
> are there any past reports on what problems exist, their source or
> cause, and where things stand on those issues? Is there a survey of
> problems?
>
> 3) Data: Do any of the EAC surveys include questions that would
> reflect the identification of compliance problems by local offices?
> (I'm most familiar with the NVRA questions in the survey, but not some
> of the other elements.)  What different databases of voter reported
> problems exist, or summaries of these reports?
>
> I know that's a tall request, but I'm just looking for some documents
> to skim for background on the general "state of things."  Thanks.
>
> Doug Hess
> 202-277-6400 (cell)
> _______________________________________________
> election-law mailing list
> election-law@mailman.lls.edu
> http://mailman.lls.edu/mailman/listinfo/election-law