Psephology and Technology, or: The Rise and Rise of the Script-Kiddie


1    Introduction

psephology and technology

Download this text as PDF

From its very beginnings, psephology has been at the forefront of methodology and has sometimes pushed its boundaries (see e.g. King, 1997 on ecological regression). Methods such as factor analysis or logistic regression, that were considered advanced in the 1990s, are now part of many MA and even BA programs. Driven by the proliferation of fresh data and the availability of ever faster computers and more advanced, yet more user-friendly software, the pace of technical progress has once more accelerated over the last decade or so. Hence, and somewhat paradoxically, this chapter cannot hope to give a definitive account of the state of the art: The moment this book will ship, the chapter would already be outdated. Instead, it tries to identify important trends that have emerged in the last 15 years as well as likely trajectories for future research.
More specifically, the next section (2) discusses the general impact of the “open” movements on electoral research. Section 3 is devoted to new(ish) statistical methods – readily implemented in open source software – that are necessitated by the availability of data – often available under comparably open models for data distribution – that are structured in new ways. Section 4 is a primer on software tools that were developed in the open source community and that are currently underused in electoral research, whereas the penultimate section discusses the double role of the internet as both an infrastructure for and an object of electoral research. Section 6 summarises the main points.

2    Open Source, Open Data, Open Science

Like many other subfields in the social sciences, psephology is heavily affected the rapid progress in computer and information technology. The two most significant developments in this respect are the twin open-source and open-data revolutions. Open source software has its roots in  the  free  software  movement  of  the  1980s  (Lakhani and Hippel, 2003), a rebellion against increasingly more restrictive software licences that, amongst other things, aimed at patenting algorithms and banned the “reverse engineering” of software installed on private computers. Proponents of the free software movement, on the other hand, made their software available for free (“free as in free beer”) and gave everyone and anyone the licence to modify their programs as they saw fit (“free as in free speech”), which required laying open the source code. The spread of the internet in the 1990s then facilitated large-scale collaboration on free software projects and gave rise to the current idea of open source software that is embodied in Raymond’s (1999) manifesto “The Cathedral and the Bazaar”, which emphasises the idea of distributed and only loosely co-ordinated teams as a strategy for quick and efficient development.
Whereas the free software movement had a certain anti-establishment bent, many of the largest and most successful open source projects, such as the Linux operating system, the Apache web server or the Firefox browser series, which collectively power much of the current internet, are happy to rely on the support of corporate backers who donate money, resources, and the time of some of their staff. In other instances, large companies have even created open “community editions” of their existing programs, or designed them as open source applications in the first place (Google’s Android operating system). Companies may do this to raise their profile, or in order to attract the best software engineers for their commercial projects, but two other motives are more interesting: They may want to use the open source software instead of a closed-source alternative to generate and deliver their own products (e.g. tech companies relying on Linux for running their server farms), or they may offer a service that is based on the open-source software (professional support or hosted versions). Either way, corporate support for open source makes commercial sense – neatly illustrating Olson’s (1965) argument about big players rationally investing in public goods – because open source is a, as Raymond suggests, a highly efficient model for organising large projects: It incorporates feedback from the user base almost instantaneously and turns the most capable and committed users into developers.
Open source is highly relevant for psepholog not only because it helped to build much of the internet infrastructure and some key tools – R (Ihaka and Gentleman, 1996; Crawley, 2013), Python (Lutz, 2013), and a plethora of others – but also because it has become the template for other “open” revolutions that impact on electoral research. In the broadest sense, open  data  refers  to  the  idea  that  research  data,  or data that could be used for research,  should be as accessible as possible.  As such, it is old news. In the quantitative social sciences, data archives such as the Roper Center ( or Michigan’s Survey Research Center (, which collect, archive, and  disseminate  existing data for secondary analyses, were established in the late 1940s. Patterns of co-operation and exchange between (European) archives were formalised with the formation of the Council of European Social Science Data Archives (CESSDA, in the 1970s (Karvonen and Ryssevik, 2001, p. 45). In the public sector, one could argue that the practice of frequently publishing detailed information on key national statistics that was already well established in the late 19th century marks the beginning of open data. However, it was the key ingredients of the open source revolution – transparency, active involvement of the user base, and almost zero marginal transaction costs – that in the 2000s began to transform the production and use of data in unprecedented ways. Unless access is restricted for reasons of data protection, researchers no longer have to travel to a data archive to use a given data set, and for the distribution of data, physical media haven been all but abolished. Governments, large-scale research projects, and individual scholars are now opening up their raw data for download. Some agencies and some of the biggest internet companies (e.g. Google, Facebook, Twitter, and Yahoo) have even created application programming interfaces (APIs, see section 5.1) that give researchers the opportunity to access these data programmatically from a script.
The open data revolution has brought about some new problems of its own. While the body of data available for research is growing exponentially, researchers still have to know where and how to look, and the lack of a central repository and common interfaces seriously hampers progress. To be useful, data need to be stored, and, even more importantly, described and licenced in standardised ways that make them accessible and retrievable in the medium-to-long term. This, in turn, requires institutions that can be trusted, and that need funding. Moreover, the pressure on researchers to open up their own data is growing. Research councils now regularly make the deposition of research data and even the open access publication of the findings a precondition for funding. Similarly, more and more journals require that not only the data set itself but also the program code that generates the tables and graphs must be published along with thefinal article in some repository (see section 5.1).1 While such rules reinforce traditional scientific standards of honesty,  transparency,  and  reproducibility,  many  researchers are still anxious that they will be scooped if they are forced to reveal their data and methods at the beginning of a new project. Presumably due to the prevailing incentive structure, few social scientists currently adhere to the open source mantra of “release early, release often.” Others, however, embrace the ideal of a (more) open science by posting work-in-progress on their personal homepages, opening draft chapters on social network sites for scientists, or even by moving their data and manuscripts to open source development sites such as Github, which could in theory provide an ideal environment for scientific collaboration.

3    Data, Statistical Models, and Software

3.1    Complex Data Structures and Statistical Models

Pure formal theory and simulation exercises aside, all electoral research rests on data: a body of systematic and usually quantified observations that can be used to test assumptions about the ways in which citizens, politicians, organised interests, and the media interact and thereby affect political decisions. While early studies emphasised the importance of macro factors (Siegfried, 1913) and of clustered sampling and mixed methods (Lazarsfeld, Berelson, and Gaudet, 1944), the lasting influence of the American Voter (Campbell et al., 1960) has led many researchers to focus on micro-level data coming from nationally representative samples of mass publics for much of the 1960s, 1970s, and 1980s.
But theory suggests that credible (or at least plausible) accounts of human behaviour must encompass not just the individual (micro), but also the societal (macro) level, and ideally various “meso” layers and structures in between (see Coleman,  1994 for the general line of reasoning and Miller and Shanks, 1996 for an application to election studies). The thrust of this argument eventually led to a renewed interest in contextual variables and their effects (Jennings, 2007, pp. 35–38).  From the late 1990s and early 2000s on,  national election studies and comparative surveys alike began to include territorial identifier variables such as electoral district codes in their datasets. Using this information, it is possible to match data on individual respondents with government figures on the economy, on migration, and a whole host of other variables that can
1Pre-registration, a procedure that is becoming more prevalent in the Life Sciences and whose adoption in Political Science is now being discussed (Monogan, 2015), goes on step further by demanding that researchers submit sampling plans, outlines of the intended analyses, and mock reports to a journal that are peer-reviewed before they even begin to collect new data.

plausibly affect voting behaviour, while Multi-Level regression (see chapter 47) is a convenient tool for estimating the size of the alleged effects and their associated standard errors. Supplementing micro-level information with contextual variables leads to “nested” data, where each level-1 unit (respondent) belongs to one (and only one) level-2 unit (electoral) district. Each level-2 unit may in turn be part of one (and only one) level-3 unit (say, a province), resulting in a tree-like structure.
Multi-Level regression modelling with contextual covariates derived from official sources has become almost the de facto standard for analysing both large-scale comparative data sets (see chapter 48) and case studies of nations for which sub-national data are available. While the technique provides asymptotically correct standard errors and opens up a number of flexible modelling options (see section 3.2.1), it is no panacea. When nations are the relevant contexts, their number is often too low for Multi-Level Modelling (Stegmueller, 2013), and one may well ask if it makes sense at all to treat countries as if they were a random sample from a larger population (Western and Jackman, 1994). Comparing political behaviour within subnational units across nations is more informative and often more appropriate, but suffers from specific limitations, too: Even within the European Union’s complex and comprehensive system for the Nomenclature of Territorial Units for Statistics (NUTS, see Eurostat, 2015), subnational units that are supposed to be on the same level may differ vastly in terms of their size, population, and political, social and cultural relevance.2
Moreover, the integration of government statistics as regressors into a Multi-Level Model does not nearly exhaust the complexity of data that are now available for analysis. Building on earlier work by Lazarsfeld and Menzel (1961), Hox (2010) has developed a useful typology that clarifies the possibilities. On each level, there are global variables, which reflect inherent properties of the objects on the respective level. They are inherent in so far as they can neither be constructed by aggregating features of lower-level objects, nor by disaggregating features of higher-level contexts. Traditional (statistical) models of voting behaviour have focused on global variables at the indvidual level (level 1): an invidual vote for the Democrats is linked to the voter in question being female,
2NUTS-1 corresponds to the 16 powerful federal states in Germany, to clusters of provinces, states, or communities that have been grouped together for purely statistical purposes in Austria, Spain, and the Netherlands, and does not exist at all in many of the smaller countries (e.g. Croatia, Denmark, Luxembourg, or Slovenia). The lower-tier NUTS-2 level is equivalent to the federal states in Austria, the autonomous communities in Spain, the Regions in France, and the Provinces in the Netherlands, which all have their own elected assemblies. In other states such as Bulgaria, Finland, Germany, Romania, or Slovenia, NUTS-2 areas exist solely for the purpose of national planning and attracting EU funding, and citizens will be unaware of their existence. Similarly, NUTS-3 may be a district (Germany), a group of districts (Austria), a province (Denmark, Spain, Italy), a region (Finland), a statistical region (Slovenia), an island (Malta), or may not even exist (Cyprus, Luxembourg).

Level    1    2    3    . . .
Type of variable    global    →    analytical
relational    →    structural
contextual    ←    global    →    analytical
relational    →    structural
contextual    ←    global    →
relational    →
contextual    ←
→: Aggregation
←: Disaggregation
Source: Adapted from Hox (2010, p. 2)
Figure 1: A Typology of complex data structures

unemployed, and identifying as a Democrat. A prototypical Multi-Level Model would add the unemployment rate and the ethnic composition of the electoral district as level-2 regressors. These are analytical variables, which are created by aggregating global features of the lower-level units to form upper-level averages, ratios, or percentages. As a corollary, these variables can enter the model simultaneously on multiple levels (see section 3.2.1).
Other properties of the district may also be meaningful additions to the model, but they cannot be understood as an aggregation of individual-level qualities or disaggregation of higher-level features and are hence global variables at the district level. Gender and political experience of the main candidates are cases in point. Because there is no variable at the lowest level that would correspond to them, they are strictly contextual for individual voters and can enter the model only once, at the upper level.
Finally, relational data convey information regarding the ties (e.g. presence and intensity of face-to-face contacts) between objects on the same level. Such network data are crucial for any micro-sociological explantation of voting behaviour: Obviously, a person that is the hub of a Democratic clique of friends is more likely to turn out to vote, and to vote in accordance with her peers than someone who is socially isolated. Like global/analytical variables, network data can enter a Multi-Level Model simultaneously on multiple levels: Information on relations between individual voters within a district may be aggregated to form structural variables at the upper level, e.g. to compare districts with dense/sparse or homogeneous/fragmented communication networks.
Network data are extremely attractive in theory. But they introduce an additional level of complexity and require specialised statistical methods, because a tie by definition

involves two actors (see section 3.2.3). In addition, the collection of relational data necessitates specific (cluster) sampling plans, because a large number of the members of a given network needs to be surveyed to assess the properties of the network itself. This, in turn, raises issues of representativeness, data confidentiality, and cost-effectiveness and goes against the dogma of the nationally representative sample.
Election surveys sometimes contain items refering to so-called egocentric networks,
e.g. they might ask the respondent how many people she talks politics with, whether these are friends, family members, or just acquaintances, and how often she disagrees with them. But this information will be biased by the respondent’s perceptions and provides only a fractional glimpse into the full network, as normally not even the ties amongst the respondent’s immediate contacts can be reliably recovered.
As a readily available alternative, students of electoral behaviour are now turning to social media, where large and mostly complete political communication networks can be sampled and observed with ease. Just how well insights from these networks generalise to offline behaviour and the voting population as a whole is a different question. Either way, statistical procedures for analysing social networks are currently in the process of becoming part of the tool kit for electoral research.
Besides Multi-Level and network data, the use of spatial or geo-referenced data is another emerging trend in electoral studies. A geo-reference is simply a set of coordinates that locate an object in space. Coordinates can either define a point or an area (polygon). In the most simple sense, the territorial identifiers mentioned above record that a voter is living in a given (usually large) area and hence are geo-references, too. More precise coordinates for voters (e.g. census blocks, ZIP code segments, electoral wards, street addresses, or even GPS readings), however, allow researchers to locate voters within much smaller contexts, for which census and market research data – in other words, global and analytical variables that can be integrated into a Multi-Level Model of electoral choice – may be available. Whilst many researchers are familiar with the idea of coarse geo-references, the availability of very fine-grained data as well as the growing awareness of spatial dependencies necessitates specialised software and models for the proper analysis of geo-referenced data (see section 3.2.4)

3.2    Statistical techniques and software implementations

3.2.1    Multi-Level Models and Structural Equation Models

As outlined above, students of electoral behaviour routinely collect data that, reflecting the Multi-Level nature of the underlying theoretical explanations, exhibit complex structures. Statistical Multi-Level Models, which are also known as “mixed models” or “random coefficient models” are the most adequate means to deal with such data.

They account for the correlation of unmeasured disturbances within a given context and hence provide correct standard errors for the effects of macro-level variables. Moreover, they model context specific disturbances in the most efficient way possible by treating them as random. This is best illustrated with an example: In a study of N voters living in K electoral districts that aims at explaining individual turnout, one could try to capture the effects of unmeasured district-level variables (say local social capital) by introducing district specific intercepts (dummy variables). But this strategy has negative consequences for the identification of the model and becomes inefficient and impractical very quickly as the number of districts which are sampled grows (Steenbergen and Jones, 2002). A statistical Multi-Level Model will replace the K-1 estimates for the local intercepts with a single estimate of their variation over districts (a random intercept) and thus dramatically reduces the number of parameters.
Moreover, Multi-Level Models also provide for a number of additional advanced modelling options. If there are good reasons to believe that the impact of an explanatory variable (say ideology as measured by left-right self-placement) on turnout will vary considerably across the K districts, the analyst can specify a random effect for this variable, which supplements the estimate for the average effect of ideology (the traditional point estimate) with an estimate of its variation. As the name implies, random effects are adequate if the variation in the effect of an independent variable can plausibly be treated as random.
If, on the other hand, the impact of a variable varies in a systematic fashion, this can be modelled by specifying a cross-level interaction, e. g. between ideology (a micro-level variable) and the number of candidates standing in the district. Cross-level interactions need not be confined to variables that are as conceptually different as the two in this example. On the contrary, theory often suggests that a variable such as unemployment could in essence interact with itself, albeit on different levels, hence entering the model thrice: as an individual feature (a global variable on the micro-level), as an analytical variable (the unemployment rate on the district-level), and as an cross-level interaction between the two. A high unemployment rate may reduce the propensity to participate in an election for all citizens, and individual unemployment status will normally depress turnout in an even stronger fashion. But this micro-level effect may well be confined to low-unemployment level environments, whereas individual unemployment  may have no such negative impact or even increase the likelihood of voting in districts where the high unemployment rate attracts community organisers and other political entrepreneurs. Multi-Level Models are ideally suited for disentangling such complex causal relationships.
They can also deal with complexly structured political contexts  that  may  have many tiers (voters within households within wards within municipalities within districts

within provinces . . . ), and that may cross-cut and overlap instead of forming a neat, tree-like hierarchy: A voter is not just affected by the characteristics of the electoral district she is living in but has been politically socialised in completely different surroundings. Whilst Multi-Level Models can accommodate such complex structures, convergence will generally be slow, and estimates may be unstable. As with all other aspects of modelling,  analysts  should  therefore  strive  for  parsimony.  If  the  there are not variables at the higher levels and if the objective is simply to reflect the multi-stage nature of the underlying sampling process, traditional survey estimators or even Huber-White standard errors that account for clustering may provide a fast and robust alternative to a fully specified Multi-Level Model.
Having said that, Multi-Level Models are a very flexible tool, as contexts need not be defined in spatial terms. For the analysis of panel data, it often makes sense to think of individual respondents as “contexts” for the interviews conducted in successive panel waves. Particularly when panel data are imbalanced or collected at irregular intervals, Multi-Level models can alleviate some of the problems that plague the traditional approaches to panel data.
Another statistical technique that has become indispensable for students of electoral behaviour is Structural Equation Modelling (SEM). SEM is an extension of traditional factor analysis that lets researchers specify multi-indicator measurement models for otherwise unobservable (=latent) theoretical constructs such as political attitudes.  It is attractive, because it can simultaneously estimate coefficients for whole systems of equations, and because it can incorporate measurement models for attitudinal variables that account for relatively unreliable  indicators.  If  the  measurement  models  hold, SEM can also provide unbiased estimates of the equally unobservable, “structural” relationships amongst the latent variables. Given adequate data, it is possible to map a whole system of constructs and hypotheses about their relationships onto an equivalent system of equations.
In the past, its application in election studies was somewhat limited by the fact that they required measurements on a continuous scale that were distributed multivariate normal, whereas the key dependent variable in election studies as well as many relevant independent variables are categorical and usually distributed with considerable skew. In the 1990s, however, new estimators were developed that can accommodate non-normally distributed continuous data. In addition, generalisations of the original model allow for ordinal and nominal indicator variables and even for categorical latent variables (Jöreskog, 1990; Jöreskog, 1994; Muthén, 1979; Muthén, 2002). Moreover, Multi-Level Models and Structural Equation Models are closely related (Muthén, 2002; Skrondal and Rabe-Hesketh, 2004) and can be combined to form Multi-Level Structural Equation Models.

Until recently, the estimation of Multi-Level or Structural Equation Models required specialised (if relatively user-friendly) software: HLM or MLWin for Multi-Level Modelling, LISREL, EQS, or AMOS for SEM, and MPlus for either. This is no longer true: Recent versions of Stata – currently the most popular general purpose statistical package in political science – can estimate all but the most complex Multi-Level and Structural Equation Models and so greatly extend the potential user base of these techniques. SPSS, another popular package, has some Multi-Level capabilities and works closely with AMOS, an SEM software that SPSS Inc. acquired in 2003 before it was in turn bought by IBM in 2009.
Perhaps more importantly, there are packages available for the R programming language that provide similar features: Lme4 and Rstan for Multi-Level Modelling, and Lavaan and Sem for SEM. While they may be slightly less capable, slower, and generally more clunky than the commercial software, they are, like any other R-package and the core of the language itself, open source and freely available for almost any combination of hardware and operating system. Moreover, while they may lack professional documentation and customer service,  they are supported by a global community of enthusiasts, scriptable in a fully-fledged programming language with flexible data structures, and tie into the ever growing eco-system of more than 6000 user-written packages for R that aim at implementing the latest developments in statistics.

3.2.2    Bayesian methods

Most electoral researchers were trained within a “frequentist” framework of statistical reasoning that relies on the idea of a random sampling process that could be endlessly repeated under essentially identical conditions. So far, they have shown only modest interest in the (sometimes exaggerated) benefits of an alternative statistical framework: Bayesian statistics (Jackman, 2004). There are at least two causes for this inertia: The frequentist paradigm closely resembles the pattern of taking national large-scale random samples of the general population that has been the workhorse of election studies for most of the last seven decades,  and in such large samples Bayesian and frequentist estimates will normally closely resemble each other.
But whether applied researchers like it or not, the ever more popular Multi-Level Models are Bayesian models at their core (Gelman and Hill, 2007). While many political scientists still have some reservations regarding the underlying paradigm (or might be blissfully unaware of it), Bayesian statistics keeps making inroads into electoral research. There are a number of reasons for this. First, Bayesian models can sometimes be tailored to a problem for which no off-the-shelf frequentist solution has been implemented in any statistical package. Models that aim at predicting the distribution of seats in parliament from a rolling series of published opinion surveys are case in point.  Second, Bayesian

statistics may be able to provide an estimator that is better in terms of bias and efficiency than any frequentist alternative, as it is the case with Multi-Level Models and some SEMs. Third, Bayesian statistics, which for most of its existence was a rather arcane pasttime because of the computational demands implied, only gained practical relevance for applied researchers with the twin advent of simulation-based methods and affordable fast processors in the late-1990s-to-early 2000s. Even a decade ago, getting Bayesian estimates in MLWin for a reasonably complex Multi-Level Model could easily take an hour or more on a then-modern desktop computer, much as it was the case with SEM in the 1990s.
At the moment, most Bayesian estimation still requires access to specialised software (Winbugs, Openbugs, Jags, Stan . . . ), preferably via R. However, the implementation of Bayesian analysis in recent editions of Stata (from version 14 on) could be a game-changer in this respect.

3.2.3    Networks

So far, election studies have mostly missed out on the renaissance of Social Network Analysis (SNA) in political science (for some notable exceptions see e. g. Huckfeldt and Sprague, 1987; McClurg, 2006). Although interest in relational or network data has grown exponentially in Political Science, psephology has been somewhat late to the party because relevant data are generally not available. While large societies may display the properties of a “small-world” network in which everyone is related to everyone else through a relatively small number of contacts (say six), such network structures are very sparse and will rarely have an effect on political behaviour. Social embededness certainly plays a role for opinion formation and political behaviour, but mainstream election studies cannot hope to uncover the relevant networks. Traditional community studies as well as explorations of online communities, on the other hand, can do just that.
Although it is far from clear if and how findings gained here generalise to the electorate as a whole, statistical procedures for analysing social networks are currently in the process of becoming part of the tool kit for electoral research. Understanding these methods can present a formidable challenge.
By definition, network data break the mould of traditional data analysis, where cases correspond to the rows of the data matrix, and variables to its columns. In network applications, cases form both the rows and the columns of an (adjacency) data matrix, whose cells represent the existence, direction and possibly strength of ties between them. Recording traditional variables requires a second data matrix, specialised software, and, more importantly, and adjustment of the analyst’s mind set.
Once collected, data on ties between actors can be employed to calculate three broad

classes of statistical measures (Knoke and Yang, 2008): indices that reflect the position of an individual within the local or global network (e.g. one’s centrality), measures that refer to features of an actual or potential tie between two actors (e.g. the importance of this tie for the coherence of the network as a whole), and statistics that describe some features of the network as a whole (e.g. the degree to which it resembles the “small-world” scenario outlined above). Often, the aim of SNA is chiefly descriptive and the analysis would end with their calculation and interpretation, but in principle, all network measures can subsequently be employed as dependent or independent variables in a regression framework.
Relational data do not fit into the single-matrix paradigm of general statistical packages such as Stata or SPSS. Moreover, before the rise of social networking sites, there was little commercial interest in SNA. Therefore, most software that is potentially useful for students of electoral behaviour is developed by academics (often as an open source project) and available for free or at a very modest price. Historically, UCINET, which was created in the early 1980s and has been under constant development ever since has been a very popular choice. UCINET is grounded in the tradition of (mathematical) sociology and incorporates a multitude of procedures for manipulating and analysing relational data. However, according to its authors, many of these procedures become tediously slow in networks with more than 5000 nodes. Pajek and Pajek XXL, on the other hand, are slightly newer programs specifically geared towards large and very large networks of several million nodes. Their user interface is idiosyncratic, and the terminology used in the documentation as well as many of the procedures may be unfamiliar to social scientists, as the authors have their roots in mathematical graph theory and computer science. However, Pajek is unrivalled in terms of speed and sheer processing capacity.
UCINET, Pajek, and other SNA software make it possible to perform analyses that are unfeasible with standard statistical software. However, moving one’s data from a standard software suite to an external program for network analysis, then back to the general purpose package for further analysis is a disruptive, tedious, and error-prone process. The various SNA packages that exist for the R system are therefore an attractive alternative to the stand-alone SNA programs. The most generally useful are Statnet (a “meta” package that includes many procedures from more specialised packages), and Igraph, which seems to be slightly more accessible (and is also available as a package for the Python language). In all likelihood, either package will fulfil all but the most exotic needs of psephologists.

3.2.4    Geo-spatial analysis

Geo-spatial analysis is a broad term that encompasses at least two distinct (if related)
approaches: the use of geographical variables in “normal” regression models of electoral 12

behaviour on the one hand, and the estimation of specific statistical models that account for spatial dependencies on the other.
The  first  approach  may  simply  use  geo-references  to  merge  micro  data  with contextual information (see section 3.1). Under more advanced scenarios, psephologists will calculate geographical variables (most often distances) from sets of geo-references. This is best illustrated by an example: For various theoretical reasons, voters should ceteris paribus prefer local candidates, i. e. candidates that live closer to a given voter’s residence than other candidates. If candidates are obliged to have their home addresses on the ballot paper and the addresses of voters are known,3 the spatial distance between candidates and their prospective voters can be calculated (Arzheimer and Evans, 2012; Arzheimer and Evans, 2014).  This variable varies across voter-candidate pairs within districts (unless voters live at the same address) and is therefore a global variable at the
level of the individual voters.
Geo-spatial methods are required for (1) the translation of addresses into physical co-ordinates (a step known as geocoding) and (2) the calculation of various distance measures (e. g. travel time by car or public transport). Apart from the calculation of straight-line distance, which is a purely geometrical problem, the second step requires access to digital road maps, timetables, data on congestion, and routing algorithms. However, once the distance has been calculated, the analysis can proceed with the usual linear and non-linear regression models, which may account for nesting or clustering of the observations by imposing a structure on the variance-covariance matrix.
Various types of spatial regression models take this idea one step further. They correct for dependencies amongst the observations by taking the spatial co-ordinates of cases into account and adjusting the structure of the variance-covariance matrix accordingly. The relevance of spatial regression models for psephology is most obvious in the case of district-level aggregate analyses:  Whereas standard regression models assume that disturbances are identically and independently distributed, it stands to reason that neighbouring4  districts will be affected by similar disturbances and hence will display a  pattern  auto-correlation  that  renders  standard  errors  dubious  at  best.    In  spatial regression, the matrix of distances between the centroids of the electoral districts can be employed to estimate this auto-correlation, which in turn can be used to derive corrected standard errors within a spatial regression model (Ward and Skrede Gleditsch, 2008). Spatial regression could be applied to individual-level data too, but it is generally easier
3For reasons of data protection, usually only an approximate geo-reference of the respondent is recorded.
4Being neighbours is a somewhat fluid concept, as these shared influences will be stronger where districts are physically closer and less pronounced, yet still present, where a pair of districts is further apart. This scenario is very different from nesting, where there are clearly delineated, fixed groups of lower-level units.

and often also more appropriate in terms of the underlying theoretical assumptions about causal mechanisms to use a Multi-Level Model (possibly involving more than two levels) that accounts for nesting within political-administrative contexts.
Mapping and processing geo-referenced data traditionally required access to and training in the use of a Geographical Information System (GIS). A GIS is essentially a relational database with special capabilities for dealing with 2D- and 3D-coordinates. GIS software tends to be expensive, proprietary, and complex. In recent years, however, government agencies and other organisations aiming at opening up their data have set up websites that hide at least some of the complexity of the underlying system. In the most simple case, users may create chloropleth maps, or look up data for a single or a limited number of localities. More useful systems allow one to download pre-built or customised tables in some machine-readable format that can be merged with existing individual-level data. In very few ideal cases, there is an API that researchers can access programatically (see section 5.1).
Moreover, algorithms for collecting, storing, and processing geo-referenced data are now freely available and have been implemented in a host of stand-alone programs and/or packages for the R system. GRASS (Geographic Resources Analysis Support System) is a fully featured GIS that has a wide range of applications in engineering, the natural science, and the social sciences. GRASS runs on all major  operating systems. It can be used both interactively through its graphical user interface (GUI) and programmatically via scripts. Its real power, however, lies in its interfaces with two popular programming languages: Python and R. Through these interfaces (Pygrass for Python and Rgrass6/7), users can at the one hand program the GRASS system and extend its capabilities. On the other hand, researchers who regularly run their analyses in Python or R can selectively make use of data stored in GRASS and of the nearly 2,700 industry-grade functions available in the system. QGIS is a more light-weight alternative to GRASS. While it interfaces with R and Python, too, it is mostly geared towards interactive use.
In many cases, however, analysts working in R or Python will want to altogether avoid the overhead of plugging into a GIS. Much of the functionality of traditional GIS software is now available in the form of addons for these two languages. R in particular currently has more than a hundred packages for loading, manipulating, analysing, and mapping geo-referenced data ( html).

4    Tools for successful, reproducible research

The previous two sections have dwelled on the rapid pace of technical progress in psephology. Somewhat paradoxically, this section suggests that in the face of ever more complex data and software, psephologists should turn to very basic tools, concepts and techniques that computer scientists developed decades ago: plain-text files and editors, directories (folders), and some utilities commonly used in medium-sized programming projects. As the old saying goes: In election studies, regression is progress.

4.1    Establishing a reproducible workflow

Data analysis involves a number of distinct phases (see Long 2009, chapter 1 for a similar outline):

1.    Data must be collected, either by the researchers themselves or by some third party, and stored electronically
2.    These machine readable data need to be transferred to the researchers, usually via the internet
3.    The data must be recoded or otherwise normalised, possibly after being converted to some other format first.
4.    A number of exploratory analyses and preliminary models are run on the data, perhaps using more than one computer program
5.    The researchers settle on a small set of final analyses and models whose results are stored
6.    For presentation and publication,  graphs and tables are produced from  these results, possibly using additional software

To be reproducible by the original researchers and their peers, every step as well as the rationale behind the decisions involved must be documented. Realistically, that means that as much as possible of the whole process should be automated by means of scripts: short sets of instructions for a computer program. Graphical user interfaces are useful for getting to know a program, and possibly for putting the finishing touches on graphs for publication, but scripts are infinitely more powerful, efficient, and reliable. When properly commented, scripts are also self-documenting, although researchers should strive to keep a separate research journal. For smaller projects, presentations, and teaching, researchers may even want to pursue a “literate programming” (Knuth,

1984) approach that combines code for several programs, text for publication, and documentation in a single document, from which intermediate tables and graphs as well as slides and PDF documents may be produced using either the Knitr package for R or the even more general Orgmode package for Emacs (see below). However, while literate programming is attractive in principle, it may not scale well to larger projects.
Most statistics packages have simple script-editing capacities built in, but in the long term, it is more efficient to use stand-alone text editors, which offer much more powerful editing features as well as syntax highlighting, proper indentation, and basic project managing capabilities. One of the most quirky and powerful of these editors is Emacs (, which was first released in the mid-1970s and has been under active development ever since. Despite its age, interest in Emacs has surged in recent years, and many quantitative social scientists swear by it. Emacs can be endlessly customised and extended, which can be baffling for new users. Cameron et al. (2005) provide a useful introduction, but documentation for the many more features and extensions is best searched on the internet. Psephologists may also want to install one of the configurations aimed specifically at social scientists that can be found online.
With the right set of extensions, Emacs supports almost every scripting language known to humankind, including the command languages of statistical packages such as Julia, OpenBUGS/JAGS, R, S-Plus, Stan, Stata, and SAS. At a minimum, “support” means syntax highlighting, indentation, and checking for balanced parentheses. Moreover, Emacs normally gives access to the respective help systems for these languages and can find documentation for related functions. It can insert boiler plate code (e.g. loops) and can execute snippets of code or whole scripts. Emacs was designed as an editor for computer programmers and so has the ability to keep track of variables and look up the definition of functions across an arbitrary number of files, making use of text tools such as Diff, Grep, or Find, version control systems such as Git (more on them below). The more complicated the toolchain becomes, the more it shines, as R, Stata, Python, and many other applications can be conveniently managed from a single keyboard- and script-centric  interface.

4.2    Buildtools, revision control, and other open source goodies

Ideally, there should be a separate script for each of the six steps outlined in section 4.1. Shorter scripts are easier to maintain, and it would be inefficient to re-run the whole process only to add a horizontal line to a table. It is also vitally important that data are only ever edited in a non-destructive way: Each script must save its results as a new file, keeping the data collected and transferred in steps one and two in pristine condition. It is also good research practice to keep all files belonging to a given project in a directory of

their own, and to create separate sub-directories for scripts, graphs, tables, and datasets (Long, 2009).
Once a project grows beyond a handful of individual scripts, further automation of the process or meta-scripting becomes a necessity, because the individual jobs need to be executed in a certain order. In principle, a degree of automation can be achieved within the statistical package of choice itself: Both Stata and R are capable of processing scripts that it turn “include” or “source” other scripts. Moreover, both programs have rudimentary infrastructure for starting external programs and can so, at least in theory, manage a tool chain. In practice, however, it is easier and less error-prone to rely on an external scripting language, e.g. Python or the scripting language of the operating system’s native command line interpreter (shell), to manage complex workflows.
If some of the tasks involved are time-consuming or otherwise  expensive  (i.e. model estimation by numerical means or metered data acquisition from the internet), psephologists should rely on “build tools”: software that is normally used by computer programmers to compile (“build”) complex software from hundreds of text files via a potentially large number of intermediary files. If a single text file is edited, it is normally sufficient to recompile a small fraction of the whole project that is directly affected by this change. Build tools can identify, manage, visualise and most importantly exploit such dependencies, thereby making substantial efficiency gains possible.
On average, workflows for software project are more complex than workflows for the analysis of electoral data by several orders of magnitude, but psephologists can still benefit from learning to use build tools. This is best illustrated by an example. Consider the following simple workflow:

1.    Download (with R, or with a specialised program such as wget) a data set (say the European Social Survey) from the internet if the file on the web has changed
2.    Save a relevant subset of the data after recoding some variables
3.    Load the subset, estimate some complex model, and save the parameters to a file
4.    Illustrate the findings by
•    Producing a number of graphs from the parameters and save them as separate files
•    Producing a number of tables from the parameters and save them as separate files

5.    Generate a PDF report with the LATEX document preparation system by processing a text file that includes the graphs and tables

For an efficient and managable workflow, each task should be performed by a single program acting on a single set of instructions (either a script or simply a number of options and arguments submitted when the program starts). Moreover, each task takes one ore more inputs, and leaves behind one or more outputs.5 The way in which these individual tasks are listed makes it very easy to recognise the dependencies amongst them: If a new version of the European Social Survey is published, all steps must be repeated in that exact order. If, on the other hand, the researcher decides to change the coding of the variables (step 2), the estimator employed by the model (step 3), or the look of the graphs (step 4), only the subsequent steps must be repeated. Incidentally, the latter modification would not require rebuilding the tables: If the dependencies were visualised as a tree, both tasks would appear on the same level, as they are completely independent of each other. In a computing environment with sufficient ressources, they could be executed in parallel, thereby further speeding up the process.
Build tools  such  as  the  venerable Make  program  (Mecklenburg, 2005, generally available on Unix-like systems) and its many modern successors require that the dependencies are specified in yet another textfile. While this may sound like a chore, it is usually just a matter of writing down which script generates what files (“targets”) from which inputs. Moreover, this helps clarifying and streamlining the workflow. Once this set of rules is in place, the build tool will analyse the dependencies and execute the tasks in the required order. After this initial run, targets will only be regenerated if the scripts or inputs from which they originate change.
A  final  tool  that  psephologists  should  borrow  from  the  world  of  software development are revision control systems.  Most researchers will be (painfully) aware of the value of automated backup systems, which retain a number of old copies to avoid the situation where a good backup is replaced by a corrupted copy.  Modern systems usuallly provide a number of hourly or daily snapshots alongside increasingly older (weekly, monthly, yearly) copies.  Revision control systems take this idea of snapshots one step further by retaining a complete history of changes to each (text) file in a project directory.6  Modern revision control systems such as the somewhat unfortunately named Git (Loeliger and McCullough, 2012) can track the whole state of a directory and quickly reset all files in a directory to the state in which they were yesterday evening, or show which changes were made to a specific file since Monday night. They provide tools for finding the exact point at which some changes in the way the variables were recoded
5Ideally, the number of inputs and outputs should be as low as possible (i.e. by writing one individual script for every graph that goes into the final document), but that can become very tedious and is not always feasible.
6Unless they are kept in sync with a remote repository, revision control systems operate on local files only and hence do not protect against data loss through hardware failure. Researchers still need to make sure that they backup their working files as well as their revision control repository regularly.

stopped the model from converging or brought about a dramatic change in the estimates further down the line.
But most importantly, using a revision control system introduces another layer of reliability and reproducibility. Modern revision control sytems cannot just easily revert unwanted changes to one’s project files, they can effortlessly maintain an arbitrary large number of timelines (“branches”) for a project directory. This is great tool for testing code and ideas: One can easily try out a variety of operationalisations, model specifications, or graphical styles in various branches, once more recording all the changes made to the files, then switch back to a more stable line of development that represents the current state of the analysis and selectively copy over anything that worked. Revision control sytems are based on the assumption that each of these changes should be documented in a comment and so strongly encourage the analysts to keep a log of the rationale behind the myriad of tiny decisions they take while analysing their data and presenting their findings.
Like many other tools discussed in this chapter, revision control systems have been used by computer programmers for decades. Their modern incarnations are designed to deal with millions of lines of code spread across hundreds of files, on which large teams of developers may work concurrently. Psephologists may well think that a system like Git (which is relatively difficult to learn but can be tamed through a number of GUIs) is ridiculously overpowered for their needs. However, experimenting with one’s code and data in a safe environment where each change, each experiment is documented and can be reverted, modified and even re-applied at any later point is ultimately much more rational, rewarding, and productive than the common practice of endlessly commenting in and out lines of code, or creating lots of increasingly cryptically named scripts whose exact purpose we cannot remember after a couple of weeks.

5    The  Internet  as  an  Infrastructure  for  and  as  an Object of Electoral Studies

5.1    Infrastructure

Psephology has been transformed by the availability of large-scale comparative opinion surveys such as the ISSP, the EES, or the Eurobarometer series (see chapter 48). The websites of CESSDA members and other large archives are now the default option for the distribution of these datasets, allowing speedy and cost-efficient proliferation of data, whereas physical media (e.g. DVDs or CD ROMs) have been phased out, unless partiuclarly restrictive usage rules apply.

While the archives are unrivalled when it comes to providing documentation and long-term safe storage for large numbers of datasets, preparing one’s data for a release through the archive system is seen as a chore by many researchers. Thus, there has always been a tradition of more informal data-sharing in psephology with friends and close colleagues. With the advent of the web, individual researchers and small teams began to put their datasets on personal or departmental websites. However, data on such sites is often difficult to find, because there is no central catalogue, and may disappear at any moment, because it is not backed up by a professional infrastructure.
Moreover, data may be stored in any number of formats and without even minimal documentation. The open source Dataverse  project  (  and some related initiatives aim at solving these problems by providing means for the (semi-)automatic conversion, documentation, versioning, and retrieval of data. They also provide globally unique identifiers and checksums to solve the problem of data integrity. Journals, research groups, and individual scholars can easily create their own repositories to facilitate re-analysis and replication. Dataverse and similar software go a long way towards making data from smaller, often self-funded projects that would otherwise be lost to the scientific community available for secondary analyses. But they still rely on a professional and sustainable IT infrastructure. At the moment, this infrastructure is provided for free by Harvard University and some other global players. Wheter they will continue to provide this service to the community if usage of the system picks up remains to be seen.
Besides traditional data archives and more individual repositories, countless government agencies and other public institutions around the globe have set up websites where they share parts of their records and hence have become data providers. Especially at the subnational level, the main problem with these sites is fragmentation. Even if they would adhere to common standards for their website design and the presentation of their data, finding and navigating hundreds or thousands of individual sites to collect, say, data on candidates in local elections, is obviously inefficient and often infeasible. Thankfully, governments around the world have woken up to the potential value of free access to their data and are implementing open data legislation. As a result, government-sponsored regional, national, or even supra-national “portal” or “data store” sites, which gather and distribute fine-grained data from lower levels, are becoming more prevalent. While these initiatives are often primarily aimed at policy makers and business communities, the social sciences also benefit from the emerging consensus that government data should be open in principle. For psephologists, the growing availability of geo-referenced electoral results and other statistical data (e.g. census or landuse data) is of particular importance.
In an ideal world, websites would offer the exact data set required by a researcher in

a format that can be read directly into one’s favourite statistical package. In reality, datasets are often offered in the guise of Excel sheets or textfiles that need to be imported. While this is not too problematic, such files are often created “on the fly” from an underlying data base according to some specifications that need to be entered manually. If the same dataset (or different variants and iterations of the same dataset) needs to be downloaded more than a couple of times, it may be worthwhile to do this programmatically by means of a script. Moreover, there still exist (government) websites that present the required data not as a file for download, but rather as a series of formatted tables on the screen, possibly in a paginated format. In these cases, researchers should consider writing a “scraper”, i.e. a small program that simulates the activities of a website user and stores the results as a dataset. While Python has a whole suite of libraries that make it an ideal tool for scraping tasks, some modern packages for the R system offer very similar capabilities from within the statistical package. Munzert et al. (2015) provide an excellent introduction to “scraping” and “mining” the internet. While they focus on R, the techniques and standards they discuss translate easily to workflows that are based on other tools.
Finally, many service providers – amongst them a handful of government agencies
– provide “application programming interfaces” (APIs) to their data. APIs bypass the traditional website altogether. They represent complex and very specific mechanisms for interacting with the underlying database of a service as a series of simple commands for high-level programming languages such as R or Python. Using these commands, scripts can directly access these services without even simulating the activities of a human user of a website. From the point of view of the person writing a script, accessing a service on the internet is not different from calling a function that is hardwired into the respective programming language.
For instance, psephologists may have a variable that contains the addresses of candidates as stated on the ballot papers (a messy combination of names and numbers, possibly with typos). To convert these to proper geographical co-ordinates, they would want to make use of a “geocoding” service. There are APIs for various such services (e.g. Google Maps, Bing Maps, and the OpenStreetMap project), which wrap the necessary low-level instructions into a simple function call. Usage limits and possibly payment options aside, switching from one service to another is usually just a matter of applying slightly different functions to a variable. Using yet another API, the resulting coordinates could then be mapped to census tracts, for which a host of socio-economic and demographic data are available that could provide a rough-and-ready approximation of the respective environment the candidates live in.

5.2    The internet as an object

Since its inception as a research infrastructure, the internet has been thoroughly transformed. While the usual caveats about selective access and use apply, the internet’s role as a political medium is becoming more and more relevant for psephologists. Current research is very much focussed on political communication as it happens on social networking platforms, with Facebook, Twitter, and Instagram being the most prominent ones. Scraping these sites with simple scripts would not just violate their terms of use, but is virtually impossible due to their heavy use of interactive web technology, the networked nature of communication on these sites, and the sheer volume of posts. However, once more there are APIs available through which these services can be mined programmatically. While limits apply, analysts will often find the free tiers perfectly suitable for their needs. Moreover, both Twitter and Facebook have strong research departments that are open to forming partnerships with social scientists.
Research into social-networked communication on the internet is currently dominated by computer scientists and linguists, who often operate without any underlying theory of social behaviour. Psephologists interested in this field will have to learn a whole host of techniques and concepts, and will have to link these with their own substantive interests. Grimmer and Stewart (2013) provide a useful introduction to automatic content analysis, whereas Ward, Stovel, and Sacks (2011) give a tour d’horizon of concepts in social network theory that matter for political scientists.
Using the internet for analysing conventional media sources is less problematic in many ways. Although many publishers aim at implementing paywalls to secure their revenue streams, many mainstream outlets still put all or at least most of their content online. Moreover, Google, Microsoft and  other  companies have  created aggregator sites that can be accessed programmatically. Using these sources, psephologists can retrospectively track the development of a given issue during a campaign, or assess the tonality of media reports on a set of candidates.  In short, using the internet and a scripting language, researchers can achieve most of what would have required a host of research assistants and an extensive newspaper archive (or an expensive database subscription) only a few years ago.
The Google-supported Global Data on Events, Location and Tone (GDELT, http:
// database takes this idea one step further. GDELT, which is based on older event databases (Gerner et al., 1994), aims at automatically extracting information on actors and events from newswire reports and making them available on a global scale. The GDELT project is somewhat controversial, because its original founders fell out, and because of worries over the quality of the inferences that are drawn from the raw inputs. However, the project, which has generated enormous interest in the IR community, has great potential for psephology, too.

6    Conclusion

From its very beginnings, electoral research has been a beneficiary, and often a driver of technological and methodological progress in the larger field of Political Science. In recent years, this progress has accelerated: User-friendly software, ever faster computers, and last not least the proliferation of data mean that yesterday’s advanced methods quickly turn into today’s new normal. By and large, this chapter has argued that psephologists should continue to embrace technology in general and the open source and open data revolutions in particular. As the examples in the natural sciences (e.g. biology) show, psephologists can do more, and more reliably, if they think a little bit more like software developers and make use of freely available tool chains that haven been tried and tested for decades in much harsher environments.
There is, however, a flip side. Technology is a valuable tool, but it can be a distraction, too, and psephologists should never lose sight of their core competency: the ability to put singular findings into a larger context, making use of nearly a century of theory-building. The world is full of “data scientists”, who will happily and rapidly analyse electoral data just as they would analyse any other kind of data. Trying to compete with them on a purely technical level would be a hopeless endeavour. As a profession, we can only stand our ground if we can base our own analyses on profound theoretical insights.


Arzheimer, Kai and Jocelyn Evans (2012). “Geolocation and Voting: Candidate-Voter Distance  Effects  on  Party  Choice  in  the  2010  General  Election  in  England”.  In:
Political Geography 31.5, pp. 301–310. doi: 10.1016/j.polgeo.2012.04.006.
—   (2014). “Candidate Geolocation and Voter Choice in the 2013 English County Council Elections”.  In:  Research  &  Politics.  doi:  10.1177/2053168014538769.
Cameron, Debra et al. (2005). Learning GNU Emacs. A Guide to the World’s Most Extensible Customizable Editor. 3rd ed. Sebastopol: O.
Campbell, Angus et al. (1960). The American Voter. New York: John Wiley.
Coleman, James S. (1994). Foundations of Social Theory. Cambridge, London: The Belknap Press of Harvard University Press.
Crawley, Michael J. (2013). The R Book. Chichester: Wiley.
Eurostat (2015). Nomenclature of Territorial Units for Statistics NUTS 2013/EU-28. Regions in the European Union. Luxembourg: Publications Office of the European Union, url: GQ- 14- 006-EN-N.pdf/b9ba3339-b121-4775-9991-d88e807628e3.

Gelman, Andrew and Jennifer Hill (2007). Data Analysis Using Regression and Multilevel/Hierarchical Models. Cambridge: Cambridge University Press.
Gerner, Deborah J et al. (1994). “Machine Coding of Event Data Using Regional and International Sources”. In: International Studies Quarterly 38.1, pp. 91–119.
Grimmer, Justin and Brandon M. Stewart (2013). “Text as Data. The Promise and Pitfalls of Automatic Content Analysis Methods for Political Texts”. In: Political Analysis
21.3, pp. 267–297. doi: 10.1093/pan/mps028.
Hox, Joop J. (2010). Multilevel Analysis. Techniques and Applications. 2nd ed. New York: Routledge.
Huckfeldt, Robert and John Sprague (1987). “Networks in Context: The Social Flow of Political Information”. In: The American Political Science Review 81.4, pp. 1197–1216.
Ihaka, Ross and Robert Gentleman (1996). “R: A Language for Data Analysis and Graphics”. In: Journal of Computational and Graphical Statistics 5.3, pp. 299–314. doi:
Jackman, Simon (2004). “Bayesian Analysis for Political Research”. In: Annual Review of Political Science 7, pp. 483–505.
Jennings, M. Kent (2007). “Political Socialization”. In: The Oxford Handbook of Political
Behaviour. Ed. by Russell J. Dalton and Hans-Dieter Klingemann. Oxford: Oxford University  Press,  pp.   29–45.  doi:   10.1093/oxfordhb/9780199270125.003.0002.
Jöreskog, Karl G. (1990). “New Developments in LISREL: Analysis of Ordinal Variables Using Polychoric Correlations and Weighted Least Squares”. In: Quality and Quantity
24.4, pp. 387–404. doi: 10.1007/BF00152012.
— (1994). “On the Estimation of Polychoric Correlations and Their Asymptotic Covariance Matrix”. In: Psychometrika 59.3, pp. 381–389.
Karvonen, Lauri and Jostein Ryssevik (2001). “How Bright was the future? The Study of Parties, Cleavages and Voters in the Age of the Technological Revolution”. In: Party Systems and Voter Alignments Revisited. Ed. by Lauri Karvonen and Stein Kuhnle. London: Routledge, pp. 45–61.
King, Gary (1997). A Solution to the Ecological Inference Problem. Reconstructing Individual Behavior from Aggregate Data. Princeton: Princeton University Press.
Knoke, David and Song Yang (2008). Social Network Analysis. 2nd ed. Thousand Oaks: Sage.
Knuth, Donald Ervin (1984). “Literate Programming”. In: The Computer Journal 27.2, pp. 97–111.
Lakhani, Karim R. and Eric von Hippel (2003). “How Open Source Software Works: “‘”Free”’  User-to-User  Assistance”.  In:  Research  Policy  32.6,  pp.  923–943.  doi:  10 .

Lazarsfeld, Paul F., Bernard Berelson, and Hazel Gaudet (1944). The People’s Choice. How the Voter Makes up His Mind in a Presidential Campaign. Chicago: Columbia University Press.
Lazarsfeld, Paul F. and Herbert Menzel (1961). “On the Relation Between Individual and Collective Properties”. In: Complex Organizations. A Sociological Reader. Ed. by Amitai Etzioni. New York: Holt, Rinehart & Winston, pp. 422–440.
Loeliger,  Jon  and  Matthew  McCullough  (2012).  Version  Control  with  Git.  2nd  ed.
Sebastopol: O’Reilly.
Long, J. Scott (2009). The Workflow of Data Analysis. Principles and Practice. College Station: Stata Press.
Lutz, Mark (2013). Learning Python. 5th ed. Sebastopol: O’Reilly.
McClurg,  Scott  D.  (2006).  “The  Electoral  Relevance  of  Political  Talk:  Examining
Disagreement and Expertise Effects in Social Networks on Political Participation”. In: American Journal of Political Science 50.3, pp. 737–754. url: http://www.jstor.
Mecklenburg, Robert (2005). Managing Projects with GNU Make. Sebastopol: O’Reilly. Miller, Warren E. and J. Merrill Shanks (1996). The New American Voter. Cambridge,
London: Harvard University Press.
Monogan, James E. III (2015). “Research Preregistration in Political Science. The Case, Counterarguments, and a Response to Critiques”. In: PS: Political Science & Politics
48 (3), pp. 425–429. doi: 10.1017/S1049096515000189.
Munzert, Simon et al. (2015). Automated Data Collection with R. A Practical Guide to Web Scraping and Text Mining. Chichester: Wiley.
Muthén, Bengt O. (1979). “A Structural Probit Model with Latent Variables”. In: Journal of the American Statistical Association 74, pp. 807–811.
— (2002). “Beyond SEM. General Latent Variable Modeling”. In: Behaviormetrika 29, pp.  81–117.  url:  /home/kai/Work/Texte/Muthen2002.pdf.
Olson, Mancur (1965). The Logic of Collective Action. Public Goods and the Theory of Groups. Cambridge: Harvard University Press.
Raymond, Eric S. (1999). The Cathedral and the Bazaar. Musings on Linux and Open Source by an Accidental Revolutionary. Beijing et al.: O’Reilly.
Siegfried, André (1913). Tableau politique de la France de l’Ouest sous la Troisieme Republique. Paris: A. Colin.
Skrondal, Anders and Sophia Rabe-Hesketh (2004). Generalized Latent Variable Modeling.
Boca Raton u.a.: Chapman & Hall.
Steenbergen, Marco R. and Bradford S. Jones (2002). “Modelling Multilevel Data Structures”. In: American Journal of Political Science 46, pp. 218–237.

Stegmueller,   Daniel   (2013).   “How   Many   Countries   for   Multilevel   Modeling?   A
Comparison of Frequentist and Bayesian Approaches”. In: American Journal of Political Science. doi: 10.1111/ajps.12001.
Ward,  Michael  D.  and  Kristian  Skrede  Gleditsch  (2008).  Spatial  Regression  Models.
Quantitative Applications in the Social Sciences 155. Thousand Oaks: Sage.
Ward, Michael D., Katherine Stovel, and Audrey Sacks (2011). “Network Analysis and Political Science”. In: Annual Review of Political Science 14.1, pp. 245–264. doi: 10.
Western,  Bruce  and  Simon  Jackman  (1994).  “Bayesian  Inference  for  Comparative Research”. In: American Political Science Review 88, pp. 412–423.

Political Interest Furthers Partisanship in England, Scotland, and Wales


1. Introduction

In the field of public opinion and voting behaviour, few concepts have stimulated as many analyses and have aroused as much debate as that of party identification. The idea of a durable “identification” with a political party has been a staple in American electoral studies since the 1940s and is at the core of the Michigan model of electoral choice (Campbell et al., 1960). But with the proliferation of Michigan-inspired voting studies during the late 1960s and early 1970s (see Miller, 1994) scholars tried to apply the concept to political systems other than the US and began to couch their analysis of voting behaviour in Western Europe in terms of stabilizing party attachments and disruptive short-term factors. Roughly about the same time, the concept came under criticism both in the US and abroad.

A first strand of this critique accepts the basic premises of the Michigan model but holds that their empirical findings were dependent on the unusually quiet and stable political setting of the 1950s. According to this school, the political unrest of the 1960s and 1970s greatly reduced the prevalence and electoral importance of partisanship (Abramson, 1976; Nie et al., 1976). A second and related line of argument questions the validity of the indicators, which is of particular importance for the application outside the US. Critics objected that in political systems other than the US indicators for party identification merely presented another measure for vote intentions (Schleth & Weede, 1971; Thomassen, 1976; LeDuc, 1981; Küchler, 1986). Other challenges focus on the fact that the original Michigan indicator was based on a single continuum spanned by the two relevant American parties, whereas the vast majority of European polities feature multi-party systems (Katz, 1979).

The third and most fundamental line of criticism addresses the meaning and theoretical status of party identification. The original Michigan model as outlined in the American Voter was firmly grounded in then-contemporary assumptions about human behaviour that have been subsumed under the label of a “homo sociologicus of sociological empiricism” (Lindenberg, 1985, p.102): Voters were perceived as actors who “form opinions about everything”, are “easily influenced by others”, and “act directly on the basis of … [their] opinions” (Lindenberg, 1985, p.102). Consequentially, the attachment to one of the major parties would have a powerful direct impact on one’s political behaviour and would operate as a “perceptual screen” that biases the reception and the processing of political information (Campbell et al., 1960, p.133).

According to the classic Michigan model of political behaviour, citizens do not apply an explicit decision rule to maximise their utility from voting but rather react in a semi-conscious and stochastic way to political stimuli. This runs against the grain of a competing “model of man” which holds that citizens act rationally, i.e. actively choose the political alternative that is optimal given their general preferences. Starting out from Downs’ instrumental interpretation of party identification (Downs, 1957), authors such as Samuel L. Popkin and Morris P. Fiorina developed a competing view of partisanship. According to them, party identification is nothing but a cost-saving device for voters in a situation where it would be irrational to gather too much political information (Popkin et al., 1976; Fiorina, 1977; Fiorina, 1981).

While the question of whether humans act rationally in politics or merely follow their attitudinal dispositions is obviously a deep and complex one, in the case of party identification both competing views have observable implications that lend themselves to an empirical test. While the Michigan school never claimed that party identification is perfectly stable (Campbell et al., 1960, pp. 135, 165), it follows from their presentation in the American Voter and subsequent accounts that one’s identification is normally acquired early in life and then retained for years if not decades unless the political landscape changes dramatically. On the other hand, the “revisionist school” claims that party identification is nothing but a “running tally of retrospective evaluations of party promises and performance” (Fiorina, 1981, p. 84) that is frequently updated and changes accordingly as new political information comes in (see Milazzo et al. 2012 for a more subtle development of this idea in the British context).

On the basis of panel data that track the party identifications of individuals over time, it should be fairly straightforward to establish which of the competing views more adequately reflects political realities: if many electors change their identifications over a comparatively short period of four or five years, that would constitute rather strong evidence of rational updating in the light of new information. If, on the other hand, identifications are more or less stable over this period, this would prima facie support the classic view, although proponents of the revisionist school could still argue that political circumstances have simply not changed enough to trigger significant updating.

The issue is further complicated by random measurement error: respondents will get tired and bored during the course of a lengthy interview and give an incorrect or random answer to get over with the procedure, and interviewers will mishear or mistype their utterances. Therefore, not all apparent changes in the answers to a survey question reflect a true shift in the underlying attitude. Put differently, the correlation between measurements at time t and time t+1 will be attenuated.i Therefore, results from panel analyses of partisan change and stability that do not account for random measurement error will be seriously biased in favour of the revisionist school (Green et al., 2002).

As regards party identification in Britain, to our best knowledge only the analyses by Clarke and his colleagues (Clarke et al. 2004, Clarke et al. 2009, Clarke & McCutcheon 2009) deal adequately with this problem. Their main finding is that even if measurement error is taken into account, the “substantial latent-level dynamics in party identification in recent years … [are] inconsistent with the high levels of partisan stability as argued by Green et al. and other proponents of Michigan-style partisanship” (Clarke et al., 2004, p. 193; see also Clarke et al. 2009, pp. 327330; Clarke & McCutcheon 2009).

While we agree with Clarke et al. that party identification in Britain is not completely stable, we disagree with some of their interpretations of their findings. More importantly, we argue that their model should be extended to include political interest as a key factor that can explain stability of partisan ties. This reflects the crucial role political interest plays in another strand of the literature that harks back to Dalton’s (1984) seminal contribution on cognitive mobilisation and partisan dealignment. Although both strands of the literature should obviously complement each other, they are by and large disjoint. Our own model aims to narrow this gap.

In the remainder of this paper, we first review very briefly the existing evidence on the status of party identification in Britain. Then, we present findings from a model that differs from the specification chosen by Clarke et al. by introducing one additional variable and by defining the analytical sample in a slightly more restrictive way. These two innocuous modifications lead us to substantively different conclusions that are much more in line with the classic model of party identification. Finally, we discuss how our findings relate to the broader discussion on the nature and stability of party identification.

2. Previous Research

The Michigan-inspired concept of party identification (labelled as “partisan self-image”) was introduced by Butler and Stokes (1969; 1974) to the analysis of public opinion and voting behaviour in Britain. While building on the American concept, the authors found considerable Anglo-American differences. Though highly stable in absolute terms, partisan self-images in Britain turned out to be much more likely than their American counterparts to travel in tandem with vote choice over time. Given these findings, some scholars discarded the concept arguing that in Britain party identification is not as independent from voting behaviour as implied by the Michigan school. Others related the Anglo-American differences to features of the political institutions or even to measurement problems and concluded that the concept could be applied to Britain in principle (LeDuc, 1981; Mughan, 1981; but also see Crewe et al., 1977, p. 141; Cain & Ferejohn, 1981). Following the latter account, many scholars used the concept of party identification to analyse public opinion and voting behaviour in Britain.

Subsequent analyses, however, yielded more and more evidence that seemed at odds with the traditional concept. Beginning in the 1970s, Britain underwent a period of partisan dealignment, i.e. the strength of party attachments decreased considerably (Crewe et al., 1977). What is more, the decline in intensity resulted from party attachments’ responsiveness to retrospective evaluations of party performance on salient political issues and party leader evaluations (Clarke & Stewart, 1984; see also Johnston & Pattie, 1996). Expanding on this line of research, Clarke and colleagues (e.g. Clarke et al. 1997, 1998) argue in a number of contributions that the directional component of British partisanship also responds to short-term forces like performance evaluations and party leader images. Summarising these findings, Clarke et al. conclude that this level of aggregate and individual volatility cannot be reconciled with the classic model. Therefore, party identification in the sense of the Michigan model should be replaced by the Fiorina-inspired concept of “valenced partisanship” (Clarke et al., 2004, p. 211; Clarke et al. 2009; Whiteley et al. 2013).ii Specifically, employing fractional cointegration methods (e.g., Box-Steffensmeier & Smith 1996), Clarke and his colleagues suggest that party leader images and personal economic evaluations exert effects on aggregate-level party support in Britain (Clarke & Lebo 2003; see also Lebo & Young 2009; Pickup 2009).

But this conclusion has not gone uncontested. Several scholars claimed that the apparent instability of party identification in Britain is the result of an inappropriate survey instrument. Since the traditional indicator prompts respondents with a list of party labels and does not offer them an explicit non-identity option, respondents who lack the sense of durable attachment that is implied by the concept will in all likelihood answer the question on the basis of their present (but not necessarily stable) party preference. This will result in an inflated figure for the percentage of partisans in Britain as well as in a deflated estimate of partisan stability.

Cross-sectional analyses have largely supported the view that the traditional indicator has problems (Brynin & Sanders, 1997; Bartle, 1999; Bartle, 2003; Blais et al., 2001; Sanders et al., 2002; see also Sanders, 2003; see for a similar argument on the effects of question order Heath & Pierce, 1992). When it comes to the stability issue, however, the findings are somewhat mixed. Comparing the traditional and a revised measure (the so-called “supporter question”), Clarke et al. can demonstrate that both indicators result in identical rates of stable responses. At the same time, the revised indicator leads to considerably lower rates of inter-party change than the traditional instrument (Clarke et al., 2004, pp. 196199).

A related methodological objection against the notion that party identification in the UK is merely a “running tally” was raised by Donald Green and his colleagues. Using a simple dummy indicator specification for party identification, Green et al. show that party attachments in Britain turn out to be very stable over time if one controls for random measurement error. What is more, they demonstrate that short-term forces do not seem to affect party identification in Britain if random error is accounted for. Accordingly, Green et al. conclude that evidence in favour of the running tally account of party identification is based on methodologically flawed analyses (Schickler & Green, 1997; Green et al., 2002).

Clarke and his colleagues (e.g. Clarke & McCutcheon 2009, pp. 711-714), however, argue that Green et al.’s approach to measurement error is methodologically flawed and suggest to take an alternative route based on Mixed Markov Latent Class (MMLC) analysis a more adequate method for dealing with categorical latent variables that estimates probabilities for transition from one latent group to another and obtain very different results. Their analyses of panel data collected between 1963 and 2006 reveals considerable change in party identification at the latent-variable level even when allowing for measurement error. Testing four different specifications, they find that a Mixed Markov Latent class model with time homogeneous measurement error rates fits the data for Britain (and also Canada and the USA) best. In such a model, the measurement of partisanship is assumed to be affected by random error that is homogeneous (constant) over time. Moreover, one group of respondents is assumed to have perfectly stable partisan orientations (the “stayers”), whereas members of a second group change their orientations randomly from one wave to the next (the “movers”). The model is related to Converse’s “black-white” model but differs in one important aspect: the assumption that these switches occur with equal probability is relaxed. In Britain, the estimated size of the “mover” group varies between 29 and 37 per cent (Clarke & McCutcheon 2009, pp. 721). Therefore, they suggest discarding the original Michigan concept in favour of the running tally model (Clarke et al., 2004, pp. 194195; Clarke et al., 1999, pp. 97-101; Clarke et al. 2009, pp. 327330).

Clarke et al.’s works are an important methodological and substantive step forward, although we think that they do not represent the final word on the “Michigan vs Running Tally” debate. To be sure, the probabilities for retaining one’s party identification do not equal unity. Perfect stability, however, is not implied by the Michigan model. Rather, this would be a feature of the “unmoved mover” caricature of the original concept (Converse, 2006, p. 5).iii The finding that about two thirds of the respondents in the UK are “stayers” with perfectly stable partisan orientation, combined with the fact that estimated retention rates amongst the “movers” are also relatively high could easily be read as an endorsement of the Michigan model.

However, the debate on the relative merits of both models has become somewhat stale. In reality, electorates are comprised of stable partisans, party switchers, and apartisans, and investigating the scale, the sources and the consequences of this unobserved heterogeneity seems to open up promising new avenues for research (Neundorf, Stegmueller & Scotto 2011). In this article, we suggest adding political interest as an explanatory variable into Clarke et al.’s model to re-examine the over-time stability of party identification in Britain in the late 1990s. This seemingly innocuous modification leads to an important new insight that helps us to discriminate more clearly between the traditional interpretation of partisanship and the revisionist one. In addition, it has some bearing on a related conflict within the traditionalist camp.

The rationale is simple: From the ideas of Downs, Fiorina and Popkin it follows that citizens who are interested in politics and hence exposed to political information will update their “running tally” more frequently than their compatriots with lower levels of political interest. Being interested in politics should therefore have a positive effect on the probability of being in the “mover” class. Moreover, since party identification is merely a function of prior information, interest in politics will raise levels of exposure to political information and should hence be associated with higher levels of partisanship.iv

From the point of view of the traditionalists, expectations regarding the role of political interest are less clear-cut. On the one hand, starting from ideas originally formulated in the American Voter, the thrust of Dalton’s (1984) seminal “cognitive mobilisation” thesis is that low-interest citizens will rely on partisan cues, whereas cognitively mobilised citizens have no need for these cost-saving devices. Cognitive mobilisation will therefore undermine partisan ties and contribute to dealignmant (e.g. Dalton 2014).v For individual respondents, this implies that political interest should once more increase the probability of being the mover group. Moreover, it follows that political interest should have a negative effect on the likelihood of identifying with a political party.

On the other hand, Campbell et al. (1960, p. 133) have famously argued that party identification acts as a perceptual screen that affects the way political information is selected, processed, and stored (see also Bartels 2002). This view is in line with modern theories of motivated reasoning, which suggest that voters with high levels of interest in politics and high levels of political knowledge already stored in their long-term memory are more likely to select information that bolsters their preferences and to counter-argue information that runs contrary to their existing preferences (confirmation and disconfirmation bias). In effect, additional information is likely to support, rather than undermine, existing preferences. Among low-interest voters, this effect is smaller (e.g., Taber and Lodge 2006; see somewhat relatedly Converse, 1962; Zaller, 1992). Political interest should therefore be associated with higher levels of partisanship (e.g. Albright 2009), as well as with a higher probability of being in the stayer class.

To summarise, the three different theoretical perspectives lead to diverging expectations regarding the effect of political interest:

– Table 1 about here –

3. Data and Model

It is not our aim to fully replicate the various analyses by Clarke and his colleagues or to refute their findings. Rather, we want to demonstrate how adding a single variable to their model can shed some new light on the heterogeneity of partisanship stability in Britain and beyond. We therefore focus on data that were collected for the British Election Panel Survey from 1997 to 2000. There are three reasons for re-analysing these data that were collected more than a decade ago. First, this was the last face-to-face panel study of the BES, which began to employ internet (access) panels from 2005 on. While these are cost-efficient and can offer comparable data quality, the bulk of the data analysed comes from traditional surveys, and we would rather avoid mode effects. More specifically, we are worried that “professional respondents” who participate in many surveys may be more interested in politics in the first place and will develop more consistent attitudes over time, which would bias the results in favour of the traditionalist camp. However, an additional analysis of the 2005-2009 internet panel (documented in the online appendix) leads to essentially identical findings.

Second, the 1997-2000 panel (just like the 2005-2009 study) is a “truncated” panel, as far as party identification is concerned, because the last measurement was taken well before the beginning of the election campaign in the following year. Hence, it will not be contaminated by any campaign effects that may prompt voters to revert to their initial identification (e.g. Finkel 1993), while still giving us the benefits of analysing four measurements that span almost the complete life of a parliament.

Third, and most importantly, Clarke & McCutcheon (2009, p. 721) flag up the 1997-2000 panel as the UK’s least stable in modern times. This is confirmed by our own analyses of the 1963-2009 BES panel data: While 80 per cent of the respondents reported the same identification in the last wave in 2000 as they did when they were first interviewed in 1997 (compared to 74 per cent in the 1992-95 and 84 per cent in the 2005-08 periods), the year-to-year changes (documented in the online appendix) are higher than most of those that have been previously observed. To summarise, re-analysing the 1997-2000 data stacks the odds against finding stable identifications of traditionalist lore and is therefore a sensible modeling choice.

The volatility of the 1997-2000 period does not come as a surprise. After all, “New Labour” won the 1997 election by a landslide following the abolition of the old Clause IV (that called for nationalisation) in 1995 and an “Americanised” campaign, which played down ideological differences between the parties. Subsequently, Labour implemented a flurry of constitutional changes, but carried on with many of the previous government’s fiscal and economic policies and established a leadership style that was widely seen as presidential and tried to appeal to the broadest possible constituency (Bevir & Rhodes, 2006). Therefore, the early Blair years should provide a litmus test for the hypothesis of (largely) immutable identifications: if identifications resist the momentum of these events, if they remain stable although Britain has, according to Clarke et al., entered an era of valence politics, this would constitute strong evidence in favour of the classic model.

Unlike Clarke et al., we analyse the 1064 respondents from the smaller nations (882 from Scotland and 182 from Wales separately). Since the 1970s, both Scotland and Wales have featured party systems that are clearly distinct from the national party system, with Labour as the dominant party (until 2014/15) and comparatively strong nationalist parties that represent the centre-periphery cleavage. Devolution of the Scottish Parliament and the Welsh Assembly in 1999 has made these differences even more salient (Bohrer & Krutz, 2005; Lynch, 2007). In our view, pooling respondents from the three nations would lead to more unobserved heterogeneity instead of controlling for sources of heterogeneity, as the presence of the nationalist parties (taking seats in the Scottish Parliament and the Welsh assembly from 1999) will alter the meaning and possibly the stability of the “other” category. Moreover, the stability of mainstream party identifications might be lower in the periphery because respondents may well hold diverging party preferences and loyalties at the national and the sub-national level (see for evidence on the US and Canada Niemi et al., 1987; Stewart & Clarke, 1998).

The second important difference between the analysis by Clarke et al. and our approach is the specification of the model: As outlined in the previous section, we introduce self-stated political interest as an additional variable, which is correlated with both the mover/stayer property and the initial latent identification. The model’s parameters were estimated with MPlus 7.11 assuming that data are missing at random (MAR). Apart from considering political interest, our model is identical to the Mixed Markov model championed by Clarke et al.: We distinguish between Labour identifiers, Conservative identifiers, and all others. Like Clarke & McCutcheon, we further assume that reliability of the indicator is stable across the 1997-2000 period but place no restrictions on the transition matrices within the mover group.

4. Findings

As outlined in the previous section, we set up the model separately for a) England and b) the devolved nations. To establish a baseline, we first estimate the model without considering political interest and its correlations with the latent classes. In line with our expectations, restricting the sample to English respondents results in a higher estimate for the proportion of stayers (75 per cent vs. 66 per cent). Like Clarke et al., we note that some (about one third) of those placed in the mover category do not actually change their identification, bringing the total number of respondents with perfectly stable party identification to 83 per cent. This finding alone is a powerful re-assertion of the idea of largely stable party alignments.

In 1997, 40 per cent of the respondents were Labour identifiers, and 32 per cent identified with the Conservatives. Amongst the initial Labour identifiers, only one quarter are movers. For the Conservatives, the rate is even lower (one fifth), but for the “other” group, it approaches one third. Across all respondents, the probability of retaining one’s identification from one wave to the next varied between 0.94 and 0.99 for Labour and between 0.86 (between 1997 and 1998) and 0.97 for the Tories. For the heterogeneous “other” group, the retention rate is markedly lower (0.74) in 1998 and somewhat lower (0.92) in 1999 and 2000.

For Scotland and Wales combined, the estimate for the stayer group is also somewhat higher than 70 per cent and thus tends to exceed the figure reported by Clarke & McCutcheon. While this difference is small and within the margin of error, the discrepancy underlines that it is worthwhile to disaggregate the data. Once more, about one third of the “movers “(most of them Labour identifiers) retain their initial identification over the four waves, bringing the total number of stable partisans close to 80 per cent. Across all respondents, retention rates are slightly lower than in England and vary between 87 per cent (Labour from 1998 to 1999, the year of the first elections to the Scottish Parliament and Welsh Assembly) to 97 per cent (the Conservatives 1999 to 2000).

Next, we introduce political interest as an additional variable. Interest was measured in every wave using a five-point scale. While we could have constructed another latent variable from these four measurements (see, e.g., Prior 2010), this would have made the estimation prohibitively expensive in terms of computation, and would have led to a further proliferation of parameters. Instead of trying to purge random measurement error from this variable, we simply use the single measurement from the first wave as a rough indicator for general political interest. This is actually a conservative modelling strategy: Any random noise in the 1997 measurement (which could be due to higher levels of interest during the campaign) will dilute the relationship between political interest on the one hand and partisanship and its stability on the other.

  • Table 2 about here –

Including political interest in the model involves estimating three additional parameters – one for membership in the mover group, and two for initially identifying with Labour or the Conservatives, respectively. The change in the Bayesian Information Criterion (BIC) shows that this additional complexity is well-warranted: The BIC (which aims to strike a balance between model fit and parsimony) drops from 11,024 to 10,996 in England and from 4,386 to 4,378 in Scotland/Wales, which indicates a modest improvement over the pure Mixed Markov model (see Table 2).

  • Table 3 about here –

In both regions, including political interest in the model has hardly any effect on the estimated sizes of the mover/stayer classes. However, higher levels of political interest seem to reduce the probability of being a mover. The effects are sizable at about -0.2, meaning that each one-point increase in interest will reduce the odds of being a mover by roughly 18 per cent, but are not statistically significant by conventional standards (p=0.06 in England, 0.09 in Scotland/Wales). Hence, the findings (narrowly) fail to support the “motivated reasoning” perspective on partisan stability, but also clearly contradict the “running tally” and “cognitive mobilisation” perspectives, which predict a positive coefficient.

Regarding the effect of political interest on partisanship, the results are less equivocal. Political interest has a statistically significant and substantial positive effects on both identification with the Labour and the Conservative party (see Table 3). They are equivalent to changes in the odds ranging from 19 to 43 per cent. The somewhat weaker effects in the devolved nations are compatible with a lower number of apartisans in the “other” category due to the relevance of the nationalist parties.

  • Table 4 about here –

Moreover, there is a strong correlation between membership in the mover/stayer groups and the direction of the (initial) party identification. In England, stayers are considerably more likely to identify with one of the two major parties (see Table 4) than movers. From the relative size of the groups it follows that only about 19 per cent (a quarter of 75 per cent) of the respondents remain in the “other” group over the course of the survey. In Scotland and Wales, however, stayers predominantly identify with none or one of the nationalist parties, whereas more than two thirds of the movers identified with Labour in 1997 but may have changed their allegiance further down the line.

  • Table 5 about here –

Taken together, the results imply that overall retention rates are high in some, but not in all circumstances as Table 5 reveals. In particular, we can see that Labour experiences a significantly lower rate of retention outside England while the situation is reversed for the Tories and to a lesser extent for the “other” parties, both of which see a higher levels of loyalty among supporters in Scotland and Wales than in Englandvi These findings suggest that some of the late-1990s support for Labour in Scotland and Wales may have been rather instrumental in nature, and that devolution may have facilitated and accelerated the emergence of subnational party systems in the devolved nations.

5. Conclusion

In many ways, the discussion between proponents of the Michigan model (that has been updated and revised many times since its first inception in the 1950s) and their revisionist critics could be described as a dialogue of the deaf. This is in part because both models will lead to very similar empirical findings under most circumstances. In this contribution, we have tried to bring some fresh air to this otherwise stale debate by taking a closer look at the role of interest in politics in affecting the prevalence and stability of party attachments. Relying on this perspective, we derived three models with clearly distinguishable predictions: the “running tally” model, the “cognitive mobilisation” model, and the “motivated reasoning” model, which is well in line with the traditional notion of party identification.

The evidence gleaned from the 1997-2000 BES panel survey suggests that in Britain the traditional model is better suited to describe the role of interest in politics in affecting the prevalence and stability of party attachments than its contenders. Rather than providing evidence for a frequent “updating” of identifications amongst those who are interested in politics, our results for England and Scotland and Wales support the classic view that a change in party identification is a comparatively rare event amongst both high- and low-interest citizens, and it is even rarer among the former than among the latter. Our findings thus support the classic notion of party identification (Campbell et al., 1960; see also Bartels 2002), which implies that party attachments serve as perceptual screen. In particular, they suggest that the affective nature of party identification is conducive to motivated reasoning and thereby lends considerable stability to party attachments. In line with recent findings in political psychology (e.g., Taber and Lodge, 2006), these self-stabilizing effects of party attachments are particularly strong among high-interest citizens. This finding in turn fits nicely into Zaller’s (1992) RAS model which posits that high levels of political awareness is valuable in identifying and refuting information that contradicts existing predispositions.

In accordance with the latter model, our findings also have implications for the dynamics of party identification at the aggregate level, the so-called macro-partisanship (e.g., MacKuen et al. 1989; Clarke et al. 2001; Clarke & Lebo 2003). They suggest that the dynamics in the aggregate-level distribution are primarily driven by voters who are not heavily interested in politics. To be sure, this finding on voter heterogeneity does not imply that these dynamics are indicative of some kind of irrationality (see on this debate, e.g., Page and Shapiro 1992). However, it contradicts the notion that it is highly involved voters who cause shifts in macro-partisanship, a notion that would appear to be desirable from a democratic accountability perspective. Thus our findings can be seen as supportive of the well-known paradox whereby individuals with less than ideal citizenship traits actually seem to make important contributions to the functioning of democratic political systems (Berelson et al. 1954: 316; Neuman 1986).

As is the case for most empirical studies of political behaviour, this paper is subject to several limitations.vii First, we studied the stability of party attachments in a specific period in time. The 1997-2000 period is probably atypical in that citizens were provided with much information that could make them switch party allegiances. While this characteristic made a good test case for the hypotheses it also limits the generalizability of our findings, although our additional analysis of the 2005-2009 data leads to essentially identical results. Also, we did not take into account the durability of changes in party attachments. With data from multi-wave panel surveys covering longer time periods, future research may also be able to distinguish short-term fluctuations from more permanent changes in party attachments and hence explore whether political interest affects the durability of shifts in party attachments. Moreover, we have to keep in mind that we simplified our model by treating political interest not as latent variable. Yet, this strategy is likely to have diluted the impact of political interest on the stability of party attachments. Utilizing more sophisticated techniques would probably yield evidence that supports our conclusions even more strongly. So, we are confident that our evidence lends considerable support to the classic notion of party identification in Great Britain.


Abramson, P.R. (1976) Generational Change and the Decline of Party Identification in America: 1952–1974. American Political Science Review, 70(2), pp. 469–478.

Albright, J.J. (2009) Does Political Knowledge Erode Party Attachments? A Review of the Cognitive Mobilization Thesis. Electoral Studies, 28(2), pp. 248–260.

Bartels, L. M. (2002) Beyond the Running Tally: Partisan Bias in Political Perceptions. Political Behavior, 24(2), pp. 117-150.

Bartle, J. (1999) Improving the Measurement of Party Identification in Britain. British Elections & Parties Review, 9, pp. 119–135.

Bartle, J. (2003) Measuring Party Identification: An Exploratory Study with Focus Groups. Electoral Studies, 22(2), pp. 217–237.

Berelson, B., Lazarsfeld, P.F. & McPhee, W. (1954) Voting: A Study of Opinion Formation in a Presidential Campaign. Chicago: University of Chicago Press.

Bevir, M. & Rhodes, R.A.W. (2006) Prime Ministers, Presidentialism and Westminster Smokescreens. Political Studies, 54(4), pp. 671–690.

Blais, A., Gidengil, E., Nadeau, R. & Nevitte, N. (2001) Measuring Party Identification: Britain, Canada, and the United States. Political Behavior, 23(1), pp. 5–22.

Bohrer, R.E. & Krutz, G.S. (2005) The Devolved Party Systems of the United Kingdom: Sub-national Variations from the National Model. Party Politics, 11(6), pp. 654–673.

Box-Steffensmeier, J.M. & Smith, R.M. (1996) The Dynamics of Aggregate Partisanship. American Political Science Review, 90, pp. 567-580.

Brody, R.A. & Rothenberg, L.S. (1988) The Instability of Partisanship: An Analysis of the 1980 Presidential Election. British Journal of Political Science, 18(Oct 88), pp. 445–465.

Brynin, M. & Sanders, D. (1997) Party Identification, Political Preferences and Material Conditions: Evidence from the British Household Panel Survey, 1991–1992. Party Politics, 3(1), pp. 53–77.

Butler, D. & Stokes, D. (1969) Political Change in Britain: Forces Shaping Electoral Choice (London: Macmillan).

Butler, D. & Stokes, D. (1974) Political Change in Britain: The Evolution of Electoral Choice (London: Macmillan).

Cain, B.E. & Ferejohn, J. (1981) Party Identification in the United States and Great Britain. Comparative Political Studies, 14(1), pp. 31–47.

Campbell, A., Converse, P.E., Miller, W.E. & Stokes, D.E. (1960) The American Voter (New York: Wiley).

Clarke, H.D. & McCutcheon, A.L. (2009) The Dynamics of Party Identification Reconsidered. Public Opinion Quarterly, 73(4), pp. 704–728.

Clarke, H.D. & Lebo, M. (2003) Fractional (Co)integration and Governing Party Support in Britain. British Journal of Political Science, 33, 283-301.

Clarke, H.D. & Stewart, M.C. (1984) Dealignment of Degree: Partisan Change in Britain, 1974–1983. Journal of Politics, 46(3), pp. 689–718.

Clarke, H.D., Stewart, M.C. & Whiteley, P. (1997) Tory Trends: Party Identification and the Dynamics of Conservative Support since 1992, British Journal of Political Science, 27(2), pp. 299–319.

Clarke, H.D., Stewart, M.C. & Whiteley, P. (1998) New Models for New Labour: The Political Economy of Labour Party Support, January 1992–April 1997. American Political Science Review, 92(3), pp. 559–575.

Clarke, H.D., Stewart, M.C. & Whiteley, P. (1999) New Labour’s New Partisans: The Dynamics of Party Identification in Britain since 1992. British Elections & Parties Review, 9(1), pp. 87–104.

Clarke, H.D., Stewart, M.C. & Whiteley, P. (2001) The Dynamics of Partisanship in Britain: Evidence and Implications for Critical Election Theory. British Elections & Parties Review, 11(1), pp. 66-83.

Clarke, H.D., Sanders, D., Stewart, M. & Whiteley, P. (2004) Political Choice in Britain (Oxford: Oxford University Press).

Clarke, H.D., Sanders, D., Stewart, M. & Whiteley, P. (2009) Performance Politics and the British Voter (Cambridge: Cambridge University Press).

Converse, P.E. (1962) Information Flow and the Stability of Partisan Attitudes. Public Opinion Quarterly, 26(4), pp. 578–599.

Converse, P.E. (2006) Researching Electoral Politics. American Political Science Review, 100(4), pp. 1–8.

Crewe, I., Särlvik, B. & Alt, J. (1977) Partisan Dealignment in Britain 1964–1974. British Journal of Political Science, 7(2), pp. 129–190.

Dalton, R.J. (1984) Cognitive Mobilization and Partisan Dealignment in Advanced Industrial Democracies. Journal of Politics, 46(1), pp. 264–284.

Dalton, R.J. (2014) Interpreting Partisan Dealignment in Germany. German Politics, 23(1-2), pp. 134-144.

Dalton, R.J. (2000) The Decline of Party Identifications, in: R.J. Dalton & M.P. Wattenberg (eds) Parties without Partisans. Political Change in Advanced Industrial Democracies (Oxford: Oxford University Press), pp. 19–36.

Downs, A. (1957) An Economic Theory of Democracy (New York: Harper and Row).

Finkel, S.E. (1993) Reexamining the “Minimal Effects” Model in Recent Presidential Campaigns. Journal of Politics, 55(1), pp. 1–21.

Fiorina, M.P. (1977) An Outline for a Model of Party Choice. American Journal of Political Science, 21(3), pp. 601–625.

Fiorina, M.P. (1981) Retrospective Voting in American National Elections (New Haven:Yale University Press).

Goodman, L.A. (1961) Statistical Methods for the Mover-Stayer Model. Journal of the American Statistical Association, 56(296), pp. 841–868.

Green, D., Palmquist, B. & Schickler, E. (2002) Partisan Hearts and Minds. Political Parties and the Social Identities of Voters (New Haven: Yale University Press).

Greene, S. (2004) Social Identity Theory and Party Identification. Social Science Quarterly, 85(1), pp. 136-153.

Heath, A. & Pierce, R. (1992) It was Party Identification all along: Question Order Effects on Reports of Party Identification in Britain. Electoral Studies, 11(2), pp. 93–105.

Johnston, R.J. & Pattie, C.J. (1996) The Strength of Party Identification Among the British Electorate: An Exploration. Electoral Studies, 15(3), pp. 295–309.

Kalton, G., Kasprzyk, D. & McMillen, D.B. (1989) Nonsampling Error in Panel Surveys, in: D. Kasprzyk, G. Duncan, G. Kalton & M.P. Singh (eds) Panel Surveys (New York: Wiley), pp. 249–270.

Katz, R.S. (1979) The Dimensionality of Party Identification: Cross-National Perspectives. Comparative Politics, 11(2), pp. 147–163.

Küchler, M. (1986) Wahl- und Surveyforschung. Politische Vierteljahresschrift, 27(Special Issue 17), pp. 194–208.

Langeheine, R., Pannekoek, J. & van de Pol, F. (1996) Bootstrapping Goodness-of-Fit Measures in Categorical Data Analysis. Sociological Methods & Research, 24(4), pp. 492–516.

Lebo, M. J. & Young, E. (2009) The Comparative Dynamics of Party Support in Great Britain: Conservatives, Labour and the Liberal Democrats. Journal of Elections, Public Opinion and Parties, 19 (1), pp. 73-103.

LeDuc, L. (1981) The Dynamic Properties of Party Identification: a Four-Nation Comparison. European Journal of Political Research, 9(3), pp. 257–268.

Lindenberg, S. (1985) An Assessment of the New Political Economy: Its Potential for the Social Sciences and Sociology in Particular. Sociological Theory, 3(1), pp. 99–114.

Lynch, P. (2007) Party System Change in Britain: Multi-Party Politics in a Multi-Level Polity. British Politics, 2(3), pp. 323–346.

MacKuen, M.B., Erikson, R.S. & Stimson, J.A. (1989) Macropartisanship. American Political Science Review, 83 (4), 1125-1142.

Milazzo, C., Adams, J. & Green, J. (2012) Are Voter Decision Rules Endogenous to Parties’ Policy Strategies? A Model with Applications to Elite Depolarization in Post-Thatcher Britain. Journal of Politics, 74(1), pp. 262–276.

Miller, W. E. (1994) An Organizational History of the Intellectual Origins of the American National Election Studies. European Journal of Political Research, 25(3), pp. 247–265.

Mughan, A. (1981) The Cross-National Validity of Party Identification: Great Britain and the United States Compared. Political Studies, 29(3), pp. 365–375.

Neuman, W. R. (1986) The Paradox of Mass Politics: Knowledge and Opinion in the American Electorate. Cambridge: Harvard University Press.

Neundorf, A., Stegmueller, D., & Scotto, T. J. (2011) The Individual-Level Dynamics of Bounded Partisanship. Public Opinion Quarterly, 75(3), pp. 458–482.

Nie, N. H., Verba, S. & Petrocik, J.R. (1976) The Changing American Voter (Cambridge: Harvard University Press).

Niemi, R.G., Wright, S.G. & Powell, L.W. (1987) Multiple Party Identifiers and the Measurement of Party Identification. Journal of Politics, 49(4), pp. 1093–1103.

Page, B.I. & Shapiro, R.Y. (1992) The Rational Public: Fifty Years of Trends in Americans’ Policy Preferences. Chicago: University of Chicago Press.

Pickup, M. (2009) Testing for Fractional Integration in Public Opinion in the Presence of Structural Breaks: A Comment on Lebo and Young. Journal of Elections, Public Opinion and Parties, 19 (1), pp. 105-116.

Popkin, S., Gorman, J.W., Phillips, C. & Smith, J.A. (1976) Comment: What Have You Done for Me Lately? Toward An Investment Theory of Voting. American Political Science Review, 70(3), pp. 779–805.

Prior, M. (2010) You’ve Either Got It or You Don’t? The Stability of Political Interest over the Life Cycle. Journal of Politics 72, pp. 747-766.

Rapoport, R.B. (1982) Sex Differences in Attitude Expressions: A Generational Explanation. Public Opinion Quarterly, 46(1), pp. 86–96.

Richardson, B.M. (1991) European Party Loyalties Revisited. American Political Science Review, 85(3), pp. 751–775.

Sanders, D. (2003) Party Identification, Economic Perceptions, and Voting in British General Elections, 1974–1997. Electoral Studies, 22(2), pp. 239–263.

Sanders, D., Burton, J. & Kneeshaw, J. (2002) Identifying the True Party Identifiers: A Question Wording Experiment. Party Politics, 8(2), pp. 193–205.

Schickler, E. & Green, D.P. (1997) The Stability of Party Identification in Western Democracies: Results from Eight Panel Surveys. Comparative Political Studies, 30(4), pp. 450–483.

Schleth, U. & Weede, E. (1971) Causal Models of West-German Voting Behavior. Sozialwissenschaftliches Jahrbuch für Politik, 2, pp. 73–97.

Stewart, M.C. & Clarke, H.D. (1998) The Dynamics of Party Identification in Federal Systems: The Canadian Case. American Journal of Political Science, 42(1), pp. 97–116.

Taber, C. S. & Lodge, M. (2006) Motivated Skepticism in the Evaluation of Political Beliefs. American Journal of Political Science 50, pp. 755-769.

Thomassen, J. (1976) Party Identification as a Cross-National Concept: Its Meaning in the Netherlands, in: I. Budge, I. Crewe & D. Farlie (eds) Party Identification and Beyond. Representations of Voting and Party Competition (London: Wiley), pp. 63–102.

Whiteley, P. F., Clarke, H. D., Sanders, D. & Stewart, M. C. (2013) Affluence, Austerity and Electoral Change in Britain (Cambridge: Cambridge University Press).

Zaller, J.R. (1992) The Nature and Origins of Mass Opinion (Cambridge: Cambridge University Press).

i While it is possible that random measurement error masks some true changes at the micro-level, the correlation of measurements at occasions t and t+1 will underestimate stability in the aggregate.

ii Similarly, Richardson (1991) claimed that in Britain partisanship did not resemble affective-laden identifications but rather cognitive partisanship.

iii Campbell et al (1960, p.135) proposed non-recursive rather than recursive effects between party identification and short-term attitudes, though they found party identification to be the predominant factor in the 1950s.

iv As Fiorina (1981: 90) suggests that party identification may also have non-political roots, this relationship might be attenuated.

v Dalton’s original measure of of cognitive mobilisation is an additive index of political interest and levels of formal education. We focus on political interest because it is more closely related to Fiorina’s idea of updating one’s identification based on the influx of new information, and also because average levels of formal education have risen sharply in Britain so that educational attainment is now closely linked to birth cohort membership.

vi It should be noted that the retention rates reported here refer only to those respondents who (net of any measurement error) were deemed to hold a perfectly stable identification across all four years. While this is a more conservative measure than looking just at consistency over the two ‘end’ points it does mean we exclude those too young to be included in all waves which may lead to some under-estimation of volatility levels, given the higher rates of switching commonly found among younger voters.

vii More recently, social identity theory has become quite popular in addressing party identification (e.g., Greene 2004), but we obviously have to rely on the traditional BES indicator..


Table 1: Theoretical Perspectives on the Expected Effects of Political Interest




Running tally”


Cognitive Mobilisation”

Motivated Reasoning”



Table 2: Model Fit


Free Parameters


Adjusted BIC


Mixed Markov




Mixed Markov + Interest




Scotland & Wales

Mixed Markov




Mixed Markov + Interest




Table 3 Effects of Political Interest






On Mover




On Lab-Identification




On Con-Identification




Scotland + Wales

On Mover




On Lab-Identification




On Con-Identification




Table 4: Mover/Stayer Property and Initial Party Identification (row percentages)

















Scotland + Wales











Table 5: Estimated Retention Rates 1997 → 2000 (per cent)









Scotland + Wales