Self-Selected or Mandated, Open Access Increases Citation Impact for Higher Quality Research
For years, researchers assumed that the Open Access citation advantage was probably a mirage. The argument went like this: scientists are strategic. They know which of their papers are strongest, and they choose to post those freely on the web. So naturally, the freely available papers get cited more — not because anyone gained access they wouldn't otherwise have had, but because the papers were already better. The citation boost wasn't about openness. It was about quality filtering done by the authors themselves. That assumption shaped how the field thought about open access policy for a long time. Then Gargouri and colleagues ran a natural experiment on twenty-seven thousand articles across four universities, and the assumption collapsed. Here's the problem they were solving. Open Access self-archiving is when an author deposits their final refereed draft on the web — freely available to anyone, not just subscribers. It supplements the publisher's version rather than replacing it. This matters because citation counts are the currency of research evaluation. They feed into funding decisions, hiring, and promotion. And the scale of inaccessibility is genuinely large: roughly twenty-five thousand peer-reviewed journals publish about two point five million articles per year, and no institution can subscribe to all of them.
Articles that can't be reached don't get cited. The question is whether removing that barrier causally increases impact, or whether the observed advantage is just authors cherry-picking their best work to post. The elegant lever Gargouri and colleagues used to crack this open was the comparison between voluntary and mandated Open Access. The logic is clean: if authors are strategically posting only their most citable papers, then forcing them to post everything should dilute the advantage. Under a mandate, low-quality and high-quality work alike get deposited, so any quality filter disappears. If the citation advantage persists under a mandate, that implicates access itself, not author selection. The four institutions they drew on were those with the longest-standing self-archiving mandates at the time: the University of Southampton's School of Electronics and Computer Science, with a mandate since two thousand two; CERN, the particle physics laboratory, since late two thousand three; Queensland University of Technology since early two thousand four; and Minho University in Portugal since late two thousand four.
The final dataset covered twenty-seven thousand one hundred ninety-seven articles published between two thousand two and two thousand six, spread across one thousand nine hundred eighty-four journals indexed by Thomson-Reuters. Articles from Open Access journals were excluded because same-journal comparisons between Open Access and non-Open Access articles weren't possible for them. The controls were carefully matched. Each mandated Open Access article was paired with non-Open Access articles from the same journal, same volume, same year — and then further narrowed to the ten non-Open Access articles whose titles shared the most words with the target article. That keyword matching kept the subject matter comparable. Open Access status was verified by an automated web robot and Google Scholar searches. Citation counts were extracted in November two thousand eight, giving the articles at least two years to accumulate citations. Verified compliance under the mandates was about sixty percent. Spontaneous self-archiving among the control articles was about fifteen percent — consistent with the commonly reported global baseline.
The results are direct. Open Access articles were cited more, and mandated Open Access showed just as large a citation advantage as self-selected Open Access. The team computed within-journal log ratios — for each journal, they took the logarithm of the citation ratio between one article class and another, then averaged those log differences across journals. This approach reduces the distortion from very highly cited outliers and keeps comparisons within the same journal and year. The mean log differences were all significantly greater than zero. When comparing mandated Open Access articles directly to self-selected Open Access articles using the same journal-level log-ratio method, they found no detectable reduction in the advantage. A mandate that triples the deposit rate — from about fifteen percent to about sixty percent — does not shrink the citation boost. But could the advantage still be explained by other factors? Older articles have had more time to accumulate citations. Higher-impact journals produce more highly cited papers on average. Articles with more co-authors, more references, more pages, and review-type classifications all tend to get cited more. First authors based in the United States show a positive citation correlation. All of these are potential confounders.
Gargouri and colleagues ran stepwise logistic regression on the full twenty-seven thousand one hundred ninety-seven article sample, controlling simultaneously for article age, journal impact factor, number of co-authors, number of references, number of pages, scientific field, article type, and country of the first author. They also subtracted self-citations — about thirty-two percent of articles had at least one, averaging two self-citations per article — to avoid inflating the effect. Because citation distributions are heavily skewed, they structured the regression as four binary comparisons across citation ranges: zero versus one to four citations, one to four versus five to nine, one to four versus ten to nineteen, and one to four versus twenty or more. Open Access remained a statistically significant independent predictor in three of the four models. In the middle range — distinguishing articles with one to four citations from those with five to nine — a one-unit change in Open Access status raised the odds of falling in the higher group by a factor of one point thirty-two. The advantage was largest in the highest citation range. And there was a significant interaction between Open Access and article age: the Open Access advantage grows as articles get older, meaning access keeps paying off over time.
This is where the finding gets interpretively interesting. The Open Access advantage is not uniform across the citation distribution — it's skewed toward the top. About twenty percent of articles receive about eighty percent of all citations, a Pareto-style concentration that holds generally across scientific publishing. Open Access amplifies that existing skew rather than creating it. The boost is greatest for articles that would have been highly cited anyway. And crucially, this pattern holds just as strongly under mandate, when authors have no ability to select what gets posted. The paper's interpretation is that the skew reflects user self-selection, not author self-selection. When subscription walls come down, readers can find and cite the best available work more efficiently. The constraint that was removed was access — not quality. Higher-quality papers benefit more from Open Access because once researchers can reach them, they use them more, in proportion to their usefulness. Gargouri and colleagues call this a "quality advantage" rather than a "quality bias": the effect is driven by what readers do with open access, not by what authors choose to post. The practical implications follow directly from the causal finding. If the Open Access advantage were merely a selection artifact, institutions would have little reason to mandate self-archiving. But because the advantage is real and independent of other citation correlates, the incentive structure changes.
Spontaneous self-archiving sits at about fifteen to twenty percent globally. Mandates at these four institutions raised that to about sixty percent. Survey data cited in the paper suggest that ninety-five percent of researchers would self-archive if required — eighty-one percent willingly, fourteen percent reluctantly, and about five percent who would not comply. Mandates adopted elsewhere have reportedly driven deposit rates well toward one hundred percent within about two years. The ceiling on impact from voluntary participation is low. The ceiling from mandated participation is not. What Gargouri and colleagues ultimately showed is that access genuinely changes how science gets used. That's not a small finding. Research that could influence other work but sits behind a paywall inaccessible to most of the world's researchers is research that loses some of its effect. Open Access doesn't just make articles available — it shifts the probability that the best work actually reaches the people who can act on it. The authors note that as Open Access approaches one hundred percent, the competitive advantage between Open Access and non-Open Access articles will shrink, because the access playing field will be level. But the quality advantage — the tendency for researchers to preferentially use the best work when all of it is reachable — will persist.
Downloads remain higher for Open Access articles and continue to drive later citations. The mechanism doesn't disappear when everyone is open. It just stops being a distinguishing factor and becomes the floor. This lecture was created by ennepō. Go to https://ennepo.ai to Discover, Create and Follow the latest research in your field. Read when you can. Listen when you want to.
Related lectures
- ‘Predatory’ open access: a longitudinal study of article volumes and market characteristics
- Do Altmetrics Work? Twitter and Ten Other Social Web Services
- Do Pressures to Publish Increase Scientists' Bias? An Empirical Support from US States Data
- A Dual-Self Model of Impulse Control
- Citation Advantage of Open Access Articles
- The heterogeneity statistic I2 can be biased in small meta-analyses