Source-linked AI summary
Scientific Utopia: I. Opening scientific communication
Brian A. Nosek, Yoav Bar-Anan
TL;DR
Existing journal practices create risks around reputation and access, so the paper outlines author-led, graded, and more open communication. It concludes that faster dissemination could accelerate progress and identify research limitations sooner, though coordination remains a challenge.
Problem
Closed journals and their accumulated reputations make switching outlets risky, limiting movement away from established scientific communication practices.
Method
The paper proposes shifting gatekeeping toward authors and separating dissemination from evaluation through reviewer-based article grading.
Results
The proposed model would distribute new results instantly, identify research limitations more quickly, and begin publication on the first day.
Takeaways & Limitations
More open and continuous scientific communication could accelerate progress and address research limitations sooner.
Takeaways & Limitations
Implementation faces challenges, particularly coordinating interest groups to translate the ideal model into practice.
Abstract
from arXiv · showhide
Existing norms for scientific communication are rooted in anachronistic practices of bygone eras, making them needlessly inefficient. We outline a path that moves away from the existing model of scientific communication to improve the efficiency in meeting the purpose of public science - knowledge accumulation. We call for six changes: (1) full embrace of digital communication, (2) open access to all published research, (3) disentangling publication from evaluation, (4) breaking the "one article, one journal" model with a grading system for evaluation and diversified dissemination outlets, (5) publishing peer review, and, (6) allowing open, continuous peer review. We address conceptual and practical barriers to change, and provide examples showing how the suggested practices are being used already. The critical barriers to change are not technical or financial; they are social. While scientists guard the status quo, they also have the power to change it.
The Present of Scientific Communication
Scientific communication follows a journal-centered process in which manuscripts undergo editorial screening, peer review, revision, and publication scheduling. A laboratory case study shows that this process often involves multiple journals and substantial delays before publication.
- The standard practice: Researchers select among approximately 23,750 journals based on prestige, acceptance rates, topical area, methods, format, readership, length, and publication frequency.These choices aim to promote careers and maximize research impact, while review, publication, and patience lags can delay publication.
- The standard practice: Editors screen submissions and solicit one to five expert reviews before accepting, rejecting, or requesting revision; reviews are typically anonymous and unpaid.Editors may return revisions to previous or new reviewers, repeating the process until acceptance, rejection, or author exhaustion.
- The standard practice: Acceptance rates vary widely across journals, with some below 10%, while typical rejection rates range from 70%-90% in social sciences and 20%-40% in physical sciences.The same manuscript may therefore be reviewed by multiple teams at multiple journals before acceptance.
- A case study of one laboratory’s scientific communication: Only 37% (23/62) of manuscripts were accepted by the first journal, whereas 52% (32/62) were submitted to at least two journals.The case study also reports that journal choice predicted 12%-18% of citation impact.
Inefficiencies in Scientific Communication
Scientific communication is inefficient in the digital era because research can be nonexistent, slow, incomplete, inaccurate, or unmodifiable. These failures waste time, effort, and resources and impair knowledge accumulation.
- A. No communication: Unpublished research, especially nonsignificant results, creates a file-drawer effect that can inflate false-positive rates, distort meta-analytic effects, and produce confirmation bias.Researchers may also abandon positive-result manuscripts because of competing demands, leaving useful findings unavailable.
- A. No communication: Four manuscripts (6%) in the case study contained positive results but remained unpublished and in stasis for an average of 9.7 years after original submission.At least three would still make a unique contribution, while the fourth would minimally affirm a now-published result.
- B. Slow communication: Published manuscripts appeared in print nearly two years after being written because review and publication processes introduce substantial delays.Repeated journal review and publication lags can postpone access to results by many months.
- C. Incomplete communication: Articles provide incomplete communication because reported methodology reflects researchers’ qualitative judgments about what matters, not necessarily what is actually important.Published articles cannot report everything that was done or found.
- D. Inaccurate communication: An analysis of psychology publications found an 18% error rate, with 15% of articles reporting an incorrect statistical conclusion.Reviewers detect only a minority of possible errors because they are constrained by the report and the effort invested in review.
- E. Unmodifiable communication: Published articles are static, so known deficiencies continue influencing research because revision, retraction, errata, and comments are rare and opportunities for reexamination are limited.Although scientists can debate critiques rapidly online, the original article may remain unmodified.
The Futures of Scientific Communication
The paper proposes six cumulative changes to scientific communication to improve the pace and quality of knowledge accumulation, while enabling practical steps and critical review of existing systems.
- The Futures of Scientific Communication: The authors argue that the current scientific communication system is improvable and that greater openness and updated filtering can accelerate and improve scientific knowledge accumulation.They aim to demonstrate benefits for both the pace and quality of accumulating knowledge and the scientific literature.
- The Futures of Scientific Communication: The overall goal is to promote critical review of scientific communication systems and initiate practical steps toward improving them.The proposed changes are presented as a way to improve scientific communication rather than address every part of the scientific process.
- The Futures of Scientific Communication: They propose six cumulative stages focused on publishing original research, with later stages partly dependent on earlier changes but sometimes adoptable beforehand.Each stage covers the proposed change, its effects, objections, existing examples, and practical barriers.
Stage 1: Full embrace of digital communication
The authors propose replacing paper-based scientific communication with Internet-first publication to eliminate print-driven delays and constraints. Digital communication enables faster, broader, cheaper, and more accessible dissemination while preserving substantive editorial standards.
- Stage 1: Full embrace of digital communication: Internet-first communication replaces paper as science’s primary channel, enabling rapid digital publication and removing printing, shipping, storage, and issue-based delivery.Articles can be published after editorial review and copyediting, eliminating publication lag; digital delivery also supports continuous website access, automated feeds, email highlights, search, and citation linking.
- Stage 1: Full embrace of digital communication: 5–10 months, or 20%–40% of submission-to-publication time, is the typical publication lag caused by issue-based print practices.Digital publication can eliminate this lag completely, and the two case-study articles with the shortest publication times appeared in journals without publication lag.
- Stage 1: Full embrace of digital communication: Removing page limits would let journals accept as many manuscripts as meet their standards, reducing rejection-driven delays and repeated review rounds.Editors could work more flexibly with marginal manuscripts rather than defaulting to rejection, potentially reducing repeated author, editor, and reviewer effort.
- Stage 1: Full embrace of digital communication: Converting 90% of publications to electronic-only would save 5% of publishers’ costs and 36% of libraries’ access costs, totaling more than $1.6 billion.Digital access can also reduce institutional access disparities by making articles available through an Internet connection rather than subscriptions or subscribing libraries.
Stage 2: Open access to all published research
Stage 2 proposes replacing closed-access publishing with fully open digital delivery, making research freely accessible while reducing publishing costs. The paper argues that this shift is already underway but requires the scientific community to build confidence in open-access journals.
- Stage 2: Open access to all published research: $900 million in total publishing-cost reductions could accompany the move to open access, beyond savings from digital distribution.The paper characterizes open access as both a financial benefit and a means of broadening accessibility.
- Stage 2: Open access to all published research: Open access replaces reader-paid subscriptions with upfront publication fees paid by authors, funders, or institutions, making published research freely available.The paper presents open publishing as financially preferable to closed solutions in the digital era.
- Stage 2: Open access to all published research: Closed access transfers copyright from publicly funded researchers to publishers, which then sell access back through subscriptions and individual article charges.Individual articles can cost $5-$50, while institutional subscriptions impose major university-budget costs.
- Stage 2: Open access to all published research: Open-access articles reach more readers and show a citation-impact advantage over closed-access articles.The paper cites evidence for both greater readership and higher citation impact, while noting that OA journals are becoming sustainable and respected.
- Stage 2: Open access to all published research: The shift to fully open digital delivery lets anyone read, learn from, and critique scientific research, but established journal reputations create adoption risks.These risks are especially consequential for early-career scientists who rely on publication venues for reputation building.
Stage 4: A grading evaluation system and a diversified dissemination system
Stage 4 changes scientific communication by separating peer review from journals and replacing journal gatekeeping with article grading and diversified dissemination. Journals promote rather than exclusively publish articles, enabling multiple content filters and article-level evaluation.
- Grading evaluation: Stage 4 alters peer review and dissemination by separating manuscript evaluation from specific journals.Authors submit to review services that grade manuscripts rather than decide journal-specific acceptance.
- Diversified dissemination: Because all articles are published, journals promote articles without exclusive claims, allowing dozens of journals to promote the same article.A distinct curator role selects articles for promotion in particular journals.
- Diversified dissemination: Open access and diversified dissemination create many possible content filters for distributing research.In this model, dissemination mechanisms across an open system function as content filters.
- Article-level evaluation: The same article can appear in dozens or hundreds of journals using whatever dissemination criteria outlets deem relevant.Breaking the one-journal constraint shifts evaluation of quality and impact toward the article itself.
- Article-level evaluation: Journal impact factors obscure substantial within-journal variation because they mainly reflect a small minority of high-impact papers.The cited comparison reports that 35-40% of citations go to the top 10% of articles, while the bottom half account for 10-15%.
The New Reality
The section depicts a digitally connected scientific system in which open commentary, grading, and rapid corrections guide discovery, revision, and evaluation. Publication quality and influence are assessed through review data, ongoing discussion, and qualitative judgment rather than publication counts alone.
- The New Reality: Scientists discover research through personalized filters combining review grades, comments, citations, authors, and keywords.Hari Seldon’s filters include grade thresholds, comment counts, citation counts, followed researchers, and relevant keywords.
- The New Reality: Open, continuous commentary enables immediate methodological correction, extended debate, and later revisions that address critical points.Seldon responds to a newly identified analysis problem, while delaying his own response so broader discussion can develop before revision.
- The New Reality: Researchers publish before certified review, accumulate open commentary for a few months, then revise before submitting to a review service.The model treats expert feedback before certification as a way to improve article quality.
- The New Reality: Review quality can serve as a tie-breaker when publication records differ, especially when reviews influence revisions, attract citations, and reveal broader analytic talent.The faculty considers highly rated, influential reviews alongside evidence of expertise not visible in a candidate’s publication record.
Conclusion
The proposed shift toward open scientific communication is technically and financially feasible, with implementation examples already demonstrating viability. Scientists can advance these changes to accelerate information flow, critique, and cumulative knowledge building.
- Implementation: The authors present staged implementation as a viable path toward broad-scale open scientific communication, while acknowledging reasonable alternatives and coordination challenges.Small-scale examples suggest the ideas can be enhanced without waiting for prior stages to finish.
- Implementation: Scientists and societies hold primary power to change scientific communication by supporting open-access funding, publishing openly, and participating in post-publication peer review.Scientists can also discuss desired scientific practices rather than simply accepting existing ones.
- Expected effects: If implemented, the changes would leave daily laboratory practice largely unchanged while greatly increasing information flow and distributing new results widely and instantly.Communication would begin early in research rather than only after publication.
- Expected effects: The reforms would accelerate identification of limitations and shift scientists’ effort from publication decisions toward interpreting, testing, and extending others’ results.In the case study, an average of 677 days elapses between initial submission and publication; the authors argue publication could occur on the first day, leaving remaining time for critique, revision, and follow-up.
- Broader reforms: Further openness in areas such as data and workflow could better align scientific values with practice and help maximize rapid progress toward a cumulative knowledge base of nature.The authors call on scientists to evaluate and improve daily practices and disciplinary norms.