Skip to main content
  • Home
  • About
  • Faculty Experts
  • For The Media
  • Videos
  • Topics
    • Alumni
    • Events
    • Faculty
    • Library
    • Research
    • Students
    • All Topics
  • Contact
  • Submit
STEM
  • All News
  • Arts & Culture
  • Business & Economy
  • Campus & Community
  • Health & Society
  • Media, Law & Policy
  • STEM
  • Veterans
  • |
  • Alumni
  • The Peel
  • Athletics
Sections
  • All News
  • Arts & Culture
  • Business & Economy
  • Campus & Community
  • Health & Society
  • Media, Law & Policy
  • STEM
  • Veterans
  • |
  • Alumni
  • The Peel
  • Athletics
  • Home
  • About
  • Faculty Experts
  • For The Media
  • Videos
  • Topics
    • Alumni
    • Events
    • Faculty
    • Library
    • Research
    • Students
    • All Topics
  • Contact
  • Submit
STEM

NSF Grant Will Allow Acuna to Study Optimization of Scientific Peer Review Process

Wednesday, August 29, 2018, By Diane Stirling
Share
facultyresearchSchool of Information Studies

Deficiencies in the scientific community’s centralized peer review process can impact more than a researcher’s career. Faults in the process can ultimately affect the kinds of scientific discoveries that are made, the distribution of information about findings, the technology innovations that do—or don’t—result and even the economic impact of scientific research work.

head shot

Daniel Acuna

With that premise and a goal and plan to improve the process, School of Information Studies (iSchool) Assistant Professor Daniel Acuna has attracted a $531,339 grant from the National Science Foundation.

For the next three years, he and two co-researchers will determine ways to optimize scientific peer review by creating a better understanding of the factors that affect the process and developing insights and plans to improve it. Acuna is the principal investigator for the project. He is working with co-principal investigators Konrad P. Kording, Penn Integrated Knowledge Professor at the University of Pennsylvania, and James A. Evans, director of Knowledge Lab, Professor of Sociology, and Director of the Computational Social Science program at the University of Chicago.

Acuna explains that some researchers have found that the scientific community’s centralized peer review process can be slow and low-quality, while other studies have quantified biases in the process, such as  prejudices against certain ideas and inconsistencies in opinions from different groups of peers. Those deficiencies can delay or shorten the dissemination of important research, he says. Such issues also can have larger effects, and not simply on the careers of scientific researchers. More broadly, those issues can affect the types of research that gets done, thus the direction science takes, plus the emergence of technology innovations and even the impact of scientific research on the economy.

“This grant can help illuminate one of the oldest and perhaps least understood aspects of how modern scientific knowledge is disseminated,” Acuna says. “Several research groups have shown that scientists can be against novel ideas or ideas produced by distant scientific relatives. Moreover, scientists can be inconsistent, judging essentially similar pieces of work wildly differently. These problems percolate into the peer review system and can be exacerbated by its anonymity. We hope to address some of these issues.”

In its scope, the research analyzes factors that affect peer review outcomes and uses those to improve reviewer selection. Ultimately, plans call for the development of software that will help optimize reviewer assignments and evaluate the resulting models. The analysis is being done in the real-world context of a scientific journal, major scientific conferences and massive open, online courses (MOOCs).

In its first phase, the project will quantify problems in bias, variance, timing, and quality of reviews, then identify bias as attributed to author and reviewer (such as age, gender, minority status and visibility and centrality within the field).  The second phase of research consists of assessing techniques to estimate the characteristics of potential reviewers. Then, the study will use that information to propose a review panel that is balanced in terms of reviewer choice, timing and quality of the process. In the last segment, the study will test the techniques that automatically assign reviewers and analyze the output of the process.

  • Author

Diane Stirling

  • Recent
  • Activities for the Weekend of April 22-25
    Thursday, April 22, 2021, By News Staff
  • Annual Remembrance and Lockerbie Scholar Convocation to Be Held April 30
    Thursday, April 22, 2021, By News Staff
  • Watch Pomp and Ceremony of the 104th Chancellor’s Review Award Ceremony Live on April 23
    Wednesday, April 21, 2021, By Brandon Dyer
  • Chancellor Syverud Provides Updates to the University Senate
    Wednesday, April 21, 2021, By News Staff
  • Let’s Talk About Current Issues Welcomes Open Dialogue
    Wednesday, April 21, 2021, By Gabrielle Lake

More In STEM

Intelligence++ Competition Winners Announced

Three interdisciplinary teams won the inaugural Intelligence++ design and entrepreneurship competition held at Syracuse University Libraries’ Blackstone LaunchPad & Techstars (LaunchPad) on April 16. MeetCute won the $15,000 gold prize, HG Sensory won the $10,000 silver prize and Fundwurx won…

Fusion of Art and Science Leads to Discovery

Robert Wysocki arrived at Syracuse University in 2008, having made a name in the art world by capturing landscapes in three dimensions. Known for large sand sculptures showcased in galleries from Los Angeles to Florida, Wysocki’s inspiration began on a…

Bioengineering Ph.D. Student Receives National Recognition for Breakthrough Molecular Computational Tool

Nandhini Rajagopal’s accomplishments are massive even though her research focuses on small molecules. As part of biomedical and chemical engineering Professor Shikha Nangia’s research group, the Ph.D. student has focused her work on minute interactions between protein molecules in the…

New Study From Department of Biology Highlights Ways to Support Students in Virtual Learning Environments

The mass migration to virtual learning that resulted from the COVID-19 pandemic led to a profound change in student learning. While it presented many challenges, it also created opportunities for documenting responses. Two researchers from the Department of Biology in…

Research Computing: A Decade of Discovery on Campus

Do you need more computing power to move your work forward? Since 2011, the Research Computing team within Information Technology Services (ITS) has helped faculty and staff tackle computational challenges beyond the capabilities of a normal desktop or laptop computer. Each…

Subscribe to SU Today

If you need help with your subscription, contact sunews@syr.edu.

Connect With Us

  • Twitter
  • Facebook
  • Instagram
  • Youtube
  • LinkedIn
Social Media Directory

For the Media

Find an Expert Follow @SyracuseUNews
  • Facebook
  • Instagram
  • Youtube
  • LinkedIn
  • @SyracuseU
  • @SyracuseUNews
  • @SUCampus
  • Social Media Directory
  • Accessibility
  • Privacy
  • Campus Status
  • Syracuse.edu
© 2021 Syracuse University News. All Rights Reserved.