Skip to main content
  • Home
  • About
  • Faculty Experts
  • For The Media
  • Videos
  • Topics
    • Alumni
    • Events
    • Faculty
    • Library
    • Research
    • Students
    • All Topics
  • Contact
  • Submit
STEM
  • All News
  • Arts & Culture
  • Business & Economy
  • Campus & Community
  • Health & Society
  • Media, Law & Policy
  • STEM
  • Veterans
  • |
  • Alumni
  • The Peel
  • Athletics
Sections
  • All News
  • Arts & Culture
  • Business & Economy
  • Campus & Community
  • Health & Society
  • Media, Law & Policy
  • STEM
  • Veterans
  • |
  • Alumni
  • The Peel
  • Athletics
  • Home
  • About
  • Faculty Experts
  • For The Media
  • Videos
  • Topics
    • Alumni
    • Events
    • Faculty
    • Library
    • Research
    • Students
    • All Topics
  • Contact
  • Submit
STEM

NSF Grant Will Allow Acuna to Study Optimization of Scientific Peer Review Process

Wednesday, August 29, 2018, By Diane Stirling
Share
facultyresearchSchool of Information Studies

Deficiencies in the scientific community’s centralized peer review process can impact more than a researcher’s career. Faults in the process can ultimately affect the kinds of scientific discoveries that are made, the distribution of information about findings, the technology innovations that do—or don’t—result and even the economic impact of scientific research work.

head shot

Daniel Acuna

With that premise and a goal and plan to improve the process, School of Information Studies (iSchool) Assistant Professor Daniel Acuna has attracted a $531,339 grant from the National Science Foundation.

For the next three years, he and two co-researchers will determine ways to optimize scientific peer review by creating a better understanding of the factors that affect the process and developing insights and plans to improve it. Acuna is the principal investigator for the project. He is working with co-principal investigators Konrad P. Kording, Penn Integrated Knowledge Professor at the University of Pennsylvania, and James A. Evans, director of Knowledge Lab, Professor of Sociology, and Director of the Computational Social Science program at the University of Chicago.

Acuna explains that some researchers have found that the scientific community’s centralized peer review process can be slow and low-quality, while other studies have quantified biases in the process, such as  prejudices against certain ideas and inconsistencies in opinions from different groups of peers. Those deficiencies can delay or shorten the dissemination of important research, he says. Such issues also can have larger effects, and not simply on the careers of scientific researchers. More broadly, those issues can affect the types of research that gets done, thus the direction science takes, plus the emergence of technology innovations and even the impact of scientific research on the economy.

“This grant can help illuminate one of the oldest and perhaps least understood aspects of how modern scientific knowledge is disseminated,” Acuna says. “Several research groups have shown that scientists can be against novel ideas or ideas produced by distant scientific relatives. Moreover, scientists can be inconsistent, judging essentially similar pieces of work wildly differently. These problems percolate into the peer review system and can be exacerbated by its anonymity. We hope to address some of these issues.”

In its scope, the research analyzes factors that affect peer review outcomes and uses those to improve reviewer selection. Ultimately, plans call for the development of software that will help optimize reviewer assignments and evaluate the resulting models. The analysis is being done in the real-world context of a scientific journal, major scientific conferences and massive open, online courses (MOOCs).

In its first phase, the project will quantify problems in bias, variance, timing, and quality of reviews, then identify bias as attributed to author and reviewer (such as age, gender, minority status and visibility and centrality within the field).  The second phase of research consists of assessing techniques to estimate the characteristics of potential reviewers. Then, the study will use that information to propose a review panel that is balanced in terms of reviewer choice, timing and quality of the process. In the last segment, the study will test the techniques that automatically assign reviewers and analyze the output of the process.

  • Author

Diane Stirling

  • Recent
  • Action Required: Review and Commit to the Stay Safe Pledge
    Thursday, January 21, 2021, By News Staff
  • Future of News Production the Focus of NSF Planning Grant
    Thursday, January 21, 2021, By Wendy S. Loughlin
  • College of Law Adds Vincent H. Cohen ’92, L’95 to Board of Advisors
    Wednesday, January 20, 2021, By Martin Walls
  • Students Invited to Network and Skill-Build with Alumni
    Wednesday, January 20, 2021, By Gabrielle Lake
  • ‘Confronting ‘Who We Are”
    Tuesday, January 19, 2021, By News Staff

More In STEM

Arts and Sciences Welcomes New Director of Forensics Kathleen Corrado

After 25 years working in the field of forensic science and over two decades of executive experience as a laboratory director, Kathleen Corrado has been named director of the Forensic and National Security Science Institute (FNSSI) in the College of…

Hehnly Lab Awarded $1.2M NIH Grant to Research Critical Tissue Formation

A key process during the development of an embryo is tissue morphogenesis, where the number of cells in an organism increase through cell division and tissues begins to take shape. Heidi Hehnly, assistant professor of biology, has been awarded a…

The Role of Digital Forensics and Tracking Down US Capitol Riot Criminals

With just under a week left before President-elect Joe Biden’s inauguration ceremony, investigators and law enforcement agencies across the country are working speedily to identify as many of the Jan. 6 U.S. Capitol riot offenders as they can. Knowing exactly…

A&S Researchers Awarded $2.1M Grant to Study Causes of Congenital Heart Defects

Congenital heart defects are the most common type of birth defect, affecting nearly 1 percent of births in the United States each year, according to the Centers for Disease Control and Prevention. Doctors have been unable to lower that number…

$1.5 Million NIH Grant Funds ALS-Linked Research

The human body is made up of trillions of cells. Within each cell are proteins which help to maintain the structure, function and regulation of the body’s tissues and organs. When cells are under stress, as in response to heat…

Subscribe to SU Today

If you need help with your subscription, contact sunews@syr.edu.

Connect With Us

  • Twitter
  • Facebook
  • Instagram
  • Youtube
  • LinkedIn
Social Media Directory

For the Media

Find an Expert Follow @SyracuseUNews
  • Facebook
  • Instagram
  • Youtube
  • LinkedIn
  • @SyracuseU
  • @SyracuseUNews
  • @SUCampus
  • Social Media Directory
  • Accessibility
  • Privacy
  • Campus Status
  • Syracuse.edu
© 2021 Syracuse University News. All Rights Reserved.