Skip to main content
  • Home
  • About
  • Faculty Experts
  • For The Media
  • Videos
  • Topics
    • Alumni
    • Events
    • Faculty
    • Library
    • Research
    • Students
    • All Topics
  • Contact
  • Submit
STEM
  • All News
  • Arts & Culture
  • Business & Economy
  • Campus & Community
  • Health & Society
  • Media, Law & Policy
  • STEM
  • Veterans
  • |
  • Alumni
  • The Peel
  • Athletics
Sections
  • All News
  • Arts & Culture
  • Business & Economy
  • Campus & Community
  • Health & Society
  • Media, Law & Policy
  • STEM
  • Veterans
  • |
  • Alumni
  • The Peel
  • Athletics
  • Home
  • About
  • Faculty Experts
  • For The Media
  • Videos
  • Topics
    • Alumni
    • Events
    • Faculty
    • Library
    • Research
    • Students
    • All Topics
  • Contact
  • Submit
STEM

NSF Grant Will Allow Acuna to Study Optimization of Scientific Peer Review Process

Wednesday, August 29, 2018, By Diane Stirling
Share
facultyresearchSchool of Information Studies

Deficiencies in the scientific community’s centralized peer review process can impact more than a researcher’s career. Faults in the process can ultimately affect the kinds of scientific discoveries that are made, the distribution of information about findings, the technology innovations that do—or don’t—result and even the economic impact of scientific research work.

head shot

Daniel Acuna

With that premise and a goal and plan to improve the process, School of Information Studies (iSchool) Assistant Professor Daniel Acuna has attracted a $531,339 grant from the National Science Foundation.

For the next three years, he and two co-researchers will determine ways to optimize scientific peer review by creating a better understanding of the factors that affect the process and developing insights and plans to improve it. Acuna is the principal investigator for the project. He is working with co-principal investigators Konrad P. Kording, Penn Integrated Knowledge Professor at the University of Pennsylvania, and James A. Evans, director of Knowledge Lab, Professor of Sociology, and Director of the Computational Social Science program at the University of Chicago.

Acuna explains that some researchers have found that the scientific community’s centralized peer review process can be slow and low-quality, while other studies have quantified biases in the process, such as  prejudices against certain ideas and inconsistencies in opinions from different groups of peers. Those deficiencies can delay or shorten the dissemination of important research, he says. Such issues also can have larger effects, and not simply on the careers of scientific researchers. More broadly, those issues can affect the types of research that gets done, thus the direction science takes, plus the emergence of technology innovations and even the impact of scientific research on the economy.

“This grant can help illuminate one of the oldest and perhaps least understood aspects of how modern scientific knowledge is disseminated,” Acuna says. “Several research groups have shown that scientists can be against novel ideas or ideas produced by distant scientific relatives. Moreover, scientists can be inconsistent, judging essentially similar pieces of work wildly differently. These problems percolate into the peer review system and can be exacerbated by its anonymity. We hope to address some of these issues.”

In its scope, the research analyzes factors that affect peer review outcomes and uses those to improve reviewer selection. Ultimately, plans call for the development of software that will help optimize reviewer assignments and evaluate the resulting models. The analysis is being done in the real-world context of a scientific journal, major scientific conferences and massive open, online courses (MOOCs).

In its first phase, the project will quantify problems in bias, variance, timing, and quality of reviews, then identify bias as attributed to author and reviewer (such as age, gender, minority status and visibility and centrality within the field).  The second phase of research consists of assessing techniques to estimate the characteristics of potential reviewers. Then, the study will use that information to propose a review panel that is balanced in terms of reviewer choice, timing and quality of the process. In the last segment, the study will test the techniques that automatically assign reviewers and analyze the output of the process.

  • Author

Diane Stirling

  • Recent
  • Graduate Students Bring Physics to Local Classrooms With Outreach Program
    Friday, May 27, 2022, By Dan Bernardi
  • COVID-19 Update: Effective Wednesday, June 1, Masking Level Returns to Yellow
    Friday, May 27, 2022, By News Staff
  • Preparing Students for a Life of Success
    Friday, May 27, 2022, By Caroline K. Reff
  • Alumni Draw on Their Military Experience in Their Roles as Teachers
    Thursday, May 26, 2022, By Martin Walls
  • Bringing ‘CSI’ Into the Classroom
    Thursday, May 26, 2022, By Dan Bernardi

More In STEM

Graduate Students Bring Physics to Local Classrooms With Outreach Program

“When am I ever going to use this in real life?” That is the oft-heard refrain from middle- and high-school science students, struggling through labs and formulas that feel as far removed from their day-to-day as, well, space travel. Sarthak…

Bringing ‘CSI’ Into the Classroom

Dusting for fingerprints, documenting blood stain patterns and measuring bullet trajectory—you might think this is a description of a recent episode from the popular television series “CSI.” While this may be true, these are also the daily lessons students are…

Matt Cufari Named as a 2022-23 Astronaut Scholar

Matt Cufari, a senior physics major in the College of Arts and Sciences (A&S), a computer science major in the College of Engineering and Computer Science, a Coronat Scholar and a member of the Renée Crown University Honors Program, has…

Dean Rajiv ‘Raj’ Dewan to Step Down as Dean of the School of Information Studies

Rajiv “Raj” Dewan, dean of the School of Information Studies, has announced he will conclude his deanship on June 30, 2022. Dewan plans to return to full-time faculty duties while continuing his research. David Seaman, dean of Syracuse University Libraries…

Biology and Earth and Environmental Sciences Departments Come Together on Diversity and Engagement Initiatives

In 1948, Professor James Hope Birnie became Syracuse University’s first African American faculty member in biology, teaching here until 1951. He was also one of its first biology faculty members to be supported by the National Institutes of Health (NIH)….

Subscribe to SU Today

If you need help with your subscription, contact sunews@syr.edu.

Connect With Us

  • Twitter
  • Facebook
  • Instagram
  • Youtube
  • LinkedIn
Social Media Directory

For the Media

Find an Expert Follow @SyracuseUNews
  • Facebook
  • Instagram
  • Youtube
  • LinkedIn
  • @SyracuseU
  • @SyracuseUNews
  • @SUCampus
  • Social Media Directory
  • Accessibility
  • Privacy
  • Campus Status
  • Syracuse.edu
© 2022 Syracuse University News. All Rights Reserved.