Peer review sits at the heart of academic publishing. For a field as methodologically diverse and high-stakes as engineering education research, the peer review process is not merely a bureaucratic hurdle—it is the primary mechanism that upholds scholarly integrity, ensures methodological rigor, and filters contributions that genuinely advance teaching, learning, and curricular design. Without rigorous peer evaluation, the credibility of published findings in areas such as active learning, assessment design, and diversity interventions would be severely undermined. This article examines the peer review process in engineering education research: its importance, typical workflow, persistent challenges, and the innovative reforms that promise to make it more transparent, efficient, and equitable.

The Role of Peer Review in Engineering Education Research

Engineering education research (EER) is a relatively young but rapidly maturing discipline. It draws on both quantitative and qualitative methods—from controlled experiments and psychometric analysis to ethnographic observation and design-based research. This methodological breadth places a heavy burden on peer reviewers, who must judge not only the technical soundness of a study but also its suitability within the specific epistemological traditions of educational research.

The primary role of peer review in this context is quality control. Reviewers evaluate whether the research question is clearly defined, whether the methodology is appropriate and faithfully executed, whether the data support the conclusions, and whether the manuscript contributes something new to the existing knowledge base. This process helps journals maintain a high standard of publication, which in turn supports tenure and promotion decisions, grant funding evaluations, and the practical adoption of evidence-based teaching practices in engineering classrooms.

Furthermore, peer review in EER serves an educational function. Many authors—especially graduate students and early-career researchers—find that constructive reviewer feedback sharpens their thinking and strengthens their manuscripts. The iterative cycle of review and revision is a core part of scholarly development.

The Standard Peer Review Workflow

While variations exist across journals, the typical peer review process in engineering education research follows a well-defined sequence. Understanding each stage helps authors and reviewers collaborate more effectively.

Initial Submission

The author submits a manuscript to a journal, often through an online submission system. The manuscript is formatted according to the journal’s specific guidelines, which typically include abstract, keywords, introduction, literature review, methodology, results, discussion, conclusion, and references.

Editorial Screening

Upon submission, the editor or associate editor conducts an initial assessment. This screening checks for scope alignment—does the paper fit the journal’s mission?—and basic quality standards, such as clarity of writing, adherence to ethical guidelines, and absence of obvious fatal flaws. Many manuscripts are rejected at this stage (“desk reject”) without being sent for external review. In engineering education journals, desk reject rates can be high, often exceeding 30% to 40%.

Selection of Reviewers

If the manuscript passes screening, the editor identifies two to four expert reviewers. Reviewers are typically selected from the journal’s reviewer database, author suggestions, or the editor’s own professional network. The goal is to assemble a diverse panel with complementary expertise—someone with deep knowledge of the methodological approach and someone familiar with the specific teaching context or theoretical framework.

Double-Blind or Single-Blind Review

Most engineering education journals employ double-blind review, meaning both the author and reviewer identities are concealed. This aims to reduce bias based on author reputation, institution, gender, or nationality. Some journals use single-blind review, where reviewers know the authors but not vice versa. A small but growing number have adopted open review, where identities are disclosed.

Review Submission and Evaluation

Reviewers read the manuscript and provide a detailed evaluation, typically including a recommendation to accept, revise, or reject, along with a rationale. Constructive reviews highlight strengths, identify weaknesses, and suggest concrete improvements. Common criteria evaluated include originality, theoretical grounding, methodological rigor, clarity of argument, and practical significance.

Decision and Revision Cycle

After collecting typically two to three reviews, the editor makes a decision. Most decisions are “major revision” or “minor revision,” requiring the author to address reviewer comments and resubmit a revised manuscript. The revised version may go back to the original reviewers or be evaluated solely by the editor. This cycle may repeat multiple times.

Acceptance and Publication

Once the editor is satisfied that all concerns have been addressed, the manuscript is accepted for publication. It is then copyedited, typeset, and published online, often with a DOI. The entire process from submission to acceptance typically takes six to twelve months, though some journals aim for faster turnaround.

Persistent Challenges in Peer Review for Engineering Education Research

Despite its centrality, peer review is far from perfect. The challenges are well documented and affect authors, reviewers, editors, and ultimately the readers who rely on published research.

Reviewer Bias and Subjectivity

Bias remains one of the most persistent concerns. Reviewers may favor certain methodological approaches over others—for instance, quantitative researchers sometimes undervalue qualitative work, and vice versa. Cognitive biases such as anchoring, halo effects, or confirmation bias can skew evaluations. Institutional and geographic biases also persist; studies from less prestigious universities or developing countries may face higher rejection rates or more critical reviews. The double-blind model helps but does not eliminate bias entirely, especially in small research communities where reviewers can deduce author identity from the paper’s content.

Inconsistency Across Reviews

It is not uncommon for two reviewers of the same manuscript to reach diametrically opposite conclusions. One may praise the work as groundbreaking while the other dismisses it as trivial. This inconsistency reflects genuine differences in scholarly standards and expectations. For editors, reconciling these conflicting views is a significant challenge. For authors, inconsistent feedback can be confusing and frustrating.

Time Delays and Reviewer Fatigue

Peer review is time-consuming. The demand for reviewers far exceeds the supply of willing experts. Many scholars serve as unpaid reviewers for multiple journals while juggling teaching, research, and administrative duties. The average turnaround time for a review in engineering education journals is four to six weeks, but delays are common. Authors often wait months for a decision. When reviewers decline invitations, editors must scramble to find replacements, further extending the timeline.

Lack of Transparency and Accountability

Traditional anonymous review offers little accountability. Reviewers can write unprofessional or vague comments without consequence. Authors have no right of reply regarding the review itself, except through the revision process. This lack of transparency can lead to feelings of unfairness and can stifle scholarly dialogue. Some critics argue that closed review hinders the scientific process by preventing readers from understanding how editorial decisions were reached.

Quality of Reviews

Not all reviews are created equal. Some reviewers provide superficial comments—"this paper needs more references" or "the writing is unclear"—without substantive methodological or conceptual critique. Others may focus on minor formatting issues while overlooking serious flaws in study design or analysis. The absence of formal reviewer training in many disciplines exacerbates this variability.

Emerging Innovations and Reforms

Recognizing these challenges, the scholarly community has been actively developing and testing reforms. These innovations aim to enhance fairness, efficiency, and transparency while preserving the essential quality-control function of peer review.

Open Peer Review

Open peer review is one of the most discussed reforms. In its most common form, the reviewer’s identity and comments are published alongside the article. Some journals also publish exchange of comments between reviewer and author. Proponents argue that openness increases accountability, reduces bias, and provides added context for readers evaluating the paper. Opponents worry that less experienced reviewers may be reluctant to deliver critical feedback if their names are public. A growing number of engineering education journals have begun experimenting with open review models. Resources like the F1000 platform demonstrate how open peer review can work at scale.

Reviewer Training and Guidelines

Several initiatives aim to improve the quality of reviews through training. Journals and professional societies now offer online reviewer training modules, webinars, and written guidelines. The Committee on Publication Ethics (COPE) provides resources on ethical reviewing, including how to handle conflicts of interest and how to write constructive feedback. Some journals have introduced reviewer scorecards that assess the thoroughness and helpfulness of reviews, offering feedback to the reviewers themselves.

Use of Technology and Automation

Technology can streamline parts of the peer review process. Plagiarism detection software (e.g., iThenticate) is now standard at many journals, flagging textual overlap before the manuscript even reaches reviewers. Other tools analyze statistical reporting, check for data fabrication, or suggest appropriate reviewers based on publication history. Journal management systems increasingly automate reminders and deadline tracking. AI-assisted tools, such as those that summarize reviewer comments or identify potential conflicts of interest, are on the horizon, though their reliability in making editorial decisions remains unproven.

Post-Publication Peer Review

Rather than treating review as a gatekeeping step that ends with acceptance, post-publication peer review encourages ongoing critique and discussion after a paper is published. Platforms like PubPeer allow registered users to comment on published articles, flag errors, or suggest replications. Some journals invite formal post-publication peer reviews from designated experts. This model shifts the focus from a single assessment to a continuous quality evaluation, making it harder for flawed research to remain unchallenged.

Transparent Review Policies at Journal Level

Individual journals are also experimenting with policy changes. Some now require authors to submit a reviewer checklist confirming they addressed common methodological standards. Others mandate data and materials availability statements to facilitate reproducibility. A growing number of journals in engineering education research, such as the Journal of Engineering Education, have adopted structured review forms that guide reviewers through specific evaluation criteria, reducing the likelihood of omitted key assessments.

Conclusion and Future Directions

Peer review remains the bedrock of scholarly communication in engineering education research. It validates the rigor of new findings, fosters professional development among authors and reviewers, and helps maintain the trust that educators, administrators, and policymakers place in published work. Yet the process is not static. The ongoing challenges of bias, inconsistency, delay, and lack of transparency demand continued attention and reform.

The future of peer review in this field will likely involve a blend of traditional elements and new practices. Hybrid models may retain anonymity for reviewers while publishing their comments. Journals will continue to invest in reviewer training and technology to improve efficiency. The trend toward open science—including preregistration, data sharing, and open access—will push the peer review process to become more transparent and reproducible.

Ultimately, the goal is a peer review ecosystem that is rigorous, fair, and responsive to the needs of a growing and diversifying engineering education research community. By embracing reforms thoughtfully, the field can ensure that peer review continues to serve as a reliable filter for high-quality scholarship that truly advances the practice and theory of engineering education.