1. What is PCI and PCI RR?
2. What is a Journal Adopter?
3. What are the main benefits of PCI RR?
4. How can a PCI RR-friendly journal be sufficiently certain of the quality of the PCI RR review process to accept RRs that are recommended by PCI RR without additional peer review?
5. If a recommended RR is published in a journal, will it also be published by PCI RR?
6. If a submission falls within the remit of multiple journals, would any one journal have an exclusive right to publish it?
7. At what stage in the PCI RR process would authors submit a manuscript to a PCI RR-friendly journal?
8. Where a journal already offers RRs, does the PCI RR track replace the journal's internal RR track?
9. Is this initiative specific for RRs, or does it also include other article types?
10. Is there a subscription fee for becoming a PCI RR-friendly or PCI RR-interested journal?
11. Can a PCI RR-friendly journal still levy an article processing charge (APC) or any other fees?
12. What is the complete set of requirements for becoming a PCI RR-friendly journal?
13. Under what circumstances would a journal prefer to become PCI RR-friendly?
14. Under what circumstances might a journal prefer to become PCI RR-interested?
15. Does PCI RR publish the reviews of rejected submissions?
16. Does a journal need to implement a general open review policy to become PCI RR-friendly?
17. Can a journal obtain the identity of an anonymous reviewer who contributes to PCI RR?
18. Can a journal become PCI RR-friendly only for submissions where reviewers agree to sign their reviews?
19. Can members of a journal's editorial board (including the chief editor) also serve as PCI RR recommenders?
20. What additional infrastructure does a journal need to build in order to become PCI RR-friendly?
21. How do PCI RR-friendly journals appear on the PCI RR web site?
22. How does PCI RR assess whether research meets ethical requirements?
23. How financially sustainable is PCI?
1. What is PCI and PCI RR?
2. What is a Journal Adopter?
PCI RR adoption gives journals the opportunity to benefit from the rigour, transparency, and efficiency of the PCI RR process. Two categories of journal adoption are available: PCI RR-friendly and PCI RR-interested. Adoption is cost-free and carries multiple benefits for journals, authors and the wider research community.
2.1 PCI RR-friendly journals
2.2 PCI RR-interested journals
PCI RR offers a secondary category of adoption called PCI RR-interested. A PCI RR-interested journal does not automatically accept PCI RR recommendations but has signed up to be alerted when a new Stage 1 in-principle acceptance (IPA) or Stage 2 acceptance is recommended by PCI RR. The journal can then contact the authors to arrange additional peer review or make a direct publication offer.
As part of the Stage 1 submission checklist, authors are asked whether they want PCI RR-interested journals to be informed if and when their manuscript receives a positive Stage 1 or Stage 2 recommendation from PCI RR. Where consent is given, the submission is then added to list of submissions accessible to PCI RR-interested journals. The list includes author names, contact details, the Stage 1 recommendation and reviews where authors elect to publish them prior to Stage 2 acceptance, and the URL to the Stage 1 manuscript registered by PCI RR. The journal then has the option to contact the authors directly, and independently of PCI RR, to suggest additional peer review or to make a direct offer of Stage 1 IPA or Stage 2 acceptance. A PCI RR-interested journal can also wait until a positive Stage 2 recommendation before making contact or offering publication. Any such communications or offers are independent of PCI RR.
3. What are the main benefits of PCI RR?
For authors
-
Rigorous and constructive peer review managed by the architects of the Registered Reports initiative
-
Rather than submitting to one journal at a time, manuscripts undergo a single peer review process that serves as a gateway to multiple journals
-
A positive recommendation from PCI RR gives authors the power to choose which (if any) PCI RR-friendly journal will publish the final Stage 2 article
-
No need for authors to decide which (if any) journal to submit their manuscript to until after a positive Stage 2 recommendation
-
The peer-reviewed manuscript remains hosted on a preprint server with the reviews and recommendation published at PCI RR
-
Novel policy features including programmatic RRs in which one Stage 1 manuscript forms the basis of multiple Stage 2 articles, and Scheduled Review to reduce the duration of initial Stage 1 review from weeks to days
For adopting journals and publishers
-
The opportunity to publish transparent high-quality RRs at no cost, transparently reviewed and recommended according to rigorous standards
-
Journal editors can join PCI RR as recommenders, overseeing the peer review of RRs both within and beyond their own journal, increasing their global reach
-
Allows journals that don't offer RRs as an internal article type to nevertheless publish RRs by using the PCI RR review infrastructure in place of a journal-based submission workflow
4. How can a PCI RR-friendly journal be sufficiently certain of the quality of the PCI RR review process to accept RRs that are recommended by PCI RR without additional peer review?
First, the Managing Board of PCI RR has substantial editorial experience in general (e.g. including the chief editor of BMJ Open Science, Emily Sena), and also includes Chris Chambers and Zoltan Dienes who have many years experience editing RRs. Chambers co-founded the RR format at the journal Cortex, currently serves as section editor for RRs at multiple journals and has handled hundreds of submissions. This core team will govern the PCI RR platform and ensure exceptional review standards. Along with all PCI communities, PCI RR is also a member of COPE.
Second, PCI RR includes a broad and diverse team of specialist recommenders, the PCI term for action editor. Editorial board members and associate editors at PCI RR-friendly journals are welcome to join PCI RR as recommenders, increasing overlap between PCI RR and journals. Editors in such circumstances are free to continue their existing role at their journal while also serving at PCI RR, and the journal can continue to offer a direct submission route for RRs alongside the PCI RR track. Editors who wish to join PCI RR are invited to complete a brief expression of interest or contact the PCI RR Managing Board (contact@rr.peercommunityin.org).
Third, the criteria for the appointment of recommenders at PCI RR is stringent and includes an entrance exam that tests knowledge of Registered Reports and PCI RR policy, with careful oversight and ongoing mentoring by the PCI RR Managing Board. The PCI RR Managing Board oversees the review process for all PCI RR submissions, assessing and approving all PCI RR recommendations before they are issued.
Fourth, PCI RR adheres to high standards of transparency concerning open data and digital materials. In particular, PCI RR achieves TOP guidelines Level 2 or higher across all TOP standards, which means that all data, code and digital materials must be publicly archived to the maximum extent permitted by any ethical or legal restrictions.
Finally, PCI RR-friendly journals can set additional quality requirements to automatically accept positive PCI RR recommendations, including falling within a defined disciplinary scope, achieving a minimum pre-planned strength of evidence (e.g. a minimum level of statistical power), or ensuring a minimum level of bias-control where data already exist. The journal will also retain the right to ask authors to make cosmetic changes to accepted manuscripts (e.g. to address any formatting issues), and any Stage 2 RR submission will provide a link to the peer reviews and recommendation published at PCI RR.
5. If a recommended RR is published in a journal, will it also be published by PCI RR?
6. If a submission falls within the remit of multiple journals, would any one journal have an exclusive right to publish it?
7. At what stage in the PCI RR process would authors submit a manuscript to a PCI RR-friendly journal?
8. Where a journal already offers RRs, does the PCI RR track replace the journal's internal RR track?
9. Is this initiative specific for RRs, or does it also include other article types?
10. Is there a subscription fee for becoming a PCI RR-friendly or PCI RR-interested journal?
11. Can a PCI RR-friendly journal still levy an article processing charge (APC) or any other fees?
12. What is the complete set of requirements for becoming a PCI RR-friendly journal?
- Minimum pre-planned evidence strength
- Minimum level of bias control
- Falling within the disciplinary scope of the journal
- Falling within the methodological scope of the journal (specifically concerning quantitative or qualitative research, and whether the journal accepts meta-analyses, systematic reviews, systematic maps, or scoping reviews as RRs)
- Whether the manuscript reports a regular or programmatic RR. All PCI RR-friendly journals will accept regular RRs (in which one Stage 1 manuscript is associated with one Stage 2 output) but also have the option to accept programmatic RRs (for which one Stage 1 manuscript is associated with multiple Stage 2 outputs)
- Achieving minimum journal requirements concerning availability of data, digital materials and code
- Complying with journal requirements concerning formatting and word-count
- Identification of reviewers (e.g. where the journal policy requires reviews to be signed)
- Payment of any applicable APCs or other fees (e.g. submission fees, page charges, colour figure charges etc)
- Any additional bespoke conditions as negotiated with the PCI RR Managing Board
13. Under what circumstances would a journal prefer to become PCI RR-friendly?
14. Under what circumstances might a journal prefer to become PCI RR-interested?
15. Does PCI RR publish the reviews of rejected submissions?
16. Does a journal need to implement a general open review policy to become PCI RR-friendly?
17. Can a journal obtain the identity of an anonymous reviewer who contributes to PCI RR?
18. Can a journal become PCI RR-friendly only for submissions where reviewers agree to sign their reviews?
19. Can members of a journal's editorial board (including the chief editor) also serve as PCI RR recommenders?
20. What additional infrastructure does a journal need to build in order to become PCI RR-friendly?
21. How do PCI RR-friendly journals appear on the PCI RR web site?
- Journal name
- Statement of commitment, including a general description of the commitment and any additional conditions, e.g. "[Journal Name will automatically offer Stage 1 in-principle acceptance (IPA) to any quantitative Stage 1 RR within the journal’s field remit that receives IPA at PCI RR, and will accept without further peer review any Stage 2 RR that has been recommended by PCI RR, subject to the manuscript meeting the applicable journal requirements concerning statistical thresholds, bias control, and formatting."
- Disciplinary scope, defined as broadly or as precisely as the journal chooses
- Word limits, including information about any overall or section-specific word limits or other formatting requirements
- Whether the journal will accept RRs describing qualitative research
- Whether the journal will accept RRs describing quantitative research
- Minimum required thresholds for pre-planned statistical evidence, where applicable, e.g. “For studies employing null hypothesis significance testing: power ≥ 0.90 and alpha ≤ .05 for all preregistered hypothesis tests. For studies employing Bayesian hypothesis testing, data collection until Bayes Factor (BF)>6 in favour of H1 or H0 for all preregistered hypotheses OR authors can specify a maximum feasible sample size at which data collection must cease regardless of the BF, provided the sample is sufficiently large that inconclusive results at this sample size would be an important message for the field”
- Minimum required level of bias control to protect against prior data observation, as defined by the PCI RR taxonomy
- Policy for sharing of data, code and digital materials, including whether the journal policy is more stringent than PCI RR or the same/less stringent
- Whether the journal will accept RRs describing meta-analyses, systematic reviews, systematic maps, or scoping reviews
- Whether the journal will accept Programmatic RRs
- Where the journal is fully open access, details of any article processing charge
- Submission fee, where applicable
- Any other publication charges, where applciable, such as colour figure charges or page charges
- Whether the journal offers the opportunity for authors to publish their Stage 1 manuscript in the journal as a separate article, e.g. Study Protocol
- Whether the journal requires peer reviews provided by PCI RR to be signed in order to automatically endorse PCI RR recommendations
- Whether the journal imposes any additional conditions or requirements, as negotiated with PCI RR