Peer Review Process
The step-by-step process is described here.
The acceptance criterion for Collabra: Psychology is scientific, methodological, and ethical rigor. While Collabra: Psychology editors and reviewers do not attempt to predict a submission’s impact to the field, nor employ any topic bias in accepting articles, they will check for rigorously and transparently conducted, statistically sound, adequately powered, and fairly analyzed research worthy of inclusion in the scholarly record. This is a focus on more objective acceptance criteria and the bar is set high.
Specific requirements for transparency and openness are detailed below (please use the navigation on the right of this page).
Collabra: Psychology operates 2 types of peer-review, with an option for open peer review also available, and an option for streamlined review:
- Single-blind peer review process, meaning that author names are available to the reviewer, but reviewers remain anonymous.
- Non-blind peer-review, meaning that reviewers sign their reviews.
Open Peer Review
Whether single-blind or non-blind, authors can request an open peer review at submission. This means that the correspondence and comments during the review process will be openly available in a single document along with the published article, if accepted. This is an unedited output of the comments on the peer review form and other interactions such as the author response letter, excluding any confidential comments to the editor by a reviewer. If the reviewer has signed his/her review, his/her identity will also be openly available.
Authors whose articles have been rejected within the previous 365 days from other journals for reasons that are not due to lack of scientific, methodological, or ethical rigor are welcome to submit prior reviews and decision letters along with their submission, and request a streamlined review in their cover letter. (Common reasons for such rejections are due to perceived future impact, being out of scope, curation of topics, policies regarding numbers of studies, etc.)
- Indicate clearly in their cover letter that they are requesting streamlined review. (This is in addition to the other standard items required in the cover letter, listed here.)
- Clearly state from which journal the article was rejected.
- Specifically describe the nature of any changes that were made, or not made, to the manuscript in response to the prior set of reviews, just as they would normally do when submitting a revised manuscript. (Although the author is not obligated to revise the manuscript in response to the prior set of reviews, the authors should carefully consider the content of the reviews and to make those changes with which they agree prior to requesting streamlined review.)
- Include a copy of the previous editor's action letter along with copies of all of the written reviews from the prior submission. If the reviewers signed their reviews, this information should also be passed to Collabra: Psychology. These materials must be submitted in their original form; any alteration of these materials will cause the manuscript to be returned without review. These can be uploaded as supplementary files (after any article items) or attached. If they are not available in their original form but need to be copied/pasted, or otherwise provided, the editor or publisher will need to verify the information with the previous editor.
- Indicate whether the previous editors (and reviewers. if they signed their reviewers and are known) may have given their permission for their comments to be openly available at Collabra: Psychology, if the submission is accepted.
- Seek no further reviewers, and make the decision based on the ported reviews and information.
- Make the decision based on the ported reviews and one more invited reviewer.
- Send the submission out for regular review, if s/he decides the ported reviews and information are not sufficient to make a decision.
- Reject the submission (either with or without additional reviews).
Any additional reviews by Collabra: Psychology reviewers will be open if the author chooses open peer review, as for a regularly submitted article.
Focus and Scope
Collabra: Psychology has 7 sections representing the broad field of psychology, and a highlighted focus area of “Methodology and Research Practice.”
- Cognitive Psychology
Methodology and Research Practice
Collabra: Psychology supports the principles of Open Science, including a mandatory open data policy, and an option for authors to choose open peer review. We strongly encourage pre-registration of studies and pre-analysis plans.
Transparency and Openness Policy
Collabra: Psychology bases its transparency and openness policy on the standards in the Transparency and Openness Promotion (“TOP”) Guidelines faciliated by the Center for Open Science, available at https://cos.io/top/#TOP, and certain guidelines developed by the Association for Psychological Science.
All data, program code, and other methods must be appropriately cited. Such materials are recognized as original intellectual contributions and afforded recognition through citation.
- All data sets and program code used in a publication must be cited in the text and listed in the reference section.
- References for data sets and program code must include a persistent identifier, such as a Digital Object Identifier (DOI). Persistent identifiers ensure future access to unique published digital objects, such as a text or data set. Persistent identifiers are assigned to data sets by digital archives, such as institutional repositories and partners in the Data Preservation Alliance for the Social Sciences (Data-PASS).
- Data set citation example: Campbell, Angus, and Robert L. Kahn. American National Election Study, 1948. ICPSR07218-v3. Ann Arbor, MI: Inter-university Consortium for Political and Social Research [distributor], 1999. http://doi.org/10.3886/ICPSR07218.v3
Open Data, Open Analytic Methods (Code), and Research Materials Transparency
Data, and also methods used in the analysis, and materials used to conduct the research must be clearly and precisely documented, and be maximally available to any researcher for purposes of reproducing the results or replicating the procedure.
Authors using original data must make the data available at a trusted digital repository. (Note: If all data required to reproduce the reported analyses appears in the article text, tables, and figures then it does not also need to be posted to a repository.)
Trusted repositories adhere to policies that make data discoverable, accessible, usable, and preserved for the long term. Trusted repositories also assign unique and persistent identifiers. Author maintained websites are not compliant with this requirement, but many university libraries have established institutional repositories that provide long-term and stable accessibility to scholarly data. We encourage authors to check with their home institutions if an appropriate subject-based public archive is not available.
Dissemination of data, methods, and materials can be delayed until article publication, as long as reviewers have adequate access. Under exceptional circumstances, editors may grant an embargo of the public release of data for up to one year after publication.
Authors will be requested to provide a data accessibility statement with their submissions (see Guide for Authors for full details), listing where each dataset is or will be archived and including accession numbers or DOIs. Along with data, authors should:
- include all variables, treatment conditions, and observations described in the manuscript.
- provide a full account of the procedures used to collect, preprocess, clean, or generate the data.
- provide program code, scripts, codebooks, and other documentation sufficient to precisely reproduce all published results.
- provide research materials and description of procedures necessary to conduct an independent replication of the research.
Authors reusing data available from public repositories must provide program code, scripts for statistical packages, and other documentation sufficient to allow an informed researcher to precisely reproduce all published results.
In certain cases some or all data or materials cannot be shared for legal or ethical reasons. In such cases, authors must inform the editors at the time of submission. This will be taken into account during the review process. Authors are encouraged to anticipate data and material sharing at the beginning of their projects to provide for these circumstances. It is understood that in some cases access will be provided under restrictions to protect confidential or proprietary information. Editors may grant exceptions to data and material access requirements provided authors:
- explain the restrictions on the dataset or materials and how they preclude public access.
- provide a public description of the steps others should follow to request access to the data or materials.
- provide software and other documentation that will precisely reproduce all published results.
- provide access to all data and materials for which the constraints do not apply.
Authors are responsible for ensuring that their articles continue to meet these conditions. Failure to do so may lead to an editorial expression of concern or retraction of the article.
Design and Analysis Transparency in psychology research
Authors are required to follow the standards for disclosing key aspects of the research design and data analysis in their Methods sections, which standards were developed by the Association for Psychological Science. In summary, this includes disclosure of:
- any data exclusions
- all of the conditions/groups tested
- all of the dependent variables or measures collected for each study reported in the submitted manuscript.
Preregistration of Studies and Analysis Plans
Collabra: Psychology encourages, but does not require, preregistration of studies.
Preregistration of studies involves registering the study design, variables, and treatment conditions prior to conducting research. Including an analysis plan involves specification of sequence of analyses or the statistical model that will be reported.
Authors should state in the Acknowledgements section whether the conducted research was preregistered with an analysis plan in an independent, institutional registry (e.g., http://clinicaltrials.gov/, http://openscienceframework.org/, http://egap.org/design-registration/, http://ridie.3ieimpact.org/, http://aspredicted.org/) and that the preregistration adheres to the disclosure requirements of the institutional registry.
If the conducted research was preregistered, authors must provide links to the time-stamped pre-registration(s) at the institutional registry.
Collabra: Psychology welcomes submissions of replication studies.
Thanks and Acknowledgements
Collabra: Psychology acknowledges the work of the Center for Open Science, and the Association for Psychological Science, in developing best practices and policies in transparency and openness, and for making such work available to use and repurpose at other journals.
Collabra: Psychology supports the principles of the Committee on Publication Ethics (COPE) and follows its guidelines for dealing with potential cases of misconduct. We expect our authors to comply with best practices in publication ethics, particularly with respect to authorship, conflict of interest, compliance with standards of research ethics, redundant publication, figure manipulation, plagiarism, and dual submission.
Research published in Collabra: Psychology must conforms to Standard 8 of the American Psychological Association’s Ethical Principles of Psychologists and Code of Conduct http://www.apa.org/ethics/code/index.aspx (Although please note that some of our standards, e.g. data sharing, are more rigorous.)
Corrections and Additions
Amendments to published articles will be made only if they affect the integrity and accuracy of the scholarly record. Formal notifications will be published on the Collabra: Psychology website, falling into one of two categories:
- Correction: An error introduced by the publisher or the author(s) (and this will be indicated in the explanatory text) that affects the integrity of the scholarly record, the reputation of the authors, or the reputation of the journal.
- Retraction: Withdrawal of a published paper due to invalid results or conclusions. All authors of a paper must sign a retraction request, indicating the error and describing how it affects the paper’s conclusions. If authors are not in unanimous agreement in requesting a retraction, the pertinent Senior Editor will consult the handling Editor(s) and, as necessary, external reviewers and apply the category of amendment that appears most appropriate, indicating dissenting authors in the text of the published amendment.
Original research report
- Open Submissions
- Peer Reviewed
Original research reports should present original findings. Null/negative findings, reanalyses of previous studies with new results, and replication studies, are also considered.
- Open Submissions
- Peer Reviewed
Review articles should provide a balanced and comprehensive overview of discoveries in a particular field.
- Open Submissions
- Peer Reviewed
These should present a new and thoughtfully-considered viewpoint or opinion of a current problem, concept, implication, innovation, or practice relating to psychological science. While not required, it is acceptable to approach the Editorial Office, or relevant Senior Editor, with ideas prior to submission.
- Open Submissions
- Peer Reviewed
Registered Reports are a form of empirical article in which the methods and proposed analyses are pre-registered and reviewed prior to research being conducted. The cornerstone of this article format is that a substantial part of the manuscript will be assessed prior to data collection. Please see the Author Guidelines for the full policies and guidelines.