Skip to main content

Evaluation [#] of "Paper Title" [Template]

Evaluation of "Paper Title" for The Unjournal.

Published onMar 06, 2024
Evaluation [#] of "Paper Title" [Template]
·

Abstract

[Here we will include the ~75 word, 400 character summary that we will request evaluators to provide. Otherwise, we will use an LLM-generated summary (and note this is the case).]

[Here, we offer a template for hosting Unjournal evaluations in PubPub, version 6. This template can also be used for sharing with authors (as a draft), for their response, before the full package is released.]

[To proceed…1]

Summary Measures

We asked evaluators to give some overall assessments, in addition to ratings across a range of criteria. See the evaluation summary “metrics” [link evaluation summary draft, view mode, ‘metrics’ header] for a more detailed breakdown of this. See these ratings in the context of all Unjournal ratings, with some analysis, in our data presentation here.2

REPLACE WITH ACTUAL RATINGS HERE

Rating

90% Credible Interval

Overall assessment

55/100

45 - 63

Journal rank tier, normative rating

3.5/5

2.6 - 4.8

Overall assessment: We asked evaluators to rank this paper “heuristically” as a percentile “relative to all serious research in the same area that you have encountered in the last three years.” We requested they “consider all aspects of quality, credibility, importance to knowledge production, and importance to practice.”

Journal rank tier, normative rating (0-5): “On a ‘scale of journals’, what ‘quality of journal’ should this be published in? (See ranking tiers discussed here)” Note: 0= lowest/none, 5= highest/best”.

See here for the full evaluator guidelines, including further explanation of the requested ratings.

Written report

[Editor: Incorporate the evaluator’s full report here. ]

  1. ‘Import’ this using PubPub tools into a blank ‘pub’ before including the rest of the content

  2. Many formats can be incorporated, but you may need to adapt these. Please try to capture headers, add citations, etc.

Evaluator details

  1. How long have you been in this field?

  2. How many proposals and papers have you evaluated?

Comments
0
comment
No comments here
Why not start the discussion?