HelpForum

Forum (Archive)

This forum is kept largely for historic reasons and for our latest changes announcements. (It was focused around the older EPPI Reviewer version 4.)

There are many informative posts and answers to common questions, but you may find our videos and other resources more informative if you are an EPPI Reviewer WEB user.

Click here to search the forum. If you do have questions or require support, please email eppisupport@ucl.ac.uk.

<< Back to main Help page

HomeHomeUsing EPPI-Revi...Using EPPI-Revi...Questions about...Questions about...Priority screening with multiple reviewersPriority screening with multiple reviewers
Previous
 
Next
New Post
14/08/2019 16:26
 

Hi there, 

I'm playing around with the priority screening function and have a few questions:

1)Is it possible for more than one reviewer to engage in priority screening? I don't want the two reviewers to be reviewing the same papers. Instead, I want them both to be reviewing two different sets of papers but at the same time to speed things up.

2)What's the outcome of the priority screening process? Is there a point when the software will have been fed enough information to be able to determine alone whether to add a paper or not? Or does it simply put forward papers which it thinks I will include but I still need to review all papers?

3) Can I close priority screening and come back to the same machine learning process later on?

 
New Post
15/08/2019 09:57
 

Dear Zoé,

You can indeed have multiple people screening items under Priority Screening, with the software automatically building a list of items to present to each reviewer. You can specify your chosen number of people and reconciliation mode.

The software will order the papers, so you see the most relevant ones first. After a certain point, the likelihood is you can safely stop screening - safe in the knowledge that the software has ordered the papers so that anything past this point is just confirming the software's "decision". (The software cannot guaranteed to be 100% accurate, so some discretion is required, but generally you will be able to see this point come... The software's progress can be monitored and graphed.)

You can carry out other operations within the software and then return to the Screening tab (once you have turned the feature on via the review settings in our Account Manager), but generally I would recommend following a "process" within your review - search, import, screen (usually on title & abstract, and then on full text for the items that made it through the first round of screening on title & abstract), extract data, etc.

Priority Screening is covered in our Manual (see https://eppi.ioe.ac.uk/cms/Default.aspx?tabid=2933 or https://eppi.ioe.ac.uk/CMS/Portals/35...er%20manual.pdf for the direct link). It is covered around page 74 onwards (https://eppi.ioe.ac.uk/CMS/Portals/35/ER4_8_0%20user%20manual.pdf#page=74).

Do let us know if you need any further information or assistance. We are happy to give specific suggestions for settings for a particular review, if given the review ID number (or name). I would recommend checking you have your settings correct before starting the process.

Kind regards,

EPPI Support
(EPPISupport@UCL.ac.uk)

 

 
New Post
15/08/2019 15:18
 

Dear Zak, 

Thank you for your answer. 

I'm now clear on questions 2 and 3.

Regarding my question1:

I can see how multiple reviewers can be doing the screening at the same time. But my problem is that I don't want them to be doing multiple coding. I want them to each be reviewing different papers, and not to code the papers twice. As far as I can tell from the user's guide (which I have read in-depth), none of the reconciliation modes offer that possibility. Is there a way for multiple reviewers to be working at once but not to be engaging in multiple coding?

I'm also worried about keeping track of the number of items each reviewer has done and will have to do. I know that outside of priority screening, it is possible to keep track of people's workload through the collaborate tab. Is there a way to do the same thing but within priority screening?

Thank you in advance for your answer. 

Best,

Zoé

 
New Post
15/08/2019 17:03
 

Hello Zoé,

the key here is about the "Data entry mode" in which the chosen screening tool is configured. There are 2 possibilities: "Normal" which means that anyone's decision is immediately considered authoritative and made visible to everyone; and "Comparison" mode. In this latter case, what codes people tick will initially remain as "incomplete" coding and thus private to them.
In the Silverlight version, you change the data entry mode via right click on the root of your screening tool and "properties". In both versions, the "Normal" data entry is represented visually by the icon showing one person, the "Comparison" mode is represented by an icon with two people.

The additional facility of "auto reconcile" offered via the "priority screening" mechanism would automatically mark as "completed" (and thus public/authoritative) all the codings that satisfy the conditions as specified by the configuration in question (no auto completions, "safety first", at code level or at Include/Exclude level).

However, if you don't want to double code anything (one reference is to be screened by one reviewer), then what's needed is to configure the screening tool for "Normal" data entry (which I believe is your current situation). This means you won't be able to increase the "# of people screening each item" to more than 1 (in the "Screening" tab) and that the priority screening engine will feed references accordingly (only one person will screen a given reference). Moreover, whenever a reference will be screened, the decision will be recorded as "completed" (public and authoritative) and will thus be visible to all (all reviewers and accessible through all EPPI-Reviewer functions).

To monitor progress (by person and coding tool) you can use the "review statistics" tab in the Silverlight version (lower right corner). In the web version, the same information is visible in the "review home" tab, "Coding Progress" section (you can expand the details of each coding tool by clicking on the tool name).

I hope this helps,
Sergio

 

 
New Post
15/08/2019 17:31
 

Amazing! Just tried it and it works well! Thank you so much!

 
Previous
 
Next
HomeHomeUsing EPPI-Revi...Using EPPI-Revi...Questions about...Questions about...Priority screening with multiple reviewersPriority screening with multiple reviewers


Copyright 2021 by EPPI-Centre :: Privacy Statement :: Terms Of Use :: Site Map :: Login
Home::Help::EPPI-Mapper::RIS Export::About::Account Manager