HelpForum

Forum (Archive)

This forum is kept largely for historic reasons and for our latest changes announcements. (It was focused around the older EPPI Reviewer version 4.)

There are many informative posts and answers to common questions, but you may find our videos and other resources more informative if you are an EPPI Reviewer WEB user.

Click here to search the forum. If you do have questions or require support, please email eppisupport@ucl.ac.uk.

<< Back to main Help page

HomeHomeUsing EPPI-Revi...Using EPPI-Revi...Questions about...Questions about...Overlap in screening assignments?Overlap in screening assignments?
Previous
 
Next
New Post
08/11/2017 14:28
 

Hi, I used the random assignment option to randomly allocate documents to screen at the title/abstract level (creating 10 groups of 10% each) but one of my screeners has some in her set that appear already coded by someone else. Is it possible that someone else was also assigned some in her set? Review id: 12961. Is there a way to diagnose and fix this?

 

Thank you!

 
New Post
09/11/2017 14:11
 

Hi Emily,

It looks like your Screen on Title & Abstract codeset is set to normal (single user) coding, rather than comparison coding. This means once anyone codes something, it can be seen by everyone else. (See screenshot below.)

Looking at the Collaborate tab, it shows that some people have started screening items.

Clicking on any of these numbers will take you to a list of those items (e.g. the circled 25 in the picture will list the 25 items Kiran has already started coding in the Group 1 training set).

Clicking on any one of listed items and looking at the Coding record tab, we can see from the green tick that the item has already been coded and marked as completed.

Alternatively, you can also right-click on a codeset and select Display item frequencies (children) to see the number of items coded with each child code.

For example, in the screenshot below we can see how many items have been coded with each of the child codes from your Screen on Title & Abstract codeset. Clicking on Go or any of the numbers will again take us to a list of those items.

What you can do is mark any items that have already been coded as not complete, and then set the coding to Comprison Mode. That should set things up as you need them to be.

You can "bulk mark" all completed items as not completed, or do it person by person, etc.

(Note that this will NOT delete any existing coding, but merely indicate that the coding for the chosen item(s) is not marked as completed.)

To do this, click on the Review statistics tab towards the bottom-right of the screen, and then click on the relevant red "no entry" sign, as shown below (in this case - to mark the coding done by yourself (Emily) as incomplete).

You can also mark an entire codeset's coding as incomplete, using the relevant icon...

You can also do this via "advanced" options, by selecting the icon near the top of the list.

As well as marking the the existing coding as complete, you also need to change to Comparison Mode coding. Right-click on the relevant codeset, and then select Properties.

Finally, select the Change to Comparison data entry mode.

And all should be well!

Hope that helps, but do let me know if any problems. There is a lot more information on coding and collaboration in the manual (available from https://eppi.ioe.ac.uk/cms/Default.aspx?tabid=2933, around page 52), and in our short online training videos (available from https://www.youtube.com/user/EPPIReviewer4).

Kind regards,

Zak

 
New Post
09/11/2017 15:12
 

Thanks Zak, the screenshots are very helpful, especially to see how I can figure out who already screened the documents.

 

We had started in comparison mode (for the training set, and each reviewer was assigned 411 to overlap with another reviewer) - once these double sets were complete, we then moved to normal data entry because we don't have enough resources to double-screen all 12,000 abstracts. I set up the allocations with this in mind, but it seems a few that weren't meant to be double-coded ended up being assigned to two people. Not sure how to fix this in the future - because we will do something similar for the full text screening assignments. Any thoughts on the best ways to avoid this?

 
New Post
10/11/2017 17:25
 

Hi Emily,

 

A good way to check your allocations is to do a crosstab report with the Allocations / Screening Title and Abstract code selected for both axes.  Looking along the diagonal from top-left to bottom-right, you should have consistent numbers.

Any numbers appearing outside this suggest something has gone awry (or they were part of your initial training allocations, yet to be completed, or somesuch).

I've exported the crosstab query result from the screenshots below and emailed it to you directly, just so you have a copy.

Hope that helps!

 

Kind regards,

Zak

 

 

 

 

 
Previous
 
Next
HomeHomeUsing EPPI-Revi...Using EPPI-Revi...Questions about...Questions about...Overlap in screening assignments?Overlap in screening assignments?


Copyright 2021 by EPPI-Centre :: Privacy Statement :: Terms Of Use :: Site Map :: Login
Home::Help::EPPI-Mapper::RIS Export::About::Account Manager