Hi,

We are currently double coding our articles to assess quality.  

At the moment our quality assessment tool is set up under a node called 'Quality assessment', with a child code representing each question on the checklist we are using (e.g., '1. Was the sample size adequate?') and child codes under each of these questions to reflect possible answers (i.,e., tick boxes for yes, partial and no, each of which has its own definition added to the description field).  To complete the checklist we tick an answer for each question, adding explanatory text where necessary using the 'info' button.  

[If it's easier to look at this in context, it's in our 'Exercise' review, and the relevant codeset is QualityAssessment_Quant (Qualsyst).]  

I am now trying to generate coding reports (from the collaborate tab) as per the Eppi-Reviewer manual, and so far I've only been able to generate a report for each of the questions individually.  When I select the top level node, the report that is generated is blank.

I've also tried printing a coding record from each individual study record comparing our coding, but this report currently includes comments (i.e., text coded for each node) for only one of the coders.

Could you please advise on whether there's a simply way of generating a report for each paper with full coding from both reviewers using either of these options that I'm missing?  (Or if there's something I'm maybe doing incorrectly.)

Alternatively, do I need to reconsider the way this code set is set up?

Many thanks,

Lynley Aldridge

 Hi Jeff,

Thanks for this response - I'm not sure what I was doing wrong but I have now been able to generate the reports using the 'coding record' tab.  

Our next problem is that we would like to generate a static report of just the codes assigned by each of the two raters for each question  (e.g., yes, partial or no) without the text, and export this to Excel, before reconciliation takes place, so that we can later calculate and report on inter-rater agreement for the quality assessments.

At the moment the only way of doing this that I can see is to generate 14 separate reports (one for each question) using the 'create comparison' option from the collaborate tab.  

Can you advise on any alternatives please?

Many thanks,

Lynley

 Hi Jeff, 

Yes, we would want to determine agreement/disagreement at the questions level.  

However, I was hoping that there would be an easy way to export the data for all 14 questions into Excel in one go (to preserve the original codings, so that we can calculate and report on inter-rater reliability for each question).  At the moment it looks like we would need to generate 14 separate 'create comparison' reports and then copy and paste the data from each one into Excel.  

We can work around this, but I just thought I'd ask in case there was a relatively simple solution I was missing.

Best wishes,

Lynley