Prolific Academic Survey Alerts

sammyjammy

Interesting!  Thanks @C_J for reporting back.

[Deleted User]

I wonder if anyone has completed this study:

Scottish Juror Decision Making Study

I completed the study this evening and it took about 75 minutes.  My main focus was on the evidence given leading to a verdict.

Close to the end of the study there were questions about what the Judge was wearing, what one of the witnesses was wearing and if the accused was in the witness box on his own or with someone else.

I could not see anything in advance to suggest that these would be  the type of attention checks and I wonder if the study submission could be rejected if one of these  attention checks, although not identified as such in advance, was answered incorrectly.

I enjoyed the study and it was interesting and quite challenging. I would be very disappointed to have my submission 'fail' on one of the answers which, I think, were not directly related to the purpose of the study Ias I understood it) to follow the trialevidence through to the conviction. 

I'll be pleased if anyone can comment, thank you.

Deleted_User

MollyR

I did not complete the study, because I did not have the time to watch what they said was going to be a 50-minute video followed by the questions;  but I do remember that the introductory information said that there would be three attention-check questions about the content of the video.  I would not have thought that remembering what people were wearing could be regarded as an essential thing, although whether there was somebody else in the witness box could certainly be a relevant one.

[Deleted User]

Thanks very much MollyR.  I have edited my post to focus more on the type of checks as, as far as I understood it, the focus was to be on the evidence given leading to the conviction decision.  As you say the three attention-check questions were about the video so maybe I'll have to accept it if my submission is rejected.  The person in the witness box declined to give evidence but, even so, perhaps I should have noticed whether or not he was in the witness box alone or not.

Crimson

MollyR

As far as I know, the only time that a second person might be in the witness box would be if they are handcuffed to a police officer;  but the video was presumably made with actors, and anything could have been included.

[Deleted User]

It sounds as if my submission is likely to be rejected.  I'll be disappointed but would have to accept it if I really have failed an attention check.  Although long, it was an interesting study.

Crimson

olliebean

It's possible they weren't attention checks at all, and that part of the study was seeing how well people remembered these details, so don't give up hope yet. Although if you do get rejected on this basis, I'd be inclined to appeal with Prolific, as these do not sound like fair attention checks according to their guidelines.

[Deleted User]

That is good to know, Thanks olliebean.  I'll post back when I hear if my submission has been approved or rejected.

Crimson

[Deleted User]

Received 'submission approved' today and very pleased.  The Researcher explained that there were six attention checks and only three successful attention check successes were required.

It is a bit different from previous attention check requirements as I thought all attention checks had to be successful.  It was good of the Researcher to explain.

Thank you MollyR and olliebean for replying.

Crimson

olliebean

This morning, something that's never happened before: I got rejected for a study ("Reasoning in AI Explanations - Text 2"). The researcher sent me a message saying that I had failed one or more attention checks. I replied, asking what attention checks I'd failed, as I didn't remember seeing any in that very short study, and within 10 minutes got a reply saying sorry, turns out you did give the correct answer, and my submission was approved. I don't know if this was a genuine mistake or a researcher trying it on, but it just goes to show that it's always worth querying a rejection.