Prolific Academic Survey Alerts

albion22

I think if we all report this timed out issue to Prolific they will realise it was unfair and hopefully rectify in our favour.

yupiteru

Same here, it took me around 40 mins to complete and so I timed out.  I did get a completion code from a Prolific pop up that appeared when the time out notice appeared which I supplied to the researcher.

Very annoying I must say after spending so much time and effort.

Edit - I managed to find the page with the 'submission failed' message in my Firefox history and took a screen shot including the url that has the completion code.

Just wait now to see if the researcher replies.

fabsaver

I just accepted the study but returned it without completing after realising it was the one being discussed on here.

The maximum allowed time was showing as 13 minutes. By the time I had read the intro page the countdown timer was down to only 11 minutes left, so clearly impossible to complete without timing out.

I suspect every time it times out for someone the system is offering that place to another participant. Therefore far more people are completing it that there are actual spaces available.

Hopefully those that have spent time on it will get paid.

Raine_E_Day

Came on here to see if anyone else timed out - something I have never experienced before.  It is annoying as gave careful and considered responses to study which was interesting and thought-provoking.

albion22

fabsaver said:

I just accepted the study but returned it without completing after realising it was the one being discussed on here.

The maximum allowed time was showing as 13 minutes. By the time I had read the intro page the countdown timer was down to only 11 minutes left, so clearly impossible to complete without timing out.

I suspect every time it times out for someone the system is offering that place to another participant. Therefore far more people are completing it that there are actual spaces available.

Hopefully those that have spent time on it will get paid.

That's very interesting if the countdown timer was set at 13 minutes and the Prolific time estimate was set, as in my case, at 15 minutes. Does that suggest a system error as we are given at least twice as long and usually three times the estimated time. Then of course we have the researcher's quoted time of 30 minutes duration. 

I am hopeful that Prolific will review in our favour for all those that completed the study.

MrsWhippy

sebloak said:

The role of the end-user in the development of responsible AI systems

By city.ac.uk

£5.00 • £19.15/hr

15 mins

 0 places

Are you interested in Artificial Intelligence (AI) being fair? 

We, researchers from City, University of London, would love to hear from you!

You will participate in a 30-minute survey where we will ask your perspective on AI systems and fairness, who should be involved in representing your views, and how your views could be taken into account in the different stages of the AI system development. You will receive £5 within 3 working days after submission.  

Please do not take part if you have taken any AI or machine learning classes, you design or develop AI systems as part of your job. Your submission will be rejected when multiple attention checks are failed, not all mandatory questions are completed, the survey is completed exceptionally fast, or answers show clear low effort throughout.

Devices you can use to take this study:

• Desktop
• Mobile
• Tablet

A 30 minute study with lots of reading and typing to do, but only 15 minutes to complete it. Im almost sure it said 30 minutes to complete when accepting it at the start, so I was timed out. Reported it.

I was timed out on this one too. It did say it would take 30 mins to complete in the blurb and I spent that amount of time on it.  I have contacted the researcher and reported it. It said if completed too quickly it would be rejected - can't win either way it would seem!

yupiteru

The first page of the study also quotes the 30 minute time period.

'Submission will be rejected, and you will not receive the compensation when multiple attention checks are failed, not all mandatory questions are completed, the survey is completed exceptionally fast (estimation time for this survey is 30 minutes), or answers show clear low effort throughout'.

I think 30 mins is a bit ambitious myself given the multiple text boxes on most pages, maybe I was meant to put n/a in them, but I was quite interested in the subject matter and so had a lot to say.

[Deleted User]

The role of the end-user in the development of responsible AI systems

By city.ac.uk

£5.00 • £19.15/hr

15 mins

 0 places

I was the same as you, yupiteru.  I was interested and had quite a lot to say. 

As MrsWhippy pointed out:  "if completed too quickly it would be rejected" then,from the experience of a number of us here, if not quick enough - Timed out.

It is like being set up to fail and seems very unfair.  I wonder if the Researcher or Prolific will do anything about it.

MrsWhippy

Deleted_User said:

The role of the end-user in the development of responsible AI systems

By city.ac.uk

£5.00 • £19.15/hr

15 mins

 0 places

I was the same as you, yupiteru.  I was interested and had quite a lot to say. 

As MrsWhippy pointed out:  "if completed too quickly it would be rejected" then,from the experience of a number of us here, if not quick enough - Timed out.

It is like being set up to fail and seems very unfair.  I wonder if the Researcher or Prolific will do anything about it.

I completely agree Crimson 60. Very unfair after spending 30 minutes on it. Surely Prolific will see we've all been timed out? If we'd have put N/A in each box we'd have probably been rejected on "clear, low effort throughout"

[Deleted User]

The role of the end-user in the development of responsible AI systems

By city.ac.uk

£5.00 • £19.15/hr

15 mins

I hope I'm not going to get into bother about this but I feel quite strongly about the unfairness of this Study.

I have just sent this message and hope to receive a reply: 

"I was really interested in this Study, was pleased to participate and, understandably, had quite a lot to say in response to the many questions and opportunities to comment. 

As pointed out:  "If completed too quickly it would be rejected"  then, from the first hand experience of a number of fellow Prolific participants who also

took part in this Study, if not quick enough – Timed Out.

It is like being set up to fail and seems very unfair.  I hope that the Researcher or Prolific will do something about it and approve the genuine submissions of participants who were unfairly Timed Out."

I am not too optimistic about a positive reply but, if I hear anything (good or bad) I’ll post back.

Crimson