Prolific Academic Survey Alerts

Hermia

Vintage67 wrote: »

Interesting article here by Prolific about how they select participants for studies:

https://medium.com/prolific-co/data-quality-at-prolific-part-2-naivety-and-engagement-716937b59e84

Shows that they're now giving priority to newbies at the expense of us regulars, and are trying to discourage 'professional survey takers'

As someone who has conducted academic research, I can understand why they are doing it. If you do a lot of academic surveys you soon start to guess what they are asking or you start to recognise when they aren't being truthful (for example, when they tell you that you are playing against another participant and it is rarely the case). It will inevitably influence your answers even if you are not aware of it. One of the reasons universities use sites like PA rather than just getting the students to answer surveys is because students are more likely to recognise what the researcher is trying to do. Obviously they don't want to have the same problems with PA. It is frustrating (I have certainly noticed I earn a lot less money now) but it is understandable.

mikep22

Vintage67 wrote: »

Interesting article here by Prolific about how they select participants for studies:

https://medium.com/prolific-co/data-quality-at-prolific-part-2-naivety-and-engagement-716937b59e84

Shows that they're now giving priority to newbies at the expense of us regulars, and are trying to discourage 'professional survey takers'

To be honest I havent seen a marked drop off myself. But then I imagine as a 35 year old guy, I am probably fortunate to hit many target markets.

On a seperate issue.

Is anyone else finding that Prolific is constantly signing you out at the minute. Its fishing me right off.

MiroMark2

mikep22 wrote: »

On a seperate issue.

Is anyone else finding that Prolific is constantly signing you out at the minute. Its fishing me right off.

Yes!!!!!!!!!

elsien

Yep, and me. Generally when I hit the end of the survey and it's logging me out instead of giving me the completion code. Had a spate of Nocodes yesterday for that reason.

timefortea

mon37 wrote: »

Has anyone had problem doing Cognitive experiment test duration 1h 30 min? I had to return it after spending 45 min. as it stuck on fase 6 colour test!

I had an issue with this one too, but mine was during the elevator task, where you had to count the tones. All tones were working fine for me at first, then in the practice round one of them stopped working so I couldn't do that test. I hope the researcher still pays me too.

I'm not having any problems with being logged out though.

cobblers_boy

I managed to get through to the end of the survey, took around 50 minutes I think in total. Obviously it has not been approved yet but still very early days.

olliebean

I had it approved the next morning. That was a good day; I also got a £4 payment and £5.55 bonus from another study, so probably the most I've ever made from Prolific in one day.

burnleylad1882

I did a voice thing the other day. £25, took me about 3 nd half hours but not been approved yet

JennyJukes

Prolific keeps signing me out too. I also had an issue with this study:
An interactive experiment

Hosted by Philipp Schreck
£1.0010 minutes £6.00/hr 0 places remaining

In this study you will play with another participant for money. In addition to the participation fee of £1.00 you can earn between £0.10 and £2.10.


When I tried to open it, it kept coming up that people may be attempting to steal from your IP etc so I had to return it

elljay

Vintage67 wrote: »

Interesting article here by Prolific about how they select participants for studies:

https://medium.com/prolific-co/data-quality-at-prolific-part-2-naivety-and-engagement-716937b59e84

Shows that they're now giving priority to newbies at the expense of us regulars, and are trying to discourage 'professional survey takers'

Well that's interesting, thank you. Not just the stuff about how participants are selected but also the guidance Prolific gives to researchers. I've done a couple of really poorly thought-through surveys in the last couple of days so I hope researchers take heed of the advice.

I think it's partly my fault though as I do tend to overthink my answers and worry like mad if I feel it won't be useful. I've emailed more than once suggesting they discount my response as I don't feel the answer is helpful or reflects anything sensible. The other thing is that I wish someone would proof read the surveys, I don't know what my salary equates to in dollars, or which US political party I feel closest to (I would have to research in depth and I don't think that's what they want you to do!!!) and I really need to swot up on the US education system too as I don't know what my qualifications equate to either. I know, I know - I overthink but I want to be as accurate as possible for the studies and wish some of the surveys were angled more towards the country. Oh and then there are the spelling and grammar mistakes which would be picked up by a bit of proof reading. If they want quality responses then they should provide quality surveys.

Thanks again for the article - I'll look for more in this series. Really nice to see that Prolific takes its role so seriously and professionally.

Having had my moan, Prolific are the only surveys I do now as they're often so interesting and I feel they're useful rather than just aids to marketing and selling stuff which so many others are. Go Prolific!!