'AI Videos Evaluation' studies on Prolific.

lilbooboo

Quick question for anyone that participates in these on Prolific. They are great studies and really boost your income when doing studies on this platform. However, recently, I've started getting feedback messages from the researchers that send them - not every time, but more and more - saying that there are 'quality issues' with some of my answers. Basically saying they'll accept my submission this time but if it carries on i'll not be welcome to do future studies of theirs. The messages are always worded the same. I replied to one asking what i am doing wrong but no reply. It does worry me because I like to do these but I'm dreading that they are going to send another message every so often like this, however careful i do these studies. Has this happened to anyone else?

flaneurs_lobster

Maybe the feedback messages are being generated by AI…..

lilbooboo

Yes, that actually did cross my mind that this could be the case, even though they also state my answers have been 'manually reviewed'. It's a shame if this is happening here as Prolific are an excellent site, can't rate them enough.

flaneurs_lobster

https://forums.moneysavingexpert.com/discussion/comment/81856030#Comment_81856030

It rather seems that you can…

EDIT : Wanted to just quote your last sentence but the brand new shiny forum editor has caught me out…

House_owner

https://forums.moneysavingexpert.com/discussion/6652361/039-ai-videos-evaluation-039-studies-on-prolific

Yes, this has happened to me a few times as well, but I have still had plenty of these studies to do.

lilbooboo

https://forums.moneysavingexpert.com/discussion/comment/81856065#Comment_81856065

Apologies if I've put something out of turn in my last sentence, was just saying the above mentioned survey site are one of the best ones. If i was wasn't supposed to actually mention the company by name, sorry.

flaneurs_lobster

Apologies if I've put something out of turn in my last sentence, was just saying the above mentioned survey site are one of the best ones. If i was wasn't supposed to actually mention the company by name, sorry.

Not at all, just being mauled by the new forum editor update, made my comment mush.

lebateleur

You will receive one of these messages if you failed an attention check in one of your submissions. Sometimes they will be very subtle so pay close attention so you don't miss them.

You used to get banned from the Galactic Probe/Vortex Oasis AI studies after your third warning. However, there was an "amnesty" in December and everyone who was banned was let back again. Since then, it seems like the "three strikes and you're out" rule doesn't apply anymore. Some people say the limit is five now. But I'm not sure. In any case as long as you pay close attention you'll stop getting warnings (it took me a while to realize that some "defects" in videos were, in fact, attention checks).

elsien

I've just had the first of these warnings after doing a lot of these.

I think the problem is that they put the buzzy noise in as an attention check but I still choose that option of the visuals are better. Plus some of videos both options were so terrible that I wouldn't choose either of them so I probably had too many equally good/bad options.

onemouseplace

I've not done many recently and I'm quite glad as I've not had a warning yet, but think it is only a matter of time. I wish there was a text box so we could at least let them known why we chose one over the other.

I've also accidentally clicked and chosen one before when what I actually wanted to do was to zoom in and get a better look at something!

elsien

Can’t thinking that they’re asking for our judgement and then complaining when we give it if it’s not the one that they want.