Prolific Academic Survey Alerts

Andrew30000

snowwhyte said:

I applied for Data Annotation last year but didn't get past the initial stages. I know someone who works for Outlier and they don't really recommend them and the pay isn't as good as Prolific although you get more if you know specialist subjects like coding or maths. 
If you can get into either of the other two they could be an option if you don't have access on Prolific or lose access. I think Prolific is the best one though. 

Outlier pays $15ph for generalists. It does get mixed reviews, but it's much more regular work for me now I'm on a good project. I do like Prolific though because it's so varied and interesting but I earn about three times as much on Outlier

Racheljaa

Andrew30000 said:

snowwhyte said:

I applied for Data Annotation last year but didn't get past the initial stages. I know someone who works for Outlier and they don't really recommend them and the pay isn't as good as Prolific although you get more if you know specialist subjects like coding or maths. 
If you can get into either of the other two they could be an option if you don't have access on Prolific or lose access. I think Prolific is the best one though. 

Outlier pays $15ph for generalists. It does get mixed reviews, but it's much more regular work for me now I'm on a good project. I do like Prolific though because it's so varied and interesting but I earn about three times as much on Outlier

Do you have to create a LinkedIn account to be able to apply for Outlier? It's not a site that I use.

PocketWatchMan

The new dynamic rewards - I seem to recall that they said if you finish a little bit before the allotted time, but are still sensible and have completed 1-2 tasks, then you would not lose out in terms of compensation. I do not think this is true. 

Have had a couple of incidences now where I've been around 40 minutes on one AI assignment, having submitted either 1 or 2 mini-tasks within the assignment. Now I have to make a judgement, before starting the next mini-task, as to how long it might take, bearing in mind if it takes more than 30-something minutes I face being timed out. If it is a seriously long one then it is a non starter, so I will submit the finished assignment having spent somewhere like 42-45 mins (estimated, just going by my watch). now I realize this is a couple of minutes shorter than the suggested 50 minutes, but I still only receive partial compensation because it is calculated as dynamic reward. 

elsien

I messed up last night - didn't check properly and assumed it was an hour. In part because they all have been of late, but also because each task was taking about 15 minutes and I did not expect to only do 2 in the time. So I submitted after an hour and 4 tasks to then notice I had only been paid half the amount and the submission was showing as timed out. 
I have messaged the researcher in case they try to retract the payment (and also in the hope I might get paid for the hour) but am not holding out a lot of hope. 

onemouseplace

I think any submission, as long as you have submitted at least one task, under the time and you get the dynamic reward time.  I don't think we get paid any 'thinking' time for an incomplete task, even if you have opened up some of the contextual links and had a look at the response to see if you can realistically get it done in the remaining time.

I've seen a few people saying on Reddit that they are being penalised for submitting after the allotted time - so if they go over the time alloted, even if they submit, they were only getting a partial reward - I wonder if we only get paid for submitted tasks in the allotted time?  The average reward per hour is showing as under the intended reward per hour, which surely isn't possible under dynamic rewards??

warby68

I think it IS possible to be under the intended reward per hour because there is no extra payment above the $25 for spending longer than 50 minutes. The 'dynamic reward' is only 'dynamic' in one direction.

snowwhyte

I completed one task ten minutes after the time and got paid the full amount for the 50 minutes. I knew the dynamic award didn't count after the alloted time but I wanted to finish the task.
 It's difficult because we're estimating how long tasks will take and whilst we can look at a long task and know it will definitely take longer than 10 minutes sometimes the shorter tasks take longer than we think because one claim might take more researching or there might not be much evidence on the topic. 

onemouseplace

I wonder why they've moved to 50 minutes?  I'm finding it hard to pace myself as I was so used to 60 minutes so the 50 minutes is catching me by surprise!

snowwhyte

They said that some people were saying that an hour was too much of a time commitment but personally I found the hour much easier because it was easier to track the time. Start on the hour, finish on the hour. Take a 15 minutes break, start at 15 mins past, finish at 15 mins past etc. it just made more sense. 

PocketWatchMan

I agree I'm not sure the move to 50min is beneficial. For the same reason, imo 1hr was much easier to judge & pace the tasks.  
The other issue is, sometimes you will get a mini-task that is a lengthy one. and the responses scroll down quite significantly for perhaps 2-3 pages detailing all kinds of information, which has to be looked at, and checked. Some like this, can quite easily take the best part of an hour on their own, perhaps more. I've had a couple where by the time I'm done, has been well over the 1 hour 10, 1hr 20 mark, maybe. Not complaining, as I enjoyed them actually, but had these cropped up in a 50 minute task, with noticeable less overall time available to complete the thing, it would be a real issue.