[Air-L] Qualtrics Survey Question

[Simon Joyce]

Hi Samantha, 

In my experience Qualitrics itself is totally reliable but I do know problems can arise if arrangements for payment don't meet participant expectations. 

Another department in my university had to abandon a survey they launched on Amazon Mechanical Turk after there was a 24 hour delay in payments going out due to an admin error. Non-payment is a major problem on these sites so workers use online forums to warn each other about non-paying clients. The survey from my colleagues got put on one of these lists inside a day and was then essentially boycotted by other workers. They never made the sample size. 

Obviously, I don't know the full details of where and how you launched your survey but it’s possible that something like this might have happened if, as you say, payments were not automatic but participants had expectations that they might be – or, at least, that they might be quicker than you had planned. 

So, my guess would be it’s not a matter of extra security measures – it’s a more matter of participant expectations and how you handle them. 

Apologies in advance if I’ve misunderstood the details of your experience. Anyway, it could make an interesting section for your methodology chapter! 

All best,
Simon. 

Dr Simon Joyce
Research Fellow
Digital Futures at Work (Digit) Research Centre 
Leeds University Business School
Leeds LS2 9JT 
Email: s.joyce1 at leeds.ac.uk 


> On 11 Aug 2022, at 03:23, Samantha LeBouef via Air-L <air-l at listserv.aoir.org> wrote:
> 
> Hi Everyone,
> 
> I'm wondering if anyone has any experience using Qualtrics for their
> surveys and the surveys receiving fraudulent or scam responses? I've spoken
> to Qualtrics support and they've assured me I have all the correct security
> features in place on the survey. I do not have incentives sent out
> automatically but it appears my survey links ended up on some kind of
> scammer list. I've closed the surveys for now but I was wondering if anyone
> has any experience dealing with this or knows of any additional security
> measures I could put into place?
> 
> Thank you in advance!
> Samantha LeBouef
> 
> -- 
> Samantha LeBouef, MA
> 391 McNeal Hall, 1985 Buford Ave., St. Paul, MN 55108
> PhD Candidate | Department of Family Social Science |
> University of Minnesota |umn.edu
> *lebou006*@umn.edu <anedoe at umn.edu>
> _______________________________________________
> The Air-L at listserv.aoir.org mailing list
> is provided by the Association of Internet Researchers http://aoir.org
> Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
> 
> Join the Association of Internet Researchers:
> http://www.aoir.org/