Hey everyone! As the title suggests, I have made a website that lets you very quickly gather ~100 preferences between two images from people around the world. It has been made as a fun side project to get quick quantitative feedback on photos, graphics, or short animations. I was thinking that it might be a helpful tool in a design process (especially when iterating different variations), and would like to hear your thoughts on it. Currently it is rather rudimentary - supply two images, a rating question/criteria, and some very basic audience targeting. However, I am looking for any feedback or suggestions that could help make it better and more useful. If you think this could be useful to you, I would be grateful if you would check it out at app.rapidata.ai/compare and let me know what you think.
It’s an interesting concept, but I have a couple of concerns.
- From a practical standpoint, it would be more helpful if you could further quantify the user group (e.g. males in North American age 18 - 30).
- Again from a practical standpoint, it might be helpful to be able to have more than two options compared, but I also get the A/B nature of this.
- From a security standpoint, clients might not appreciate their work being put out for public consumption – especially for things related to product development such as packaging.
- From a cynical standpoint, I think that I’d be posting work for others to steal.
Bottom line is that it’s sort of a neat idea, but it might be better suited to amateurs or low end projects. Pros will likely stick with more secure, more targeted feedback.
Wow, what a great tool! Also where can I partake in a comparison of someone’s materials? That would be very interesting to me 
I tried your instrument and I like it! It is a bit slow in getting the reviews but still useful, I wish more people knew about it:) Here are some of my ideas:
You can add not only geo to choose from, but also detailed demographic options like age and gender, maybe cities, or something like that.
I would also love to see more detailed feedback and comments that is optional to leave.
The interface is simple and intuitive which is good! I would also like to know more about how exactly the reviews are collected, and if you have it mentioned somewhere but I missed than you can make it more visible to users.
But I also should mention the @Steve_O concern about someone stealing your art and I honestly don’t have a solution to it, maybe watermarks and low resolution preview?
Thanks a lot for the feedback!
More granularity in the targeting is definitely something that I want to work towards. It makes things a bit more complicated but definitely something that i want to implement - e.g. as a premium feature. What do you think would be fair to charge it in that case?
For more than 2, do you mean for like a ranking between several? Or multiple pairwise AB tests?
I completely get your security question. The designs that get shown are low-res and generally displayed in-app on mobile devices, it is not really easy to steal the content. But maybe including something like a watermark could be an option?
Thanks a lot for the feedback and for trying it out! There is currently no way to actively sign up to be part of the audience, but if there is a lot of interest in it, that would definitely be something that I can make available in the future.
I am happy you found it useful, feel free to share it :D. I am sorry that it was slow - may i ask what kind of targeting you selected? Maybe I can look into getting a bigger audience there.
More detailed targeting seems to be a a common suggestion/request, so I am definitely looking into that. Also free text responses or some sort of more detailed feedback is something i might experiment with in the future. Maybe i will give an update once I have something new there.
Interesting point about the way reviews are collected. Maybe I should add like an FAQ or similar. To give some context here, essentially I am integrating with different mobile apps, similar to e.g. Duolingo, so the audience will be the users of those apps.
Thanks a lot for the suggestions regarding security! the previews are already somewhat compressed, and the watermark could be a good idea!
I don’t need a doodad to compare logos. I need something that goes straight to my client’s nerve system and guides him/her to see things the correct way.
I was thinking something along the same line as Eriskay. 
I was also thinking, a lot of times, design is created under more stringent guidelines that would preclude public posting for “likes.” Which is pretty much what this is without some form of Demographics capability.
I will share it with fellow graphic designers, don’t worry about it 
Regarding the targeting I selected North America, as it is the target audience I currently work with.
Oh yes, FAQ format would be great, personally I would definitely want to learn more about the process! All the best luck with improving your project!!!
We need to develop a software like this ASAP 