Surveys are extremely hard to do properly, but no matter what, a survey should never have leading questions, or make assumptions.Peter from LinPlug wrote:Just to add myself to your statements, I took the survey. i dont think its particularly clever, but I doubt one can make a realy clever one, no matter what. I not give much on the results, as i dont give much on any surveys result.
A question such as "do you believe it is OK to use commercial software without first paying for it? Yes, Sometimes, No, Undecided." Is probably OK.
By contrast the same question rephrased as "do you believe it is OK to steal software?" is poorly posed, since it specifies theft, or the intent to permanently deprive. Someone who uses cracked software by way of an extended demo, may not have a permanent intent to deprive. Someone who uses unregistered abandon-ware also may not see their actions as theft since they have no intent to deprive. Putting aside the morals of the subject, the question itself, presented, as it is, as a way to understand another's POV, leaves no way to give an honest answer.
At its worst, this kind of sloppiness often turns up in surveys as "I do not believe it is necessary to pay for the software I own (agree/disagree)" which is so clearly busted on so many levels. It makes no distinction between lawfully or unlawfully free software, and offers only binary answers, for example. I'm always amazed how often I see surveys mistakes like that though.
A good survey can be a very useful tool, but a bad survey is no better, and usually worse, than no survey at all.
