Writing Effective Survey Questions I. For quantitative data A. Making an outline of issues with (1)______. concrete thoughts — S

Writing Effective Survey Questions
    Good morning, boys and girls. Welcome to our investigation and research class. Many students, before writing a thesis, may make some surveys to support their argument. But they must be quite disappointed when there come some imprecise or even useless data. Today I’d like to show you some good ways to prevent these things from happening again. If you follow these basic guidelines, your survey items should yield useful data.
    There are two different types of data you should deal with. The first one is quantitative data.
    First, work from the outline that you created, break down each issue or detail into a single coherent, concrete thought or concept. Look for items in your outline that might be dealing with two or more different ideas or concepts. Split these up into separate lines or bullet points. Look for items that are vague or abstract and consider how they might be made more concrete.
    Second, decide what kind of rating labels you want to work with—for example, you might be measuring "level of satisfaction", that is 5-point scale with responses ranging from "very satisfied" to "very dissatisfied", or you might be measuring "level of agreement", that is responses ranging from "strongly agree" to "strongly disagree". Often, it does not matter so much which labels you choose. What matters is that you use them consistently in the survey and phrase all items that work with your chosen labels.
    It is Okay to have different rating labels for different sections of your survey, but keep changes to a minimum and be sure you keep the transitions clear in your own mind.
    Third, keep your rating labels in mind, and turn each line or bullet point in your outline into a survey item. (3) Do this by rephrasing each line in the form of a question or statement that works with the rating labels.
    Fourth, at this point, you have your initial set of survey items, but your work is not done yet. Chances are that your survey is much too long at this point, so people will not take the time to fill it out. (4) It is time to start looking for ways to shorten the survey. At the same time, you do not want to drop items that will get you the information you need. The balance between shortening the survey and making sure you get the data you need can be a tricky one. Ultimately, you must make a series of judgment calls with regard to these issues, but stick to this basic rule for each and every item—ask yourself what exactly kind of information each and every question will give you that you would not have if you get rid of the question. If you cannot come up with a concrete answer, you should drop the item. Generally, you should not keep items in your survey simply because you think they might come in handy at some point.
    Fifth, after you have finished shortening the survey, look for ways to make each item more precise. Chances are, many of your items are suffering in this area for any of the following reasons.
    For complex wording or structure -compound sentences, complex vocabulary words etc. all these things will confuse some people and make your data less precise. (5) Use simple sentences and vocabulary appropriate to your audience. This is especially important if any portion of your respondents might not be native speakers. For vague or overly general questions—Are any of your questions so broad that they will not give you specific, actionable information? "Overall satisfaction" type questions often fall into this category. If you ask yourself what you will learn from the responses, positive or negative, from each question, you will know whether they are too vague. (6) For items that could be misinterpreted—For each survey item, ask yourself whether there are any ways in which it might be misinterpreted. Many words have different meanings to different people. References to imprecise concepts such as time and distance are subjective. For questions with a "right" answer—It is an easy and common mistake to write items that have a socially "correct" or desirable answer. Also be sure you do not lead your respondents to answer in a particular way by making them think you "want" them to provide a certain response. Your items need to be presented neutrally.
    The second type of data you should deal with is qualitative data. (7) Qualitative data is your greatest opportunity to get actionable information from your survey. The selection and composition of qualitative survey items is even more important than for quantitative items. This is because you cannot ask nearly as many items that require people to respond freely. At most, you can probably only ask a handful of such items, so it is important to get them right.
    Firstly, if possible, consider conducting a pilot survey or gather a focus group to identify potential areas in which qualitative data might be most beneficial. (8) A pilot survey might simply be your complete survey sent out to 10% of the respondent group. Based on the responses you receive, you might notice some problem areas where information from respondents would be quite useful.
    Secondly, when composing qualitative items, the same rules apply as above, (9) but you need to also be sure the questions will provoke respondents to provide insightful information. The worst kinds of qualitative items are those that ask a "yes/no" question or those that invite a specific (and often brief) answer. If you give respondents an easy out like this, they will most often take it rather than take it upon themselves to provide more a more detailed or involved response than you asked for.
    Thirdly, the best test to see whether a qualitative item is well written is to answer the question yourself -read the question as if you were a survey respondent and consider whether it allows you provide a one or two word response. Consider also whether the question is too vague or general. If it falls somewhere in between and invites you to give the kind of response that you are looking for, chances are the item will work for your survey.
    Fourthly, don’t overdo it. It takes time for respondents to answer qualitative items and they will quickly grow tired of doing so and skip over such items or worse yet, not complete the survey at all.
    Okay, these are all the guidelines. Following them, I’m sure you will be guaranteed a survey result of much value, which helps promote the overall quality of your thesis. Thank you.