Designing Survey Questions for a Student Research Project

A survey can produce tidy numbers from confusing questions. Before choosing an online form, decide what you need to measure, who can answer and how you will interpret each response. Question wording, response options and order can change what respondents understand. A short pilot is often more valuable than adding ten extra questions. Follow the course’s ethics and data rules before inviting participants, and make only the claims your sampling method supports.

Define each construct

If the project asks about satisfaction, specify whether you mean overall experience, ease of access, quality of advice or an outcome after using a service. These are related but different. Write a table linking research question, construct and proposed item. Remove items that do not contribute to an analysis you plan to perform. Asking for sensitive details simply because the form makes it easy is unnecessary and may require additional safeguards.

Use one idea per question

A question such as “Was the service fast and helpful?” cannot tell you which aspect a respondent is rating. Split it. Avoid leading language like “How much did our excellent service help you?” and make the time period explicit. Keep instructions and terminology familiar to the target group. If respondents might not remember an exact number, offer an appropriate range or ask a different question rather than inviting false precision.

Make response options usable

Categories should be mutually exclusive and collectively sensible for the question. Age bands that overlap at a boundary can confuse respondents; frequency labels such as “often” may mean different things to different people. Provide “not applicable” or “do not know” when those are valid responses, but distinguish them in analysis. For an open response, explain what kind of answer you seek without implying the preferred view.

Pilot how people interpret items

Ask a small permitted pilot group to explain in their own words what each question means and how they chose an answer. Observe hesitation or repeated clarifying questions. Cognitive interviewing is a recognised way to investigate this process. Revise ambiguities and pilot again when the change is substantial. Do not use pilot responses as final study data unless your approved plan explicitly permits it.

Plan recruitment and interpretation

Know whom the survey reaches and who may be left out. A convenience sample from your own class does not automatically represent an entire university. State the response rate if you can calculate it responsibly and report missing responses. Present findings with the actual item wording and base counts where relevant. A percentage can look precise while hiding a small or biased sample.

Worked example

If your question asks whether students “regularly” use the library, one respondent may mean daily and another weekly. Replace the vague term with a defined period and options such as “0, 1–2, 3–4, 5 or more visits in the past seven days,” if that period fits the study. Pilot whether students count online visits the same way; if not, separate physical and digital use.

Pilot a question by listening to the answer process

Read one question aloud to an approved pilot participant and ask them to describe what they thought the key words meant, how they remembered the answer and why they chose that option. You are testing comprehension, not judging the person. If a respondent cannot decide whether a “visit” includes using the library website, define the term or separate online and physical behaviour. If two respondents interpret “this semester” differently, give calendar dates. Try the revised item again. Record which changes were made and why, then freeze a version before collecting the main responses. Do not quietly change wording halfway through and pool answers as though everyone saw the same question. A good pilot often reveals a problem no amount of spreadsheet analysis can repair afterward.

Checklist before you submit

Link each item to an analysis purpose.
Remove double questions and leading adjectives.
Pilot comprehension and response options.
Report sampling limits alongside percentages.

Questions students ask

How many questions should my survey include?

As few as needed to answer the research question reliably. Remove items without a clear analytical role.

Can I survey my classmates without approval?

Check your institution’s course and ethics rules before collecting data, particularly if responses are identifiable or sensitive.