Researchers in New Zealand wanted to make sure questions about what people eat and whether they have enough food are easy to understand. They talked to 68 people of different ages, backgrounds, and education levels and asked them to think out loud while answering survey questions. They found that people got confused by unclear words, technical terms they didn’t know, and complicated instructions. By simplifying the language, giving better examples, and reorganizing the questions, the researchers created a better survey that will help the government understand how well New Zealanders are eating and whether families have access to enough food.

The Quick Take

  • What they studied: Whether survey questions about eating habits and food availability are clear and easy for people to understand and answer correctly
  • Who participated: 68 people in New Zealand aged 11 and older, including a mix of different genders, ethnic backgrounds, and education levels
  • Key finding: Three main problems made the questions confusing: unclear or ambiguous words, technical nutrition terms people didn’t understand, and instructions that were too complicated or hard to follow
  • What it means for you: Better-designed survey questions mean more accurate information about what people actually eat and whether families struggle to afford food, which helps governments make better health policies. This doesn’t directly affect your daily life, but it improves the quality of health research that informs public health decisions.

The Research Details

Researchers started with 12 survey questions about food and eating habits that were either brand new, changed from older versions, or no longer matched how people actually eat today. They invited 68 people to participate in “cognitive interviews,” which is a fancy way of saying they asked people to think out loud while answering the questions. As people answered, researchers asked follow-up questions to understand exactly how they were interpreting each question. All the interviews were recorded and written down word-for-word so researchers could look for patterns in how people understood (or misunderstood) the questions.

This approach is like being a detective of language. Instead of just asking “Did you understand the question?” the researchers watched how people actually thought through their answers. They noticed when people paused, looked confused, or gave answers that didn’t match what the question was trying to ask. By listening carefully to 68 different people, they could spot which questions caused problems for most people and which ones worked fine.

Survey questions need to mean the same thing to everyone who answers them. If some people interpret a question differently than others, the results become unreliable and misleading. By testing questions with real people before using them in a big national survey, researchers can fix problems early. This is much better than discovering after surveying thousands of people that the questions were confusing.

This study used a well-established research method called cognitive testing that’s recognized as the gold standard for improving survey questions. The researchers included a diverse group of 68 participants, which helps ensure the findings apply to different types of people. The fact that they recorded and carefully analyzed everything people said makes the findings reliable. However, this study was done only in New Zealand, so the specific confusing words might be different in other countries. The study focused on improving the questions rather than testing whether the improved questions actually work better, which would be the next logical step.

What the Results Show

The researchers identified three main types of problems that made people confused when answering the survey questions. First, some questions used words that could mean different things to different people. For example, a question might ask about “regular” eating habits, but people have different ideas about what “regular” means—does it mean every day, most days, or just sometimes? Second, some questions used technical or nutrition-related words that many people didn’t understand or weren’t sure about. Third, some questions had instructions that were too long, too complicated, or unclear about what people should do.

Based on these findings, the researchers and nutrition experts worked together to fix the problems. They simplified confusing words, removed or explained technical terms, made instructions shorter and clearer, added better examples to help people understand what they were being asked, and reorganized the order of questions to make more sense. For instance, instead of asking about “dietary patterns,” they might ask “What foods do you usually eat?” These changes should make it much easier for people to understand what’s being asked and give accurate answers.

The researchers found that some of the problems appeared in multiple questions, which meant fixing one type of problem could help several questions at once. They also discovered that some age groups or education levels had more trouble with certain types of confusing language, suggesting that survey designers need to think about who will be answering their questions.

This study builds on decades of research showing that how you ask a question dramatically affects the answer you get. Previous surveys about food and eating have sometimes had unclear questions, which is why researchers decided to test these new and updated questions before using them nationwide. This careful approach is becoming more common in nutrition research because scientists have learned that small changes in wording can lead to very different results.

This study only tested the questions with 68 people in New Zealand, so the results might not apply exactly the same way in other countries or cultures where people use different words or have different food environments. The study improved the questions based on what people said, but it didn’t actually test whether the improved questions work better in a real survey of thousands of people—that would be the next step. Additionally, the study didn’t test the questions with very young children (under 11), so we don’t know if the improved questions work well for them.

The Bottom Line

If you’re involved in nutrition research or survey design, this study strongly suggests you should test your questions with real people before using them in a large survey. The specific recommendations from this study—simplify language, explain technical terms, clarify instructions, and improve examples—apply to any survey about food and eating. Confidence level: High, based on established research methods.

Government health agencies, nutrition researchers, survey designers, and public health professionals should pay attention to these findings. If you’re a regular person answering a nutrition survey, this research helps ensure the questions you’re asked are clear and fair. You don’t need to change anything about your own eating habits based on this study.

This isn’t about personal health changes, so there’s no timeline for seeing benefits. However, once the improved survey questions are used in a national nutrition survey (likely within the next 1-2 years), the government and health researchers will have better, more accurate information about New Zealand’s eating habits and food security, which could lead to better health policies within 2-5 years.

Want to Apply This Research?

  • If you use a nutrition tracking app, pay attention to how clearly the app’s questions are worded when it asks about your eating habits. Track whether you ever feel confused about what the app is asking and note which questions are hardest to answer accurately. This feedback helps app developers improve their questions.
  • When using a nutrition app, take time to read questions carefully and make sure you understand what’s being asked before answering. If a question seems unclear, look for help text or examples within the app. This ensures your food tracking data is accurate and useful.
  • Over time, notice whether nutrition apps you use have clear, easy-to-understand questions or whether they use confusing words and complicated instructions. Apps that use simple language and good examples will give you better insights into your eating habits because you’ll be answering accurately.

This research focuses on improving survey questions rather than providing health or nutrition advice. The findings don’t directly recommend changes to what you eat or how you should manage food. If you have concerns about your nutrition or food security, please consult with a healthcare provider, registered dietitian, or local food assistance programs. This study was conducted in New Zealand and may not apply exactly the same way in other countries or regions.