On the New Strategy of Improving the Validity of Questionnaire Research
The validity of a questionnaire study refers to the extent to which the data obtained from the study achieve the research objectives.There are two indicators that express the validity of a questionnaire:the trial validity of the questionnaire and the measurement validity of the questionnaire.Based on extensive experience in questionnaire development,a new strategy for enhancing the validity of questionnaire research is explored:"goal tree construction,items derivation and questionnaire development,trial control,feedback evaluation and benchmarking modification."(1)Construct a target tree for conceptual analysis and a target tree for retrospective analysis based on research objectives.(2)Derive questionnaire items from the ultimate goals of the goal tree,compile stem questions and options based on the characteristics of the respondents,combining self-composed and borrowed items.(3)Apply quasi-experimental and experimental validity theory to control the influence of irrelevant variables such as trial sample error,Hawthorne effect of trial arrangement,regional cultural differences,historical events,and context contamination on questionnaire data,thus enhancing the trial validity of the survey questionnaire.(4)Use benchmark analysis and factor analysis methods to separately evaluate the content validity and structural validity of the questionnaire data,and modify the questionnaire items based on the evaluation results.
questionnaire research validitytarget treetrial validitymeasurement validity