How to test the reliability and validity of a questionnaire. In general, an efa prepares the variables to be used for cleaner structural equation modeling. Using confirmatory factor analysis to evaluate construct. Calculate composite reliability cr and average variance. The broad purpose of factor analysis is to summarize. Using exploratory and confirmatory factor analysis to. Lehmann columbia university this paper presents a simple procedure for establishing convergent and discriminant validity. Test final factors for construct validity using your factor as an independent variable, 1. This will allow readers to develop a better understanding of when to employ factor analysis and how to interpret the tables and graphs in the output.
Dec 14, 2011 how to test the convergent validity and discriminant validity of sem model. Convergent and discriminant validity are both considered subcategories or subtypes of construct validity. Evidence for the factorial and construct validity of a. Put all six items in that scale into the analysis 3. Contrast analysis and construct validity in their classic article on construct validation, cronbach and meehl 1955 considered the possibility of developing an overall coefficient for indexing construct validity but noted the difficulty of providing anything more than. While true or not the data is highly dependent on true or not the research instrument. Assess the reliability of the test given that reliability is necessary but not sufficient for validity. Hox department of methodology and statistics, utrecht university, the netherlands abstract. Convergent validity an overview sciencedirect topics. Using a crosssectional design, we established the factorial validity of the his scale with confirmatory factor analysis and the construct validity of the his with pearson product moment. Factor analysis on the questionnaire for construct validity was performed using tests contained in spss pasw version 20. Factor analysis factorial validity correlating with other theoretical measure with. The method uses ordinary leastsquares regression ols with the correlations between measures as the dependent variable.
Factor analyses provide evidence of construct validity for nsses ten. Hierarchical confirmatory factor analysis multitrait multimethod approach hcfa mtmm was used with data from 2,334 uk adolescents, both smokers and nonsmokers. Examining construct validity of the student online. Internal reliability if you have a scale with of six items, 16, 1. Each component has a quality score called an eigenvalue. Using exploratory and confirmatory factor analysis to measure construct validity of the traits, aptitudes, and behaviors scale tabs kevin d. Assessing convergent and discriminant validity in the adhdr. Formative construct validity can also be partially assessed using the results of the factor analysis shown in table 1. With respect to correlation matrix if any pair of variables has a value less than 0. Spurious presentations and plausible presentations see rogers et al. Construct validity is more conceptual than statistical in nature.
To save space each variable is referred to only by its label on the data editor e. Chapter 4 exploratory factor analysis and principal. The classical multitraitmultimethod mtmm matrix can be viewed as a twodimensional crossclassi. Now, with 16 input variables, pca initially extracts 16 factors or components. Testing criterion validity is beyond the scope of your project, but be aware of what it is and make sure you select s ensible items. Oct 20, 2016 factor analysis principal components analysis with varimax rotation in spss. How to calculate validity of questionnaire in spss.
Ask for two scores, cronbachs alpha and gutmmans lambda guttmans lambda w. Here are just some basic suggestions to get you started. If the determinant is 0, then there will be computational problems with the factor analysis, and spss may issue a warning message or be unable to complete the factor analysis. Kaisermeyerolkin measure of sampling adequacy this measure varies between 0 and 1, and values closer to 1 are better. Factor analysis provides information about reliability, item quality, and construct validity general goal is to understand whether and to what extent items from a scale may reflect an underlying hypothetical construct or constructs, known as factors. Contrast analysis and construct validity in their classic article on construct validation, cronbach and meehl 1955 considered the possibility of developing an overall coefficient for indexing construct validity but noted the difficulty of providing anything more than a broad indication of the upper and lower bounds of validity. The method uses ordinary leastsquares regression ols with the correlations between measures as the depen dent variable. Therefore, the correct data will be determining true the results of research quality. To evaluate the factorial and construct validity of the head injury scale his among a sample of male and female collegiate athletes. Andy field page 5 10122005 interpreting output from spss select the same options as i have in the screen diagrams and run a factor analysis with orthogonal rotation. How to test validity questionnaire using spss spss tests. An alternative procedure for assessing convergent and discriminant validity donald r.
Construct is similar to a concept, which is formally proposed with a definition and is related to empirical data methods. Feb 07, 2020 confirmatory factor analysis for all constructs is an important first step before developing a structural equation model. Jeff meyer is a statistical consultant with the analysis factor, a stats mentor for statistically speaking membership, and a workshop instructor. For factor analysis, items on the survey that did not exceed a 0. How to test the convergent validity and discriminant validity of sem model. Confirmatory factor analysis for all constructs is an important first step before developing a structural equation model. Lehmann columbia university this paper presents a simple procedure for estab lishing convergent and discriminant validity. Convergent and discriminant validities are two fundamental aspects of construct validity.
Exploratory factor analysis and principal components analysis exploratory factor analysis efa and principal components analysis pca both are methods that are used to help investigators represent a large number of relationships among normally distributed or scale variables in a simpler more parsimonious way. Check the factor structure of the test to evaluate whether items load most on the theorised scales. Factor analysis principal components analysis with varimax rotation in spss. An analytic method with high sensitivity to identify problematic. Evidence for the factorial and construct validity of a self. Assessing convergent and discriminant validity of the.
Construct validity can be viewed as an overarching term to assess the validity of the measurement procedure e. Besnoy, and caitlin byrne journal for the education of the gifted 2016 39. Factor analysis with factor analysis, the construct validity of a questionnaire can be tested bornstedt, 1977. If you are unsure what we mean by terms such as constructs, variables, and conceptual and operational definitions, we would recommend that you first read the. The important thing to recognize is that they work together if you can demonstrate that you have evidence for both convergent and discriminant validity, then youve by definition demonstrated that you have evidence for construct validity. The majority of factor analytic studies have found a two factor i. The ctcm model consisted of four correlated language constructs and three correlated method factors. A simple explanation factor analysis is a statistical procedure used to identify a small number of factors that can be used to represent relationships among sets of interrelated variables. Even the exploratory factor analysis, that looks at relationships among items that supposedly measure the same concept or. Reliability is a very important factor in assessment, and is presented as an. As indicated, the items used to assess online forum participation.
The majority of factor analytic studies have found a twofactor i. It is however important to ensure that instruments have external. Discriminant validity evidence is reported in rogers et al. Exploratory factor analysis efa is a statistical approach for determining the correlation among the variables in a dataset.
How can i validate a questionnaires construct using spss. Exploratory factor analysis efa was ap plied to the six items of the questionnaire. Factor analysis validity statistics factor analysis. Construct validity is concerned with the extent to which an instrument may be said to measure a theoretical construct or trait. Validity and reliability of the instrument using exploratory. Construct validity examination of critical thinking. Exploratory factor analysis reliability ronbachs alpha the data were analyzed using social sciences spss software version 23. For example, computer use by teachers is a broad construct that can have a number of factors use for testing. Using exploratory and confirmatory factor analysis to measure.
Convergent validity is problematic as various measures of impulsivity e. These testing the internal structure through factor analysis improves the validity of any instrument, at least internally. A multilevel multitraitmultimethod analysis cora j. Statistical analysis descriptive statistics were used to analyze the data. Exploratory and confirmatory factor analyses for testing. Confirmatory factor analysis has been used to examine the underlying factor structure, which tends to yield two dimensions labeled.
As such, factorial validity is assessed through factor analysis. The offdiagonal elements the values on the left and right side of diagonal in the table below should all be. By examining ei factor structures through exploratory and confirmatory factor analysis efacfa, quantitative evidence can support claims that the eis actually measure what they intend 1to measure. Only components with high eigenvalues are likely to represent a real underlying factor. Questionnaire evaluation with factor analysis and cronbach. Appendix b construct reliability and validity analysis.
How to test validity questionnaire using spss the validity and reliability the instrument is essential in research data collection. You could start with exploratory factor analysis and then later on build up to confirmatory factor analysis. Construct validity is considered an overarching term to assess the measurement procedure used to measure a given construct because it incorporates a number of other forms of validity i. Path estimates represent the relationships between constructs as does. This validity basically refers to whether the factor structure of the questionnaire makes intuitive sense. As a result of confirmatory factor analysis cfa, the hypothesized model of 20item structure of the solr instrument was verified as a good fit for the data. The similarity between the processes of construct validation and efa is described and the use of efa as a tool to explore score validity is explored. Assessing convergent and discriminant validity in the adhd.
For a construct to be scientifically acceptable it had to be located in a nomological network, made up of laws that are either statistical or deterministic. Testing the convergent and discriminant validity of the. Factor analysis using spss 2005 university of sussex. If a questionnaire is construct valid, all items together represent the underlying construct 2 p01 i love writing. How do i validate instrument through factor analysis. The authors extended research on the construct validity of the decisional balance scale for smoking in adolescence by testing its convergent and discriminant validity. This type of analysis provides a factor structure a grouping of variables based on strong correlations. First, an mtmm correlation matrix was obtained to examine convergent validity, discriminant validity, and construct validity. Confirmatory factor modeling approach was used to assess the construct validity of the solr instrument for this study.
615 29 207 135 466 392 1088 735 1520 1050 749 659 240 1307 54 1180 1053 869 1153 545 684 242 81 1406 582 1437 837 1053 1103 608 791 372 557