|
  Home | Clinical Café Archive | "September 2006 “The Validities”
September 2006 Clinical Café The report flew off of the printer just minutes before the family arrived. As the ink dried you embarked on your very articulate briefing of the results and interpretation. All seemed to be going smoothly as evidenced by eye contact and head nods from interested parties, and then that question, the one question that caught you off guard on that particular Monday morning… “Why did you choose this test? Is it valid for what we need? And how do you know?” As a drip of sweat formed and you thought that things couldn’t have grown more taxing, your supervisor chimed in with, “We pride ourselves on choosing well developed assessment tools which meet individualized evaluation needs of each student that we test. Ms. SLP please discuss this test’s development as well as its validity.” You groped for the information that was the heart of a paper written a touch more than ten years ago, a sea of words did the wave through your brain: validity…reliability…content… internal…criterion...external – “hmmm, what should I go with here??” you thought. That’s fiction! An imaginary tale, just some creative writing, you say? No! Concerned parents, administrators, supervisors, attorneys, judges and many others have increasingly posed this very question. Would your answer reassure the questioner? Don’t: run down the basement, drive to your storage facility or race to your garage in search of those boxes, the ones labeled: “grad school – keep forever.” Do: refer to specific test manuals for in-depth information about their validity and keep reading for a short and snappy review on what are affectionately (by whom??) known as “the validities.” Generally Speaking: A Definition “The general concept of validity…defined as "the degree to which a test measures what it claims, or purports, to be measuring" (Brown, 1996, p. 231). “Validity is the most important consideration in test evaluation. The concept refers to the appropriateness, meaningfulness, and usefulness of the specific inferences from the test scores. Test validation is the process of accumulating evidence to support such inferences (Goldstein & Zedeck, 1985, p. 9)." Specifically Speaking: Content, Construct, Criterion, Clinical Content Validity Content validity is concerned with a test’s ability to represent all of the content in a particular area, not just the content in the test questions themselves. Potential test questions should be reviewed by established content experts who must decide: are these test questions representative of the subject matter as a whole and can an inference be drawn from this test score to a large domain of items similar to those on the test?Real Life Example When a test demonstrates first-rate content validity, the examiner can be confident that the test score is more than just a measure of the specific content of the test’s (216 words), but can be generalized to a larger domain of content (receptive vocabulary). Construct Validity Construct validity refers to the degree to which a test is measuring the construct it claims to be measuring.A construct is an attribute, proficiency, ability, or skill that happens in the human brain. For example, overall English language proficiency is a construct. Real Life Example Goldman Fristoe Test of Articulation (GFTA) Criterion Validity Criterion validity measures the correlation of the test being validated with some well-respected outside measure(s) with the same objectives or specifications.Real Life Example A tester should be able to expect that when compared, assessment tools examining the same or similar construct (auditory comprehension in this example) would produce scores within the same range of performance. Clinical Validity Clinical validity information includes the ability to compare test performance between and within clinical subgroups. Clinical subgroups include individuals who are exceptional in some way. Examples include persons who are gifted and talented or demonstrate a reading disability, hearing impairment or articulation disorder. In order for an assessment tool to have clinical validity, persons in clinical subgroups must be included in the standardization process.Real Life Example Stay-tuned for more specific information on each of the validities! References www.speechandlanguage.com SLP Discussion Center
As always, we'd like to thank you for your ongoing service to people with communication
needs and to remind you that we are here to support you in that effort. If
you'd like to discuss this topic further, please feel free to use the SLP
Discussion Center as the vehicle for an ongoing discussion with your
colleagues. Should you have questions regarding these or other Pearson
Speech
and Language products, we welcome your phone calls at 800-627-7271 or use
our web site at http://ags.pearsonassessments.com.
|
 
|
| |||||||||||||||||
