Skip to main content

9 aspects of validity in Validity Centered Design

From Bunderson 2003, pp. 12-13

USER CENTERED DESIGN


1. Overall appeal.
2. Usability. The instrument will be easy to use, understandable, quick and efficient.
3. Perceived value to the target users, perceived positive consequences.


CONTENT and CONSTRUCT evidence of validity


4. Content coverage and appropriateness.
5. Substantive processes -- The important but typically invisible mental processes
used by those whom we would wish to score as more successful on an instrument,
or affective attributes of persons such as their beliefs, attitudes, and values. It is
only through theories of the cognitive, linguistic, affective or perhaps psychomotor
processes that we can design appropriate questions or performance tasks to get at
different degrees of these usually invisible processes.
6. Structure of the constructs. The starting number of questions or tasks is expected
to collapse into a smaller number of separate unidimensional measurement scales.
The scales we design should correspond with an hypothesized, then increasingly
validated structure.

CRITERION-RELATED


7. Generalizability. Evidence that the scoring methods and scores are reliable, and
generalize to different genders, racial groups, national groups, etc.
8. External. Evidence that the scores predict other valid criteria of what is being
measured; also, evidence that other instruments correlate or do not correlate as
would be expected by the nature of their constructs.
9. Consequential. Evidence that positive results (consequences) do occur over time,
and that unexpected but negative consequences do not occur over time. This is an
extension of the perceived positive consequences listed under category I, above. In
this aspect of validity, we obtain evidence of the actual occurrence of positive or
negative consequences.
Labels:

Comments

Post a Comment

Popular posts from this blog

Trait vs state

"A useful distinction in the discussion of student characteristics is trait versus state. Traits are student characteristics that are relatively constant over time...whereas states are student characteristics that tend to vary during individual learning experiences, such as level of content-specific knowledge." (Reigeluth, 1983, p. 32) Reigeluth also states that "many strategy components have been shown to help students with all kinds of traits to learn" [p. 32]. My position is that we do not know a priori which aspects of our instructional strategies, learning environment, motivator, etc... will generalize across many or all students. However, with a localized learning theory we can learn over time which do and which do not. At the same time, we will likely find ways of grouping students that we never would have before imagined.
Post a Comment
Read more

James Paul Gee's 36 principls of learning from What Video Games Have to Teach Us about Learning and Literacy

In his book, What Video Games Have to Teach Us about Learning and Literacy , James Paul Gee identifies 36 principles of learning: Active, Critical Learning principle All aspects of the learning environment (including the ways in which the semiotic domain is designed and presented) are set up to encourage active and critical, not passive, learning. Design Principle Learning about and coming to appreciate design and design principles is core to the learning experience. Semiotic Principle Learning about and coming to appreciate interrelations within and across multiple sign systems (images, words, actions, symbols, artifacts, etc) as a complex system is core to the learning experience. Semiotic Domains Principle Learning involves mastering, at some level, semiotic domains, and being able to participate, at some level, in the affinity group or groups connected to them. Metalevel Thinking about Semiotic Domains Principle Learning involves active and cr...
Post a Comment
Read more

Gagné's Five Categories (or Domains) of Learning

From Aronson and Briggs (1938) p. 81-82 1) Intellectual skill Using concepts and rules to solve problems; responding to classes of stimuli as distinct from recalling specific examples 2) Motor skill Executing bodily movements smootly and in proper sequence 3) Verbal information Stating information 4) Cognitive strategy Originating novel solutions to problems; utilizing various means for controlling one's thinking/learning processes 5) Attitude Choosing to behave in a particular way "For Gagne, learning occurs when an individual acquires a particular capability to do something." "The capability that one acquires when learning verbal information (e.g., a spouse's birthday) is stating the information. On the other hand, the capability that one acquires in learning an attitude is choosing to act in one way or another...When a person has learned a concept, which is one type of intellectual skill , the person has the capability to correctly identify or classify any pr...
Post a Comment
Read more