Skip to main content

Evaluating a theory

Criteria for evaluating theories of instruction (which mine is not, but the criteria are still relevant):

from Gordon (1968, as cited in Reigeluth, 1983, p. 24-25)
1) Internal consistency - the theory should not contradict itself
2) Explicit boundaries and limitations
3) Not contradicted by empirical data (caution: apparent contradictions may be overturned with a reanalysis of the data)

from Snelbecker (1974, as cited in Reigeluth, 1983, p. 24-25)
4) Parsimoney (i.e. simplicity)

from Snow (1971, as cited in Reigeluth, 1983, p. 24-25)
5) Usefulness "The primary criterion for the evaluation of theory is usefulness, not truthfulness [p. 103]." and Hebb (1969, as cited in Reigeluth, 1983, p. 24-25): "A good theory is one that holds together long enough to get you to a better theory [p. 27]." Snow also says that a theroy should be useful for organizing existing data meaningfully and for producing useful hypotheses. (George Kelly also said something to that effect).

from Reigeluth (1983, p. 25)
6) Comprehensiveness: "For how much of the total variance does it account?"
7) Optimality (related to usefulness): "It is not enough to be valid, is it better than anything else available? In the case of a prescriptive theory, does it present the best models for achieving desired outcomes under given conditions? In the case of descriptive theory, do the models have the best outcomes for the given conditions?"
8) Breadth of applicability (percent of conditions): "For what percent of conditions is it optimal?"
Labels:

Comments

Post a Comment

Popular posts from this blog

James Paul Gee's 36 principls of learning from What Video Games Have to Teach Us about Learning and Literacy

In his book, What Video Games Have to Teach Us about Learning and Literacy , James Paul Gee identifies 36 principles of learning: Active, Critical Learning principle All aspects of the learning environment (including the ways in which the semiotic domain is designed and presented) are set up to encourage active and critical, not passive, learning. Design Principle Learning about and coming to appreciate design and design principles is core to the learning experience. Semiotic Principle Learning about and coming to appreciate interrelations within and across multiple sign systems (images, words, actions, symbols, artifacts, etc) as a complex system is core to the learning experience. Semiotic Domains Principle Learning involves mastering, at some level, semiotic domains, and being able to participate, at some level, in the affinity group or groups connected to them. Metalevel Thinking about Semiotic Domains Principle Learning involves active and cr...
Post a Comment
Read more

Controversy over Instructional-design theory

"There has been some controversy over the useful breadth of instructional-design theory. Richard Snow is well known for his work on individual differences under the rubric of ATI, or aptitude-treatment interactions...ATI is a metatheory that in effect states that theories of instruction should prescribe methods (called treatments ) on the basis of student characteristics (called aptitudes ), because the effectiveness of those methods varies depending on student characteristics. Snow (1977) has stated that ATI (aptitude-treatment interaction) 'makes general theory impossible [p. 12]'---that instructional-design theories must be narrow and local to be of value. On the other hand, Scandura (1977) represented the view of many when he stated that instructional-design theories must be broad and comprehensive to be useful." (Reigeluth, 1983, p. 31-32) Reigeluth sias the different of opinion can be traced to a focus on management vs organizational strategies.
Post a Comment
Read more