Use AMOVA to add validity and reliability assessment value for researcher-designed instruments, with further substantiating research¶
Design Method · All design methods
Evidence · 2 claims (2 for) · 1 study (1 theoretical),q1· 0 of 1 report an effect size · 2 claims rest on one study
Description¶
The article recommends AMOVA as a post hoc addition to instrument validation practice, claiming it "adds considerable value to the methods designed to assess instrument validity and reliability especially when said instrumentation is researcher–designed". The author's stated recommendations are that more research be conducted with the model to substantiate its applicability, that an assortment of psychometric instruments use the model across disciplines, and that researchable applications be documented so the innovations can be readily applied.
Design Implications¶
Context¶
Requirements¶
- Instrument items must be clusterable and weightable on the TPE scale
- Further research to substantiate applicability, per the author's own recommendation
Constraints¶
- The author explicitly calls for more research with the model to substantiate its applicability before its value is established beyond the sample illustration
Target Learners¶
- education researchers
- instructional designers
Target Learning Objectives¶
- validating researcher-designed psychometric instruments
Claims¶
- Amova Sample Data Yields Proficient 300 [+W]
- AMOVA uses a null-hypothesis rejection cutoff at a TPE score of 2.45, which rounds via the nearest-integer function to 3.00 [+W]
Related Principles¶
Examples¶
-
Key Sources¶
- Osler, J. E. (2015). AMOVA ["Accumulative Manifold Validation Analysis"]: An advanced statistical methodology designed to measure and test the validity, reliability, and overall efficacy of inquiry-based psychometric instruments. i-manager's Journal of Educational Technology, 12(3). https://eric.ed.gov/?id=EJ1098595. doi:10.26634/jet.12.3.3742
Page metadata
| Field | Value |
|---|---|
type |
method |
id |
use-amova-for-researcher-designed-instrument-validation |
title |
Use AMOVA to add validity and reliability assessment value for researcher-designed instruments, with further substantiating research |
description |
The article recommends AMOVA as a post hoc addition to instrument validation practice, claiming it "adds considerable value to the methods designed to assess instrument validity and reliability especially when said in... |
status |
review |
generated |
by process:wiki-ingest on 2026-09-27 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — osler-2015 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.