A structural equation modeling approach for examining position effects in large-scale assessments View Full Text


Ontology type: schema:ScholarlyArticle      Open Access: True


Article Info

DATE

2017-02-16

AUTHORS

Okan Bulut, Qi Quo, Mark J. Gierl

ABSTRACT

Position effects may occur in both paper–pencil tests and computerized assessments when examinees respond to the same test items located in different positions on the test. To examine position effects in large-scale assessments, previous studies often used multilevel item response models within the generalized linear mixed modeling framework. Using the equivalence of the item response theory and binary factor analysis frameworks when modeling dichotomous item responses, this study introduces a structural equation modeling (SEM) approach that is capable of estimating various types of position effects. Using real data from a large-scale reading assessment, the SEM approach is demonstrated for investigating form, passage position, and item position effects for reading items. The results from a simulation study are also presented to evaluate the accuracy of the SEM approach in detecting item position effects. The implications of using the SEM approach are discussed in the context of large-scale assessments. More... »

PAGES

8

Identifiers

URI

http://scigraph.springernature.com/pub.10.1186/s40536-017-0042-x

DOI

http://dx.doi.org/10.1186/s40536-017-0042-x

DIMENSIONS

https://app.dimensions.ai/details/publication/pub.1083866122


Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
Incoming Citations Browse incoming citations for this publication using opencitations.net

JSON-LD is the canonical representation for SciGraph data.

TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

[
  {
    "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
    "about": [
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/17", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Psychology and Cognitive Sciences", 
        "type": "DefinedTerm"
      }, 
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/1701", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Psychology", 
        "type": "DefinedTerm"
      }
    ], 
    "author": [
      {
        "affiliation": {
          "alternateName": "Centre for Research in Applied Measurement and Evaluation, University of Alberta, 6-110 Education Centre North, 11210 87 Ave NW, T6G 2G5, Edmonton, AB, Canada", 
          "id": "http://www.grid.ac/institutes/grid.17089.37", 
          "name": [
            "Centre for Research in Applied Measurement and Evaluation, University of Alberta, 6-110 Education Centre North, 11210 87 Ave NW, T6G 2G5, Edmonton, AB, Canada"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Bulut", 
        "givenName": "Okan", 
        "id": "sg:person.013415763561.43", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013415763561.43"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Centre for Research in Applied Measurement and Evaluation, University of Alberta, 6-110 Education Centre North, 11210 87 Ave NW, T6G 2G5, Edmonton, AB, Canada", 
          "id": "http://www.grid.ac/institutes/grid.17089.37", 
          "name": [
            "Centre for Research in Applied Measurement and Evaluation, University of Alberta, 6-110 Education Centre North, 11210 87 Ave NW, T6G 2G5, Edmonton, AB, Canada"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Quo", 
        "givenName": "Qi", 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Centre for Research in Applied Measurement and Evaluation, University of Alberta, 6-110 Education Centre North, 11210 87 Ave NW, T6G 2G5, Edmonton, AB, Canada", 
          "id": "http://www.grid.ac/institutes/grid.17089.37", 
          "name": [
            "Centre for Research in Applied Measurement and Evaluation, University of Alberta, 6-110 Education Centre North, 11210 87 Ave NW, T6G 2G5, Edmonton, AB, Canada"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Gierl", 
        "givenName": "Mark J.", 
        "id": "sg:person.0721136322.46", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.0721136322.46"
        ], 
        "type": "Person"
      }
    ], 
    "citation": [
      {
        "id": "sg:pub.10.1007/bf02294363", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1006797357", 
          "https://doi.org/10.1007/bf02294363"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-1-4757-3990-9", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1009296370", 
          "https://doi.org/10.1007/978-1-4757-3990-9"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-1-4939-0317-7", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1013871579", 
          "https://doi.org/10.1007/978-1-4939-0317-7"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.3758/s13428-015-0619-7", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1026628972", 
          "https://doi.org/10.3758/s13428-015-0619-7"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/bf02296338", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1049193432", 
          "https://doi.org/10.1007/bf02296338"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/bf02296192", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1026258310", 
          "https://doi.org/10.1007/bf02296192"
        ], 
        "type": "CreativeWork"
      }
    ], 
    "datePublished": "2017-02-16", 
    "datePublishedReg": "2017-02-16", 
    "description": "Position effects may occur in both paper\u2013pencil tests and computerized assessments when examinees respond to the same test items located in different positions on the test. To examine position effects in large-scale assessments, previous studies often used multilevel item response models within the generalized linear mixed modeling framework. Using the equivalence of the item response theory and binary factor analysis frameworks when modeling dichotomous item responses, this study introduces a structural equation modeling (SEM) approach that is capable of estimating various types of position effects. Using real data from a large-scale reading assessment, the SEM approach is demonstrated for investigating form, passage position, and item position effects for reading items. The results from a simulation study are also presented to evaluate the accuracy of the SEM approach in detecting item position effects. The implications of using the SEM approach are discussed in the context of large-scale assessments.", 
    "genre": "article", 
    "id": "sg:pub.10.1186/s40536-017-0042-x", 
    "isAccessibleForFree": true, 
    "isPartOf": [
      {
        "id": "sg:journal.1136215", 
        "issn": [
          "2196-0739"
        ], 
        "name": "Large-scale Assessments in Education", 
        "publisher": "Springer Nature", 
        "type": "Periodical"
      }, 
      {
        "issueNumber": "1", 
        "type": "PublicationIssue"
      }, 
      {
        "type": "PublicationVolume", 
        "volumeNumber": "5"
      }
    ], 
    "keywords": [
      "item-position effect", 
      "structural equation modeling approach", 
      "position effects", 
      "large-scale reading assessment", 
      "same test items", 
      "paper-pencil test", 
      "item response models", 
      "item response theory", 
      "SEM approach", 
      "computerized assessment", 
      "test items", 
      "large-scale assessments", 
      "reading assessment", 
      "factor analysis", 
      "item responses", 
      "response theory", 
      "items", 
      "multilevel item response models", 
      "dichotomous item responses", 
      "response model", 
      "examinees", 
      "previous studies", 
      "assessment", 
      "modeling approach", 
      "implications", 
      "context", 
      "effect", 
      "test", 
      "study", 
      "theory", 
      "approach", 
      "modeling framework", 
      "framework", 
      "equivalence", 
      "response", 
      "accuracy", 
      "different positions", 
      "position", 
      "model", 
      "types", 
      "form", 
      "results", 
      "analysis", 
      "data", 
      "real data", 
      "Binary Factor Analysis", 
      "simulation study", 
      "generalized linear mixed modeling framework", 
      "linear mixed modeling framework"
    ], 
    "name": "A structural equation modeling approach for examining position effects in large-scale assessments", 
    "pagination": "8", 
    "productId": [
      {
        "name": "dimensions_id", 
        "type": "PropertyValue", 
        "value": [
          "pub.1083866122"
        ]
      }, 
      {
        "name": "doi", 
        "type": "PropertyValue", 
        "value": [
          "10.1186/s40536-017-0042-x"
        ]
      }
    ], 
    "sameAs": [
      "https://doi.org/10.1186/s40536-017-0042-x", 
      "https://app.dimensions.ai/details/publication/pub.1083866122"
    ], 
    "sdDataset": "articles", 
    "sdDatePublished": "2022-12-01T06:36", 
    "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
    "sdPublisher": {
      "name": "Springer Nature - SN SciGraph project", 
      "type": "Organization"
    }, 
    "sdSource": "s3://com-springernature-scigraph/baseset/20221201/entities/gbq_results/article/article_745.jsonl", 
    "type": "ScholarlyArticle", 
    "url": "https://doi.org/10.1186/s40536-017-0042-x"
  }
]
 

Download the RDF metadata as:  json-ld nt turtle xml License info

HOW TO GET THIS DATA PROGRAMMATICALLY:

JSON-LD is a popular format for linked data which is fully compatible with JSON.

curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1186/s40536-017-0042-x'

N-Triples is a line-based linked data format ideal for batch operations.

curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1186/s40536-017-0042-x'

Turtle is a human-readable linked data format.

curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1186/s40536-017-0042-x'

RDF/XML is a standard XML format for linked data.

curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1186/s40536-017-0042-x'


 

This table displays all metadata directly associated to this object as RDF triples.

142 TRIPLES      21 PREDICATES      79 URIs      65 LITERALS      6 BLANK NODES

Subject Predicate Object
1 sg:pub.10.1186/s40536-017-0042-x schema:about anzsrc-for:17
2 anzsrc-for:1701
3 schema:author Nb1d6640aa2d84013b4f0d72090b5ef34
4 schema:citation sg:pub.10.1007/978-1-4757-3990-9
5 sg:pub.10.1007/978-1-4939-0317-7
6 sg:pub.10.1007/bf02294363
7 sg:pub.10.1007/bf02296192
8 sg:pub.10.1007/bf02296338
9 sg:pub.10.3758/s13428-015-0619-7
10 schema:datePublished 2017-02-16
11 schema:datePublishedReg 2017-02-16
12 schema:description Position effects may occur in both paper–pencil tests and computerized assessments when examinees respond to the same test items located in different positions on the test. To examine position effects in large-scale assessments, previous studies often used multilevel item response models within the generalized linear mixed modeling framework. Using the equivalence of the item response theory and binary factor analysis frameworks when modeling dichotomous item responses, this study introduces a structural equation modeling (SEM) approach that is capable of estimating various types of position effects. Using real data from a large-scale reading assessment, the SEM approach is demonstrated for investigating form, passage position, and item position effects for reading items. The results from a simulation study are also presented to evaluate the accuracy of the SEM approach in detecting item position effects. The implications of using the SEM approach are discussed in the context of large-scale assessments.
13 schema:genre article
14 schema:isAccessibleForFree true
15 schema:isPartOf N1d334e9d184146d0a32cccbc4097e9d3
16 Nabe0825389ea4116b53d054a9563f229
17 sg:journal.1136215
18 schema:keywords Binary Factor Analysis
19 SEM approach
20 accuracy
21 analysis
22 approach
23 assessment
24 computerized assessment
25 context
26 data
27 dichotomous item responses
28 different positions
29 effect
30 equivalence
31 examinees
32 factor analysis
33 form
34 framework
35 generalized linear mixed modeling framework
36 implications
37 item response models
38 item response theory
39 item responses
40 item-position effect
41 items
42 large-scale assessments
43 large-scale reading assessment
44 linear mixed modeling framework
45 model
46 modeling approach
47 modeling framework
48 multilevel item response models
49 paper-pencil test
50 position
51 position effects
52 previous studies
53 reading assessment
54 real data
55 response
56 response model
57 response theory
58 results
59 same test items
60 simulation study
61 structural equation modeling approach
62 study
63 test
64 test items
65 theory
66 types
67 schema:name A structural equation modeling approach for examining position effects in large-scale assessments
68 schema:pagination 8
69 schema:productId Ne7386488289444ef9b119d6607594d81
70 Nf034837fd9de4781ad678b0cac089a2b
71 schema:sameAs https://app.dimensions.ai/details/publication/pub.1083866122
72 https://doi.org/10.1186/s40536-017-0042-x
73 schema:sdDatePublished 2022-12-01T06:36
74 schema:sdLicense https://scigraph.springernature.com/explorer/license/
75 schema:sdPublisher N0b8751eee7e4475caa6e9b7f6baa82bc
76 schema:url https://doi.org/10.1186/s40536-017-0042-x
77 sgo:license sg:explorer/license/
78 sgo:sdDataset articles
79 rdf:type schema:ScholarlyArticle
80 N0b8751eee7e4475caa6e9b7f6baa82bc schema:name Springer Nature - SN SciGraph project
81 rdf:type schema:Organization
82 N1d334e9d184146d0a32cccbc4097e9d3 schema:issueNumber 1
83 rdf:type schema:PublicationIssue
84 N2ac1f7a19d5744e1a73cb760ea2f1259 rdf:first Ne8239953a261498a9bff669dc4f0e195
85 rdf:rest N9d61b30ab32340cebc2a0b6d0035a64c
86 N9d61b30ab32340cebc2a0b6d0035a64c rdf:first sg:person.0721136322.46
87 rdf:rest rdf:nil
88 Nabe0825389ea4116b53d054a9563f229 schema:volumeNumber 5
89 rdf:type schema:PublicationVolume
90 Nb1d6640aa2d84013b4f0d72090b5ef34 rdf:first sg:person.013415763561.43
91 rdf:rest N2ac1f7a19d5744e1a73cb760ea2f1259
92 Ne7386488289444ef9b119d6607594d81 schema:name dimensions_id
93 schema:value pub.1083866122
94 rdf:type schema:PropertyValue
95 Ne8239953a261498a9bff669dc4f0e195 schema:affiliation grid-institutes:grid.17089.37
96 schema:familyName Quo
97 schema:givenName Qi
98 rdf:type schema:Person
99 Nf034837fd9de4781ad678b0cac089a2b schema:name doi
100 schema:value 10.1186/s40536-017-0042-x
101 rdf:type schema:PropertyValue
102 anzsrc-for:17 schema:inDefinedTermSet anzsrc-for:
103 schema:name Psychology and Cognitive Sciences
104 rdf:type schema:DefinedTerm
105 anzsrc-for:1701 schema:inDefinedTermSet anzsrc-for:
106 schema:name Psychology
107 rdf:type schema:DefinedTerm
108 sg:journal.1136215 schema:issn 2196-0739
109 schema:name Large-scale Assessments in Education
110 schema:publisher Springer Nature
111 rdf:type schema:Periodical
112 sg:person.013415763561.43 schema:affiliation grid-institutes:grid.17089.37
113 schema:familyName Bulut
114 schema:givenName Okan
115 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013415763561.43
116 rdf:type schema:Person
117 sg:person.0721136322.46 schema:affiliation grid-institutes:grid.17089.37
118 schema:familyName Gierl
119 schema:givenName Mark J.
120 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.0721136322.46
121 rdf:type schema:Person
122 sg:pub.10.1007/978-1-4757-3990-9 schema:sameAs https://app.dimensions.ai/details/publication/pub.1009296370
123 https://doi.org/10.1007/978-1-4757-3990-9
124 rdf:type schema:CreativeWork
125 sg:pub.10.1007/978-1-4939-0317-7 schema:sameAs https://app.dimensions.ai/details/publication/pub.1013871579
126 https://doi.org/10.1007/978-1-4939-0317-7
127 rdf:type schema:CreativeWork
128 sg:pub.10.1007/bf02294363 schema:sameAs https://app.dimensions.ai/details/publication/pub.1006797357
129 https://doi.org/10.1007/bf02294363
130 rdf:type schema:CreativeWork
131 sg:pub.10.1007/bf02296192 schema:sameAs https://app.dimensions.ai/details/publication/pub.1026258310
132 https://doi.org/10.1007/bf02296192
133 rdf:type schema:CreativeWork
134 sg:pub.10.1007/bf02296338 schema:sameAs https://app.dimensions.ai/details/publication/pub.1049193432
135 https://doi.org/10.1007/bf02296338
136 rdf:type schema:CreativeWork
137 sg:pub.10.3758/s13428-015-0619-7 schema:sameAs https://app.dimensions.ai/details/publication/pub.1026628972
138 https://doi.org/10.3758/s13428-015-0619-7
139 rdf:type schema:CreativeWork
140 grid-institutes:grid.17089.37 schema:alternateName Centre for Research in Applied Measurement and Evaluation, University of Alberta, 6-110 Education Centre North, 11210 87 Ave NW, T6G 2G5, Edmonton, AB, Canada
141 schema:name Centre for Research in Applied Measurement and Evaluation, University of Alberta, 6-110 Education Centre North, 11210 87 Ave NW, T6G 2G5, Edmonton, AB, Canada
142 rdf:type schema:Organization
 




Preview window. Press ESC to close (or click here)


...