Formative Assessment Design: A Balancing Act

Research output: ThesisPhD Thesis - Research UT, graduation UTAcademic

10 Downloads (Pure)

Abstract

Formative assessment has been considered a promising way to support student learning. It has been defined as both an instrument and a process. The instrument provides information about a student’s learning. During the process, the information is judged and used by teachers, students, or their peers for actions that support that learning.

Teachers have difficulty understanding and using the evidence from assessment instruments. Therefore, this dissertation investigates what content and visual presentation of a formative assessment instrument could help teachers.

The dissertation consists of five studies:
-A theoretical study about the validation of formative assessment.
-A needs assessment, which investigated the type of instructional actions as well as the information needs to enable these actions.
-A evaluation study investigating the usability of a formative assessment platform
-A factorial study investigating the extent to which visualizations of measurement error in score reports influence teachers’ instructional decisions.
-A study that explores how to visualize a learning trajectory that can be used for the purpose of formative assessment.

With regard to the content of formative assessment instruments, we concluded that the instrument needs:
1. Fine-grained information about students’ current performance (e.g., learning strategies, misconceptions);
2. Information about students’ desired performance (e.g., learning objectives, learning trajectory);
3. Directions to follow-up actions (e.g., learning materials, suggestions for grouping).

With regard to the visual presentation of formative assessment instruments, we concluded that:
1. Measurement error presentations affect teachers’ decisions, however, several misconceptions were identified.
2. A graphical visualization might be the most appropriate way to present possible learning pathways. Several design principles for visualization were identified in relation to the content, structure, and usability of the learning trajectory.

Overall, this dissertation shows that it is necessary and fruitful to design and evaluate assessment instruments with the intended audience in order to ensure that they will understand and use the assessment results in an appropriate way.
Original languageEnglish
QualificationDoctor of Philosophy
Awarding Institution
  • University of Twente
Supervisors/Advisors
  • Eggen, Theo T.J.H.M., Supervisor
  • Veldkamp, Bernard P., Supervisor
  • Wools, Saskia, Co-Supervisor
Award date28 Nov 2019
Place of PublicationEnschede
Edition1
Publisher
Print ISBNs978-90-365-4823-6
DOIs
Publication statusPublished - 28 Nov 2019

Fingerprint

act
learning
earning a doctorate
visualization
teacher
student
learning objective
learning strategy
grouping
student teacher
performance
present
evaluation
evidence

Keywords

  • formative assessment
  • Validity
  • score reporting
  • measurement error
  • learning trajectory

Cite this

Hopster-den Otter, Dorien. / Formative Assessment Design : A Balancing Act. 1 ed. Enschede : University of Twente, 2019. 215 p.
@phdthesis{a54f8db8eaef4a47a188014ebc1598b2,
title = "Formative Assessment Design: A Balancing Act",
abstract = "Formative assessment has been considered a promising way to support student learning. It has been defined as both an instrument and a process. The instrument provides information about a student’s learning. During the process, the information is judged and used by teachers, students, or their peers for actions that support that learning. Teachers have difficulty understanding and using the evidence from assessment instruments. Therefore, this dissertation investigates what content and visual presentation of a formative assessment instrument could help teachers.The dissertation consists of five studies:-A theoretical study about the validation of formative assessment.-A needs assessment, which investigated the type of instructional actions as well as the information needs to enable these actions. -A evaluation study investigating the usability of a formative assessment platform-A factorial study investigating the extent to which visualizations of measurement error in score reports influence teachers’ instructional decisions. -A study that explores how to visualize a learning trajectory that can be used for the purpose of formative assessment. With regard to the content of formative assessment instruments, we concluded that the instrument needs:1. Fine-grained information about students’ current performance (e.g., learning strategies, misconceptions); 2. Information about students’ desired performance (e.g., learning objectives, learning trajectory); 3. Directions to follow-up actions (e.g., learning materials, suggestions for grouping). With regard to the visual presentation of formative assessment instruments, we concluded that:1. Measurement error presentations affect teachers’ decisions, however, several misconceptions were identified. 2. A graphical visualization might be the most appropriate way to present possible learning pathways. Several design principles for visualization were identified in relation to the content, structure, and usability of the learning trajectory.Overall, this dissertation shows that it is necessary and fruitful to design and evaluate assessment instruments with the intended audience in order to ensure that they will understand and use the assessment results in an appropriate way.",
keywords = "formative assessment, Validity, score reporting, measurement error, learning trajectory",
author = "{Hopster-den Otter}, Dorien",
year = "2019",
month = "11",
day = "28",
doi = "10.3990/1.9789036548236",
language = "English",
isbn = "978-90-365-4823-6",
publisher = "University of Twente",
address = "Netherlands",
edition = "1",
school = "University of Twente",

}

Formative Assessment Design : A Balancing Act. / Hopster-den Otter, Dorien.

1 ed. Enschede : University of Twente, 2019. 215 p.

Research output: ThesisPhD Thesis - Research UT, graduation UTAcademic

TY - THES

T1 - Formative Assessment Design

T2 - A Balancing Act

AU - Hopster-den Otter, Dorien

PY - 2019/11/28

Y1 - 2019/11/28

N2 - Formative assessment has been considered a promising way to support student learning. It has been defined as both an instrument and a process. The instrument provides information about a student’s learning. During the process, the information is judged and used by teachers, students, or their peers for actions that support that learning. Teachers have difficulty understanding and using the evidence from assessment instruments. Therefore, this dissertation investigates what content and visual presentation of a formative assessment instrument could help teachers.The dissertation consists of five studies:-A theoretical study about the validation of formative assessment.-A needs assessment, which investigated the type of instructional actions as well as the information needs to enable these actions. -A evaluation study investigating the usability of a formative assessment platform-A factorial study investigating the extent to which visualizations of measurement error in score reports influence teachers’ instructional decisions. -A study that explores how to visualize a learning trajectory that can be used for the purpose of formative assessment. With regard to the content of formative assessment instruments, we concluded that the instrument needs:1. Fine-grained information about students’ current performance (e.g., learning strategies, misconceptions); 2. Information about students’ desired performance (e.g., learning objectives, learning trajectory); 3. Directions to follow-up actions (e.g., learning materials, suggestions for grouping). With regard to the visual presentation of formative assessment instruments, we concluded that:1. Measurement error presentations affect teachers’ decisions, however, several misconceptions were identified. 2. A graphical visualization might be the most appropriate way to present possible learning pathways. Several design principles for visualization were identified in relation to the content, structure, and usability of the learning trajectory.Overall, this dissertation shows that it is necessary and fruitful to design and evaluate assessment instruments with the intended audience in order to ensure that they will understand and use the assessment results in an appropriate way.

AB - Formative assessment has been considered a promising way to support student learning. It has been defined as both an instrument and a process. The instrument provides information about a student’s learning. During the process, the information is judged and used by teachers, students, or their peers for actions that support that learning. Teachers have difficulty understanding and using the evidence from assessment instruments. Therefore, this dissertation investigates what content and visual presentation of a formative assessment instrument could help teachers.The dissertation consists of five studies:-A theoretical study about the validation of formative assessment.-A needs assessment, which investigated the type of instructional actions as well as the information needs to enable these actions. -A evaluation study investigating the usability of a formative assessment platform-A factorial study investigating the extent to which visualizations of measurement error in score reports influence teachers’ instructional decisions. -A study that explores how to visualize a learning trajectory that can be used for the purpose of formative assessment. With regard to the content of formative assessment instruments, we concluded that the instrument needs:1. Fine-grained information about students’ current performance (e.g., learning strategies, misconceptions); 2. Information about students’ desired performance (e.g., learning objectives, learning trajectory); 3. Directions to follow-up actions (e.g., learning materials, suggestions for grouping). With regard to the visual presentation of formative assessment instruments, we concluded that:1. Measurement error presentations affect teachers’ decisions, however, several misconceptions were identified. 2. A graphical visualization might be the most appropriate way to present possible learning pathways. Several design principles for visualization were identified in relation to the content, structure, and usability of the learning trajectory.Overall, this dissertation shows that it is necessary and fruitful to design and evaluate assessment instruments with the intended audience in order to ensure that they will understand and use the assessment results in an appropriate way.

KW - formative assessment

KW - Validity

KW - score reporting

KW - measurement error

KW - learning trajectory

U2 - 10.3990/1.9789036548236

DO - 10.3990/1.9789036548236

M3 - PhD Thesis - Research UT, graduation UT

SN - 978-90-365-4823-6

PB - University of Twente

CY - Enschede

ER -