Development and validation of the Internet Skills Scale (ISS)

Alexander Johannes Aloysius Maria van Deursen, Ellen J. Helsper, Rebecca Eynon

Research output: Contribution to journalArticleAcademicpeer-review

45 Citations (Scopus)

Abstract

Although a number of instruments have been used to measure Internet skills in nationally representative surveys, there are several challenges with the measures available: incompleteness and over-simplification, conceptual ambiguity, and the use of self-reports. Here, we aim to overcome these challenges by developing a set of reliable measures for use in research, practice, and policy evaluations based on a strong conceptual framework. To achieve this goal, we carried out a literature review of skills-related studies to develop the initial Internet skills framework and associated instrument. After the development of this instrument, we used a three-fold approach to test the validity and reliability of the latent skill constructs and the corresponding items. The first step consisted of cognitive interviews held in both the UK and the Netherlands. Based on the cognitive interview results, we made several amendments to the proposed skill items to improve clarity. The second step consisted of a pilot survey of digital skills, both in the UK and in the Netherlands. During the final step, we examined the consistency of the five Internet skill scales and their characteristics when measured in a representative sample survey of Dutch Internet users. The result is a theoretical, empirically and cross-nationally consistent instrument consisting of five types of Internet skills: operational, navigation information, social, creative, and mobile.
Original languageEnglish
Pages (from-to)804-823
JournalInformation, communication and society
Volume19
Issue number6
DOIs
Publication statusPublished - 25 Aug 2016
Event16th Annual Conference of the Association-of-Internet-Researchers - Phoenix, United States
Duration: 21 Oct 201524 Oct 2015
Conference number: 16th
http://aoir.org/ir16/

Fingerprint

Internet
Netherlands
research policy
research practice
interview
amendment
Navigation
evaluation

Keywords

  • METIS-311331
  • IR-96965

Cite this

@article{7945dd088e0641b285e9a291ceda2bcb,
title = "Development and validation of the Internet Skills Scale (ISS)",
abstract = "Although a number of instruments have been used to measure Internet skills in nationally representative surveys, there are several challenges with the measures available: incompleteness and over-simplification, conceptual ambiguity, and the use of self-reports. Here, we aim to overcome these challenges by developing a set of reliable measures for use in research, practice, and policy evaluations based on a strong conceptual framework. To achieve this goal, we carried out a literature review of skills-related studies to develop the initial Internet skills framework and associated instrument. After the development of this instrument, we used a three-fold approach to test the validity and reliability of the latent skill constructs and the corresponding items. The first step consisted of cognitive interviews held in both the UK and the Netherlands. Based on the cognitive interview results, we made several amendments to the proposed skill items to improve clarity. The second step consisted of a pilot survey of digital skills, both in the UK and in the Netherlands. During the final step, we examined the consistency of the five Internet skill scales and their characteristics when measured in a representative sample survey of Dutch Internet users. The result is a theoretical, empirically and cross-nationally consistent instrument consisting of five types of Internet skills: operational, navigation information, social, creative, and mobile.",
keywords = "METIS-311331, IR-96965",
author = "{van Deursen}, {Alexander Johannes Aloysius Maria} and Helsper, {Ellen J.} and Rebecca Eynon",
year = "2016",
month = "8",
day = "25",
doi = "10.1080/1369118X.2015.1078834",
language = "English",
volume = "19",
pages = "804--823",
journal = "Information, communication and society",
issn = "1369-118X",
publisher = "Routledge",
number = "6",

}

Development and validation of the Internet Skills Scale (ISS). / van Deursen, Alexander Johannes Aloysius Maria; Helsper, Ellen J.; Eynon, Rebecca.

In: Information, communication and society, Vol. 19, No. 6, 25.08.2016, p. 804-823.

Research output: Contribution to journalArticleAcademicpeer-review

TY - JOUR

T1 - Development and validation of the Internet Skills Scale (ISS)

AU - van Deursen, Alexander Johannes Aloysius Maria

AU - Helsper, Ellen J.

AU - Eynon, Rebecca

PY - 2016/8/25

Y1 - 2016/8/25

N2 - Although a number of instruments have been used to measure Internet skills in nationally representative surveys, there are several challenges with the measures available: incompleteness and over-simplification, conceptual ambiguity, and the use of self-reports. Here, we aim to overcome these challenges by developing a set of reliable measures for use in research, practice, and policy evaluations based on a strong conceptual framework. To achieve this goal, we carried out a literature review of skills-related studies to develop the initial Internet skills framework and associated instrument. After the development of this instrument, we used a three-fold approach to test the validity and reliability of the latent skill constructs and the corresponding items. The first step consisted of cognitive interviews held in both the UK and the Netherlands. Based on the cognitive interview results, we made several amendments to the proposed skill items to improve clarity. The second step consisted of a pilot survey of digital skills, both in the UK and in the Netherlands. During the final step, we examined the consistency of the five Internet skill scales and their characteristics when measured in a representative sample survey of Dutch Internet users. The result is a theoretical, empirically and cross-nationally consistent instrument consisting of five types of Internet skills: operational, navigation information, social, creative, and mobile.

AB - Although a number of instruments have been used to measure Internet skills in nationally representative surveys, there are several challenges with the measures available: incompleteness and over-simplification, conceptual ambiguity, and the use of self-reports. Here, we aim to overcome these challenges by developing a set of reliable measures for use in research, practice, and policy evaluations based on a strong conceptual framework. To achieve this goal, we carried out a literature review of skills-related studies to develop the initial Internet skills framework and associated instrument. After the development of this instrument, we used a three-fold approach to test the validity and reliability of the latent skill constructs and the corresponding items. The first step consisted of cognitive interviews held in both the UK and the Netherlands. Based on the cognitive interview results, we made several amendments to the proposed skill items to improve clarity. The second step consisted of a pilot survey of digital skills, both in the UK and in the Netherlands. During the final step, we examined the consistency of the five Internet skill scales and their characteristics when measured in a representative sample survey of Dutch Internet users. The result is a theoretical, empirically and cross-nationally consistent instrument consisting of five types of Internet skills: operational, navigation information, social, creative, and mobile.

KW - METIS-311331

KW - IR-96965

U2 - 10.1080/1369118X.2015.1078834

DO - 10.1080/1369118X.2015.1078834

M3 - Article

VL - 19

SP - 804

EP - 823

JO - Information, communication and society

JF - Information, communication and society

SN - 1369-118X

IS - 6

ER -