HOT-fit evaluation framework

Validation using case studies and qualitative systematic review in health information systems evaluation adoption

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Rigorous evaluation allows us to assess the extent to which Health Information Systems (HIS) achieve their intended outcomes and support the services of healthcare delivery systems. We learn that current evaluation methods focus on different aspects of HIS and they can be improved upon. Based on previous evaluation studies, we developed a new evaluation framework, HOT-fit (Human, Organization and Technology-fit) that focus on the three factors and their fit with each other. It also makes use of earlier models of IS evaluation, particularly the IS Success Model and the IT-Organisation Fit Model. The framework was validated using a case study of a Fundus Imaging System (FIS) of a primary care organization in the UK and a qualitative systematic review of fifty-five case studies. The applicability of the framework is currently being tested in another case study of a Critical Care Information Systems (CCIS) of a tertiary care in Malaysia. The framework has been progressively refined over the evaluation phases in terms of its dimension, measures and sub measures. The research identifies and highlights the following dominant adoption factors: technology (ease of use, system usefulness, system flexibility, time efficiency, information accessibility and relevancy); human (user training, user perception, user roles, user skills, clarity of system purpose, user involvement); organisation (leadership and support, clinical process, user involvement, internal communication, inter organisational system, as well as the fit between them. The case studies and synthesis of the selected evaluation studies of HIS adoption has brought together disparate findings that summarize the research area, which can be used to better understand adoption issues and to learn from earlier adoption cases. The study shows that comprehensive, specific evaluation factors, dimensions and measures in the HOT-fit framework are applicable in HIS evaluation. We argue that the use of such framework is useful for the evaluation of both HIS and IS, regardless of their context.

Original languageEnglish
Title of host publication4th International Conference on Information Warfare and Security, ICIW 2009
PublisherCurran Associates Inc.
Pages359-365
Number of pages7
ISBN (Print)9781622766734
Publication statusPublished - 2009
Event4th International Conference on Information Warfare and Security, ICIW 2009 - Cape Town
Duration: 26 Mar 200927 Mar 2009

Other

Other4th International Conference on Information Warfare and Security, ICIW 2009
CityCape Town
Period26/3/0927/3/09

Fingerprint

Information systems
Health
Imaging systems
Communication

Keywords

  • Evaluation
  • Framework
  • Health information systems
  • Human factors
  • Organizational factors
  • Qualitative

ASJC Scopus subject areas

  • Information Systems
  • Safety, Risk, Reliability and Quality

Cite this

Mohd. Yusof, M. (2009). HOT-fit evaluation framework: Validation using case studies and qualitative systematic review in health information systems evaluation adoption. In 4th International Conference on Information Warfare and Security, ICIW 2009 (pp. 359-365). Curran Associates Inc..

HOT-fit evaluation framework : Validation using case studies and qualitative systematic review in health information systems evaluation adoption. / Mohd. Yusof, Maryati.

4th International Conference on Information Warfare and Security, ICIW 2009. Curran Associates Inc., 2009. p. 359-365.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Mohd. Yusof, M 2009, HOT-fit evaluation framework: Validation using case studies and qualitative systematic review in health information systems evaluation adoption. in 4th International Conference on Information Warfare and Security, ICIW 2009. Curran Associates Inc., pp. 359-365, 4th International Conference on Information Warfare and Security, ICIW 2009, Cape Town, 26/3/09.
Mohd. Yusof M. HOT-fit evaluation framework: Validation using case studies and qualitative systematic review in health information systems evaluation adoption. In 4th International Conference on Information Warfare and Security, ICIW 2009. Curran Associates Inc. 2009. p. 359-365
Mohd. Yusof, Maryati. / HOT-fit evaluation framework : Validation using case studies and qualitative systematic review in health information systems evaluation adoption. 4th International Conference on Information Warfare and Security, ICIW 2009. Curran Associates Inc., 2009. pp. 359-365
@inproceedings{2d2b095fb1544f9baa66f9f1defbecc5,
title = "HOT-fit evaluation framework: Validation using case studies and qualitative systematic review in health information systems evaluation adoption",
abstract = "Rigorous evaluation allows us to assess the extent to which Health Information Systems (HIS) achieve their intended outcomes and support the services of healthcare delivery systems. We learn that current evaluation methods focus on different aspects of HIS and they can be improved upon. Based on previous evaluation studies, we developed a new evaluation framework, HOT-fit (Human, Organization and Technology-fit) that focus on the three factors and their fit with each other. It also makes use of earlier models of IS evaluation, particularly the IS Success Model and the IT-Organisation Fit Model. The framework was validated using a case study of a Fundus Imaging System (FIS) of a primary care organization in the UK and a qualitative systematic review of fifty-five case studies. The applicability of the framework is currently being tested in another case study of a Critical Care Information Systems (CCIS) of a tertiary care in Malaysia. The framework has been progressively refined over the evaluation phases in terms of its dimension, measures and sub measures. The research identifies and highlights the following dominant adoption factors: technology (ease of use, system usefulness, system flexibility, time efficiency, information accessibility and relevancy); human (user training, user perception, user roles, user skills, clarity of system purpose, user involvement); organisation (leadership and support, clinical process, user involvement, internal communication, inter organisational system, as well as the fit between them. The case studies and synthesis of the selected evaluation studies of HIS adoption has brought together disparate findings that summarize the research area, which can be used to better understand adoption issues and to learn from earlier adoption cases. The study shows that comprehensive, specific evaluation factors, dimensions and measures in the HOT-fit framework are applicable in HIS evaluation. We argue that the use of such framework is useful for the evaluation of both HIS and IS, regardless of their context.",
keywords = "Evaluation, Framework, Health information systems, Human factors, Organizational factors, Qualitative",
author = "{Mohd. Yusof}, Maryati",
year = "2009",
language = "English",
isbn = "9781622766734",
pages = "359--365",
booktitle = "4th International Conference on Information Warfare and Security, ICIW 2009",
publisher = "Curran Associates Inc.",

}

TY - GEN

T1 - HOT-fit evaluation framework

T2 - Validation using case studies and qualitative systematic review in health information systems evaluation adoption

AU - Mohd. Yusof, Maryati

PY - 2009

Y1 - 2009

N2 - Rigorous evaluation allows us to assess the extent to which Health Information Systems (HIS) achieve their intended outcomes and support the services of healthcare delivery systems. We learn that current evaluation methods focus on different aspects of HIS and they can be improved upon. Based on previous evaluation studies, we developed a new evaluation framework, HOT-fit (Human, Organization and Technology-fit) that focus on the three factors and their fit with each other. It also makes use of earlier models of IS evaluation, particularly the IS Success Model and the IT-Organisation Fit Model. The framework was validated using a case study of a Fundus Imaging System (FIS) of a primary care organization in the UK and a qualitative systematic review of fifty-five case studies. The applicability of the framework is currently being tested in another case study of a Critical Care Information Systems (CCIS) of a tertiary care in Malaysia. The framework has been progressively refined over the evaluation phases in terms of its dimension, measures and sub measures. The research identifies and highlights the following dominant adoption factors: technology (ease of use, system usefulness, system flexibility, time efficiency, information accessibility and relevancy); human (user training, user perception, user roles, user skills, clarity of system purpose, user involvement); organisation (leadership and support, clinical process, user involvement, internal communication, inter organisational system, as well as the fit between them. The case studies and synthesis of the selected evaluation studies of HIS adoption has brought together disparate findings that summarize the research area, which can be used to better understand adoption issues and to learn from earlier adoption cases. The study shows that comprehensive, specific evaluation factors, dimensions and measures in the HOT-fit framework are applicable in HIS evaluation. We argue that the use of such framework is useful for the evaluation of both HIS and IS, regardless of their context.

AB - Rigorous evaluation allows us to assess the extent to which Health Information Systems (HIS) achieve their intended outcomes and support the services of healthcare delivery systems. We learn that current evaluation methods focus on different aspects of HIS and they can be improved upon. Based on previous evaluation studies, we developed a new evaluation framework, HOT-fit (Human, Organization and Technology-fit) that focus on the three factors and their fit with each other. It also makes use of earlier models of IS evaluation, particularly the IS Success Model and the IT-Organisation Fit Model. The framework was validated using a case study of a Fundus Imaging System (FIS) of a primary care organization in the UK and a qualitative systematic review of fifty-five case studies. The applicability of the framework is currently being tested in another case study of a Critical Care Information Systems (CCIS) of a tertiary care in Malaysia. The framework has been progressively refined over the evaluation phases in terms of its dimension, measures and sub measures. The research identifies and highlights the following dominant adoption factors: technology (ease of use, system usefulness, system flexibility, time efficiency, information accessibility and relevancy); human (user training, user perception, user roles, user skills, clarity of system purpose, user involvement); organisation (leadership and support, clinical process, user involvement, internal communication, inter organisational system, as well as the fit between them. The case studies and synthesis of the selected evaluation studies of HIS adoption has brought together disparate findings that summarize the research area, which can be used to better understand adoption issues and to learn from earlier adoption cases. The study shows that comprehensive, specific evaluation factors, dimensions and measures in the HOT-fit framework are applicable in HIS evaluation. We argue that the use of such framework is useful for the evaluation of both HIS and IS, regardless of their context.

KW - Evaluation

KW - Framework

KW - Health information systems

KW - Human factors

KW - Organizational factors

KW - Qualitative

UR - http://www.scopus.com/inward/record.url?scp=84893082814&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84893082814&partnerID=8YFLogxK

M3 - Conference contribution

SN - 9781622766734

SP - 359

EP - 365

BT - 4th International Conference on Information Warfare and Security, ICIW 2009

PB - Curran Associates Inc.

ER -