Validity and usability of a professional association’s web-based knowledge translation portal: American Physical Therapy Association’s PTNow.org

Author(s)Deutsch, Judith E.
Author(s)Romney, Wendy
Author(s)Reynolds, Jan
Author(s)Manal, Tara Jo
Ordered AuthorJudith E. Deutsch, Wendy Romney, Jan Reynolds and Tara Jo Manal
UD AuthorManal, Tara Joen_US
Date Accessioned2015-12-07T16:42:40Z
Date Available2015-12-07T16:42:40Z
Copyright DateCopyright ©2015 Deutsch et alen_US
Publication Date2015-10-08
DescriptionPublisher's PDF.en_US
AbstractBackground PTNow.org is an evidence-based, on-line portal created by a professional membership association to promote use of evidence in practice and to help decrease unwarranted variation in practice. The site contains synthesis documents designed to promote efficient clinical reasoning. These documents were written and peer-reviewed by teams of content experts and master clinicians. The purpose of this paper is to report on the content and construct validity as well as usability of the site. Methods Physical therapist participants used clinical summaries (available in 3 formats--as a full summary with hyperlinks, “quick takes” with hyperlinks, and a portable two-page version) on the PTNow.org site to answer knowledge acquisition and clinical reasoning questions related to four patient scenarios. They also responded to questions about ease of use related to website navigation and about format and completeness of information using a 1–5 Likert scale. Responses were coded to reflect how participants used the site and then were summarized descriptively. Preferences for clinical summary format were analyzed using an analysis of variance (ANOVA) and a Dunnett T3 post hoc analysis. Results Seventeen participants completed the study. Clinical relevance and completeness ratings by experienced clinicians, which were used as the measure of content validity, ranged from 3.1 to 4.6 on a 5 point scale. Construct validity based on the information on the PTNow.org site was supported for knowledge acquisition questions 66 % of the time and for clinical reasoning questions 40 % of the time. Usability ratings for the full clinical summary were 4.6 (1.2); for the quick takes, 3.5 (.98); and for the portable clinical summary, 4.0 (.45). Participants preferred the full clinical summary over the other two formats (F = 5.908, P = 0.007). One hundred percent of the participants stated that they would recommend the PTNow site to their colleagues. Conclusion Prelimary evidence supported both content validity and construct validity of knowledge acquisition, and partially supported construct validity of clinical reasoning for the clinical summaries on the PTNow.org site. Usability was supported, with users preferring the full clinical summary over the other two formats. Iterative design is ongoing.en_US
DepartmentUniversity of Delaware. Department of Physical Therapy.en_US
CitationDeutsch et al. BMC Medical Informatics and Decision Making (2015) 15:79 DOI 10.1186/s12911-015-0178-yen_US
DOI10.1186/s12911-015-0178-yen_US
ISSN1472-6947en_US
URLhttp://udspace.udel.edu/handle/19716/17274
Languageen_USen_US
PublisherBioMed Central Ltd.en_US
dc.rightsCC-BY 4.0 The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.en_US
dc.sourceBMC Medical Informatics & Decision Makingen_US
dc.source.urihttp://www.biomedcentral.com/bmcmedinformdecismak/en_US
TitleValidity and usability of a professional association’s web-based knowledge translation portal: American Physical Therapy Association’s PTNow.orgen_US
TypeArticleen_US
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Validity and usability of a professional association's web-based knowledge translation porta_1447450245T5662.pdf
Size:
2.9 MB
Format:
Adobe Portable Document Format
Description:
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
2.22 KB
Format:
Item-specific license agreed upon to submission
Description: