Usability Testing of an HPV Information Website for Parents and Adolescents

Randall Starling 1 *, Jessica A. Nodulman 2, Alberta S. Kong 1, Cosette M. Wheeler 1, David B. Buller 3, W. Gill Woodall 1
More Detail
1 University of New Mexico, USA
2 Augustana College, USA
3 Klein Buendel Inc., USA
* Corresponding Author
Online Journal of Communication and Media Technologies, Volume 5, Issue 4, pp. 184-203.
OPEN ACCESS   1129 Views   505 Downloads   Published online: 15 Oct 2015
Download Full Text (PDF)


Parents make the decisions regarding their children’s health care. Unfortunately, many parents are misinformed about HPV and HPV vaccines. In order to help parents make an informed decision regarding HPV vaccination for their daughter, the GoHealthyGirls website was created for parents and their adolescent daughters.Usability testing was conducted with members of the target population to refine the website prior to conducting an efficacy trial. Methods:Parents with girls (n=9) between the ages of 11-13 and 11-13 year old adolescents (n=10) were recruited for usability testing. The testing consisted of completing twelve scenarios where participants were asked to find specific information on the GoHealthyGirls site. This was followed by a self-administered system usability scale—to determine ease of use and functionality of the website—and a user satisfaction survey. Results: Both adult and adolescent participants were able to easily find the requested information and reported an increased positive opinion of HPV vaccines after visiting the website. Both groups of participants reported favorable evaluations of using the website. Conclusion: The GoHealthyGirls website has the potential to help parents of adolescent daughters make an informed decision about HPV vaccination. A large scale efficacy trial will determine its usefulness.


Starling, R., Nodulman, J. A., Kong, A. S., Wheeler, C. M., Buller, D. B., & Woodall, W. G. (2015). Usability Testing of an HPV Information Website for Parents and Adolescents. Online Journal of Communication and Media Technologies, 5(4), 184-203.


  • Atkinson, N. L., Saperstein, S. L., Desmond, S. M., Gold, R. S., Billing, A. S., & Tian, J. (2009). Rural eHealth nutrition education for limited-income families: An interative and user-centered design approach. Journal of Medical Internet Research, 11(2), e21.
  • Bangor, A., Kortumb, P.T., & Miller, J.T. (2008). An empirical evaluation of the System Usability Scale.International Journal of Human-Computer Interaction, 24(6), 574-594.
  • Bangor, A., Kortum, P., & Miller, J. (2009). Determining what individual SUS scores mean: adding an adjective rating scale. Journal of Usability Studies, 4(3), 114- 123.
  • Bangor, A., Joseph, K., Sweeney-Dillon, M., Stettler, G., & Pratt, J. (2013). Using the SUS to help demonstrate usability's value to business goals.Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 57(1), 202-205.
  • Brooke, J. (1996). SUS: a "quick and dirty" usability scale. In P. W. Jordan, B. Thomas, B. A. Weerdmeester,& A. L. McClelland (Eds.). Usability Evaluation in Industry. London: Taylor and Francis.
  • Buller, D.B., Berwisk, M., Shane, J., Kane, I., Lantz, K., & Buller, M.K. (2013).Usercentered development of a smart phone mobile application delivering personalized real-time advice on sun protection. Translational Behavioral Medicine, 3(3), 326-334.
  • Carusi, A. &Alvao, C.M. (2012). Usability testing with children: An application of Pedactice and Ticese methods.Work, 41, 822-826.
  • Centers for Disease Control and Prevention (2010).FDA Licensure of Bivalent Human Papillomavirus Vaccine (HPV2, Cervarix) for Use in Females and Updated HPV Vaccination Recommendations from the Advisory Committee on Immunization Practices (ACIP). (2010, May 28). Retrieved June 20, 2014, from
  • Centers for Disease Control and Prevention (2013).Human Papillomavirus: HPV vaccines. (2013, February 5). Retrieved August 2, 2014, from
  • Centers for Disease Control and Prevention (2014a).HPV vaccine – Questions & Answers.(2014, August 6). Retrieved August 21, 2014, from
  • Centers for Disease Control and Prevention (2014b).National and state vaccination coverage among adolescents aged 13-17 Years – United States, 2013. (2014, July 25). Retrieved August25, 2014, from
  • Centers for Disease Control and Prevention (2014c).Barriers to human papillomavirus vaccination among adolescents in the United States. Retrieved August 25, 2014 from
  • Centers for Disease Control and Prevention.(2014d). Genital HPV infection - fact sheet. Retrieved August 25, 2014, from
  • Chaturvedi, A.K., Engels, E.A., Pfeiffer, R.M., Hernandez, B.Y., Xiao, W., Kim, E., et al. (2011). Human papillomavirus andrising oropharyngeal cancer incidence in the United States. Journal of ClinicalOncology,29(32), 4294–4301.
  • Choi, J. & Bakken, S. (2006). Heuristic evaluation of a web-based educational resource for low literacy NICU parents. Studies in Health Technology and Informatics, 122, 194-199.
  • Darden, P. M., Thompson, D. M., Roberts, J. R., Hale, J. J., Pope, C., Naifeh, M., & Jacobson, R. M.. (2013). Reasons for not vaccinating adolescents: National Immunization Survey of Teens, 2008-2010. Pediatrics,131(4), 645-651.
  • de Matos, P., Cham, J.A., Cao, H., Alcantara, R., Rowland, F., Lopez, R., & Steinbeck, C. (2013). The Enzyme Portal: a casestudy in applying user-centred design methods in bioinformatics. BMCBioinformatics, 14, 103. doi:10.1186/1471-2105- 14-103
  • Gerend, M. A., Weibley, E.,& Bland, H. (2009). Parental response to human papillomavirus vaccine availability: Uptake and intentions. Journal of Adolescent Health,45(5), 528-531.
  • Gillison, M.L., Broutian, T., Pickard, R.K., Tong, Z., Xiao, W., Kahle, L., et al. (2012). Prevalence of oral HPVinfection in the United States, 2009–2010. Journal of the American MedicalAssociation, 307(7), 693–703.
  • Grabiel, M., Reutzel, T. J., Wang, S., Rubin, R., Leung, V., Ordonez, A., et al. (2013). HPV and HPV vaccines: The knowledge levels, opinions, and behavior of parents.Journal of Community Health,38(6), 1015-1021.
  • Hariri, S., Unger, E.R., Sternberg, M., Dunne, E.F., Swan, D., Patel, S., & Markowitz, L.E. (2011). Prevalence of genital humanpapillomavirus among females in the United States, the National Health andNutrition Examination Survey, 2003– 2006.Journal of Infectious Diseases,204(4), 566–573.
  • Hensley, S. (2012, February 27). National Public Radio. Pediatricians recommend HPV vaccination for boys. Retrieved August 25, 2014, from
  • Hinchliffe, A.& Mummery, W.K. (2008). Applying usability testing techniques to improve a health promotion website. Health Promotion Journal of Australia : OfficialJournal of Australian Association of Health Promotion Professionals, 19(1), 29-35.
  • Jacobson, R. M., Roberts, J. R., &Darden, P.M.(2013). Parents' perceptions of the HPV vaccine: A key target for improving immunization rates. Expert Review of Clinical Immunology,9(9):791-793.
  • Jayaprakash, V., Reid, M., Hatton, E., Merzianu, M., Riqual, N., Marshall, J., et al. (2011). Human papillomavirus types 16 and18 in epithelial dysplasia of oral cavity and oropharynx: A meta-analysis, 1985–2010. Oral Oncology, 47(11), 1048–1054.
  • Johnson, C.M. & Shaw, R.J. (2012). A usability problem: Conveying health risks to consumers on the Internet. AMIA Symposium Proceedings, 2012, 427-435.
  • Korn, D., Murray, M., Morrison, M., Reynolds, J., & Skinner, H.A. (2006). Engaging youth about gambling using the Internet: The website. Canadian Journal of Public Health, 97(6), 448-453.
  • Koutsky, L.A., Ault, K.A., Wheeler, C.M., Brown, D.R., Barr, E., Alvarez, F.B., et al. (2002). A controlled trial of a humanpapillomavirus type 16 vaccine.New England Journal of Medicine,347(21),1645–1651.
  • Kushniruk, A., Kaipio, J., Nieminen, M., Hyppönen, H., Lääveri, T., Nohr, C.. et al. (2014). Humanfactors in the large: Experiences from Denmark, Finland and Canada in movingtowards regional and national evaluations of health information systemusability. Contribution of the IMIA Human Factors Working Group. Yearbook ofMedical Informatics, 9(1), 67-81.
  • Lai, J. Y., Tinker, A. V., & Cheung, W.Y. (2013). Factors influencing the willingness of US women to vaccinate their daughters against the human papillomavirus to prevent cervical cancer.Medical Oncology,30(2), 582.
  • Luedtke, S. (2008). Human papillomavirus vaccine: Are the concerns unfounded? American Journal of Health-System Pharmacy,65(22), 2150-2151.
  • Macina, R.P. (2007). Health care decisions in minors: Ethical dilemmas. The Journal of Lancaster General Hospital, 2(1), 25-26.
  • Mandic, A. (2012). Primary prevention of cervical cancer: Prophylactic human papillomavirus vaccines. Journal of the BalkanUnion of Oncology, 17(3), 422-427.
  • Neuhauser, L. & Paul, K. Readablity, Comprehension, and Usability (2011).In B. Fischhoff, N.T. Brewer, & J.S. Downs (Eds.) Communicating Risks and Benefits: An Evidence-based User's Guide.Silver Spring, MD: Food and Drug Administration.
  • Nodulman, J.A., Starling, R., Kong, A. S.,Buller, D. B., Wheeler, C. M., Woodall, W. G. (2014).Investigating stakeholder attitudes and opinions on school-based HPV vaccination programs. Manuscript submitted for publication to Journal of School Health.
  • Pak, R., Price, M. M., Thatcher, J. (2009). Age-sensitive design of online health information: Comparative usability study. Journal of Medical Internet Research, 11, e45.
  • Rambout, L., Tashkandi, M., Hopkins, L., &Tricco, A.D. (2014). Self-reported barriers and facilitators to preventive human papillomavirus vaccination among adolescent girls and young women: A systematic review. Preventive Medicine, 58, 22-32.
  • Schmeink, C.E., Massuger, L.F., Lenselink, C.H., Quint, W.G., Witte, B.L., Melchers, W.J., &Bekkers, R.L.(2013). Prospectivefollow-up of 2,065 young unscreened women to study human papillomavirusincidence and clearance. International Journal of Cancer, 133(1), 172-181.
  • Starling, R., Nodulman, J.A., Kong, A.S., Wheeler, C.M., Buller, D.B., & Woodall, W.G. (2014a). Beta-test results for an HPV information website: –Increasing HPV vaccine uptake in the United States. Journal of Consumer Health on the Internet, 18(3), 226-237.
  • Starling, R., Helme, D., Nodulman, J.A., Bryan, A., Buller, D.B., Donohew, R.L., & Woodall, W.G. (2014b).Testing a risky sex behavior intervention pilot website for adolescents. Manuscript accepted for publication to California Journal of Health Promotion.
  • Trim, K., N. Nagji, L. Elit, & K. Roy. (2012). Parental knowledge, attitudes, and behaviours towards human papillomavirus vaccination for their children: A systematic review from 2001 to 2011.Obstetrics & Gynecology International, 2012, 921236. doi: 10.1155/2012/921236.
  • U.S. Department of Health and Human Services. Office of Disease Prevention and Health Promotion.Healthy People 2020.(2014a, August 14). Retrieved August 25, 2014, from
  • U.S. Department of Health and Human Services.System usability scale. (2014b, August 25). Retrieved August 25, 2014 from
  • U.S. Food and Drug Administration.HPV (human papillomavirus).(2014, April 24). Retrieved August 1, 2014, from
  • Vadaparampil, S.T., Malo, T.L., Kahn, J.A., Salmon, D.A., Lee, J.H., Quinn, G.P., et al. (2014). Physicians’ human papillomavirus vaccine recommendations, 2009 and 2011. American Journal of Preventive Medicine, 46(1), 80–84.
  • Waller, J., Marlow, L.A.V., & Wardle, J. (2006). Mothers' attitudes towards preventing cervicalcancer through human papillomavirus vaccination: A qualitative study. Cancer Epidemiology, Biomarkers & Prevention, 15(7).1257-1261.
  • Watson, M., Saraiya, M., Ahmed, F., Cardinez, C.J., Reichman, M.E., Weir, H.K., et al. (2008). Using population-based cancerregistry data to assess the burden of human papillomavirus-associated cancers inthe United States: Overview of methods. Cancer, 113(S10), 2841–2854.
  • Zawistowski, C.A. &Frader, J.E. (2003). Ethical problems in pediatric critical care: Consent.Critical Care Medicine, 31(S5), S407-S410.
  • Zimmerman, D. E., Akerelrea, C. A., Buller, D. B., Hau, B., & LeBlanc, M. (2003). Integrating usability testing into the development of a 5 a day nutrition website for at-risk populations in the American Southwest. Journal of Health Psychology, 8, 119-134