Adding Postal Follow-Up to a Web-Based Survey of Primary Care and Gastroenterology Clinic Physician Chiefs Improved Response Rates but not Response Quality or Representativeness

Melissa R. Partin, Adam A. Powell, Diana J. Burgess, David Haggstrom, Amy A. Gravely, Krysten Halek, Ann Bangerter, Aasma Shaukat, David B. Nelson

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

This study assessed whether postal follow-up to a web-based physician survey improves response rates, response quality, and representativeness. We recruited primary care and gastroenterology chiefs at 125 Veterans Affairs medical facilities to complete a 10-min web-based survey on colorectal cancer screening and diagnostic practices in 2010. We compared response rates, response errors, and representativeness in the primary care and gastroenterology samples before and after adding postal follow-up. Adding postal follow-up increased response rates by 20–25 percentage points; markedly greater increases than predicted from a third e-mail reminder. In the gastroenterology sample, the mean number of response errors made by web responders (0.25) was significantly smaller than the mean number made by postal responders (2.18), and web responders provided significantly longer responses to open-ended questions. There were no significant differences in these outcomes in the primary care sample. Adequate representativeness was achieved before postal follow-up in both samples, as indicated by the lack of significant differences between web responders and the recruitment population on facility characteristics. We conclude adding postal follow-up to this web-based physician leader survey improved response rates but not response quality or representativeness.

Original languageEnglish (US)
Pages (from-to)382-403
Number of pages22
JournalEvaluation and the Health Professions
Volume38
Issue number3
DOIs
StatePublished - Sep 18 2015
Externally publishedYes

Fingerprint

Gastroenterology
Primary Health Care
Physicians
Postal Service
Veterans
Early Detection of Cancer
Colorectal Neoplasms
Population
Surveys and Questionnaires

Keywords

  • colorectal neoplasms
  • data quality
  • organizational structure
  • physicians
  • respondents
  • survey methods
  • surveys

ASJC Scopus subject areas

  • Health Policy

Cite this

Adding Postal Follow-Up to a Web-Based Survey of Primary Care and Gastroenterology Clinic Physician Chiefs Improved Response Rates but not Response Quality or Representativeness. / Partin, Melissa R.; Powell, Adam A.; Burgess, Diana J.; Haggstrom, David; Gravely, Amy A.; Halek, Krysten; Bangerter, Ann; Shaukat, Aasma; Nelson, David B.

In: Evaluation and the Health Professions, Vol. 38, No. 3, 18.09.2015, p. 382-403.

Research output: Contribution to journalArticle

Partin, Melissa R. ; Powell, Adam A. ; Burgess, Diana J. ; Haggstrom, David ; Gravely, Amy A. ; Halek, Krysten ; Bangerter, Ann ; Shaukat, Aasma ; Nelson, David B. / Adding Postal Follow-Up to a Web-Based Survey of Primary Care and Gastroenterology Clinic Physician Chiefs Improved Response Rates but not Response Quality or Representativeness. In: Evaluation and the Health Professions. 2015 ; Vol. 38, No. 3. pp. 382-403.
@article{926e7a8ae5ae439eb4dc4e403bfad130,
title = "Adding Postal Follow-Up to a Web-Based Survey of Primary Care and Gastroenterology Clinic Physician Chiefs Improved Response Rates but not Response Quality or Representativeness",
abstract = "This study assessed whether postal follow-up to a web-based physician survey improves response rates, response quality, and representativeness. We recruited primary care and gastroenterology chiefs at 125 Veterans Affairs medical facilities to complete a 10-min web-based survey on colorectal cancer screening and diagnostic practices in 2010. We compared response rates, response errors, and representativeness in the primary care and gastroenterology samples before and after adding postal follow-up. Adding postal follow-up increased response rates by 20–25 percentage points; markedly greater increases than predicted from a third e-mail reminder. In the gastroenterology sample, the mean number of response errors made by web responders (0.25) was significantly smaller than the mean number made by postal responders (2.18), and web responders provided significantly longer responses to open-ended questions. There were no significant differences in these outcomes in the primary care sample. Adequate representativeness was achieved before postal follow-up in both samples, as indicated by the lack of significant differences between web responders and the recruitment population on facility characteristics. We conclude adding postal follow-up to this web-based physician leader survey improved response rates but not response quality or representativeness.",
keywords = "colorectal neoplasms, data quality, organizational structure, physicians, respondents, survey methods, surveys",
author = "Partin, {Melissa R.} and Powell, {Adam A.} and Burgess, {Diana J.} and David Haggstrom and Gravely, {Amy A.} and Krysten Halek and Ann Bangerter and Aasma Shaukat and Nelson, {David B.}",
year = "2015",
month = "9",
day = "18",
doi = "10.1177/0163278713513586",
language = "English (US)",
volume = "38",
pages = "382--403",
journal = "Evaluation and the Health Professions",
issn = "0163-2787",
publisher = "SAGE Publications Inc.",
number = "3",

}

TY - JOUR

T1 - Adding Postal Follow-Up to a Web-Based Survey of Primary Care and Gastroenterology Clinic Physician Chiefs Improved Response Rates but not Response Quality or Representativeness

AU - Partin, Melissa R.

AU - Powell, Adam A.

AU - Burgess, Diana J.

AU - Haggstrom, David

AU - Gravely, Amy A.

AU - Halek, Krysten

AU - Bangerter, Ann

AU - Shaukat, Aasma

AU - Nelson, David B.

PY - 2015/9/18

Y1 - 2015/9/18

N2 - This study assessed whether postal follow-up to a web-based physician survey improves response rates, response quality, and representativeness. We recruited primary care and gastroenterology chiefs at 125 Veterans Affairs medical facilities to complete a 10-min web-based survey on colorectal cancer screening and diagnostic practices in 2010. We compared response rates, response errors, and representativeness in the primary care and gastroenterology samples before and after adding postal follow-up. Adding postal follow-up increased response rates by 20–25 percentage points; markedly greater increases than predicted from a third e-mail reminder. In the gastroenterology sample, the mean number of response errors made by web responders (0.25) was significantly smaller than the mean number made by postal responders (2.18), and web responders provided significantly longer responses to open-ended questions. There were no significant differences in these outcomes in the primary care sample. Adequate representativeness was achieved before postal follow-up in both samples, as indicated by the lack of significant differences between web responders and the recruitment population on facility characteristics. We conclude adding postal follow-up to this web-based physician leader survey improved response rates but not response quality or representativeness.

AB - This study assessed whether postal follow-up to a web-based physician survey improves response rates, response quality, and representativeness. We recruited primary care and gastroenterology chiefs at 125 Veterans Affairs medical facilities to complete a 10-min web-based survey on colorectal cancer screening and diagnostic practices in 2010. We compared response rates, response errors, and representativeness in the primary care and gastroenterology samples before and after adding postal follow-up. Adding postal follow-up increased response rates by 20–25 percentage points; markedly greater increases than predicted from a third e-mail reminder. In the gastroenterology sample, the mean number of response errors made by web responders (0.25) was significantly smaller than the mean number made by postal responders (2.18), and web responders provided significantly longer responses to open-ended questions. There were no significant differences in these outcomes in the primary care sample. Adequate representativeness was achieved before postal follow-up in both samples, as indicated by the lack of significant differences between web responders and the recruitment population on facility characteristics. We conclude adding postal follow-up to this web-based physician leader survey improved response rates but not response quality or representativeness.

KW - colorectal neoplasms

KW - data quality

KW - organizational structure

KW - physicians

KW - respondents

KW - survey methods

KW - surveys

UR - http://www.scopus.com/inward/record.url?scp=84939249671&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84939249671&partnerID=8YFLogxK

U2 - 10.1177/0163278713513586

DO - 10.1177/0163278713513586

M3 - Article

VL - 38

SP - 382

EP - 403

JO - Evaluation and the Health Professions

JF - Evaluation and the Health Professions

SN - 0163-2787

IS - 3

ER -