Can text messages reach the parts other process measures cannot reach

an evaluation of a behavior change intervention delivered by mobile phone?

Linda Irvine (Lead / Corresponding author), Donald W. Falconer, Claire Jones, Ian W. Ricketts, Brian Williams, Iain K. Crombie (Lead / Corresponding author)

    Research output: Contribution to journalArticle

    30 Citations (Scopus)

    Abstract

    BackgroundProcess evaluation is essential in developing, piloting and evaluating complex interventions. This often involves observation of intervention delivery and interviews with study participants. Mobile telephone interventions involve no face to face contact, making conventional process evaluation difficult. This study assesses the utility of novel techniques for process evaluation involving no face to face contact.
    MethodsText messages were delivered to 34 disadvantaged men as part of a feasibility study of a brief alcohol intervention. Process evaluation focused on delivery of the text messages and responses received from study participants. The computerized delivery system captured data on receipt of the messages. The text messages, delivered over 28 days, included nine which asked questions. Responses to these questions served as one technique for process evaluation by ascertaining the nature of engagement with the study and with steps on the causal chain to behavior change.
    ResultsA total of 646 SMS text messages were sent to participants. Of these, 613 messages (95%) were recorded as delivered to participants’ telephones. 88% of participants responded to messages that asked questions. There was little attenuation in responses to the questions across the intervention period. Content analysis of the responses revealed that participants engaged with text messages, thought deeply about their content and provided carefully considered personal responses to the questions.
    ConclusionsSocially disadvantaged men, a hard to reach population, engaged in a meaningful way over a sustained period with an interactive intervention delivered by text message. The novel process measures used in the study are unobtrusive, low cost and collect real-time data on all participants. They assessed the fidelity of delivery of the intervention and monitored retention in the study. They measured levels of engagement and identified participants’ reactions to components of the intervention. These methods provide a valuable addition to conventional process evaluation techniques.
    Original languageEnglish
    Pages (from-to)e52621
    JournalPLoS ONE
    Volume7
    Issue number12
    DOIs
    Publication statusPublished - 26 Dec 2012

    Fingerprint

    Text Messaging
    Telephone sets
    Cell Phones
    Process Assessment (Health Care)
    behavior change
    Mobile phones
    Telephone
    Alcohols
    Costs
    Vulnerable Populations
    methodology
    interviews
    alcohols
    Feasibility Studies
    Information Systems
    Observation
    Interviews
    Costs and Cost Analysis
    Population

    Cite this

    @article{f8c993b7b0884c2ab6acda7314804266,
    title = "Can text messages reach the parts other process measures cannot reach: an evaluation of a behavior change intervention delivered by mobile phone?",
    abstract = "BackgroundProcess evaluation is essential in developing, piloting and evaluating complex interventions. This often involves observation of intervention delivery and interviews with study participants. Mobile telephone interventions involve no face to face contact, making conventional process evaluation difficult. This study assesses the utility of novel techniques for process evaluation involving no face to face contact.MethodsText messages were delivered to 34 disadvantaged men as part of a feasibility study of a brief alcohol intervention. Process evaluation focused on delivery of the text messages and responses received from study participants. The computerized delivery system captured data on receipt of the messages. The text messages, delivered over 28 days, included nine which asked questions. Responses to these questions served as one technique for process evaluation by ascertaining the nature of engagement with the study and with steps on the causal chain to behavior change.ResultsA total of 646 SMS text messages were sent to participants. Of these, 613 messages (95{\%}) were recorded as delivered to participants’ telephones. 88{\%} of participants responded to messages that asked questions. There was little attenuation in responses to the questions across the intervention period. Content analysis of the responses revealed that participants engaged with text messages, thought deeply about their content and provided carefully considered personal responses to the questions.ConclusionsSocially disadvantaged men, a hard to reach population, engaged in a meaningful way over a sustained period with an interactive intervention delivered by text message. The novel process measures used in the study are unobtrusive, low cost and collect real-time data on all participants. They assessed the fidelity of delivery of the intervention and monitored retention in the study. They measured levels of engagement and identified participants’ reactions to components of the intervention. These methods provide a valuable addition to conventional process evaluation techniques.",
    author = "Linda Irvine and Falconer, {Donald W.} and Claire Jones and Ricketts, {Ian W.} and Brian Williams and Crombie, {Iain K.}",
    year = "2012",
    month = "12",
    day = "26",
    doi = "10.1371/journal.pone.0052621",
    language = "English",
    volume = "7",
    pages = "e52621",
    journal = "PLoS ONE",
    issn = "1932-6203",
    publisher = "Public Library of Science",
    number = "12",

    }

    Can text messages reach the parts other process measures cannot reach : an evaluation of a behavior change intervention delivered by mobile phone? / Irvine, Linda (Lead / Corresponding author); Falconer, Donald W.; Jones, Claire; Ricketts, Ian W.; Williams, Brian; Crombie, Iain K. (Lead / Corresponding author).

    In: PLoS ONE, Vol. 7, No. 12, 26.12.2012, p. e52621.

    Research output: Contribution to journalArticle

    TY - JOUR

    T1 - Can text messages reach the parts other process measures cannot reach

    T2 - an evaluation of a behavior change intervention delivered by mobile phone?

    AU - Irvine, Linda

    AU - Falconer, Donald W.

    AU - Jones, Claire

    AU - Ricketts, Ian W.

    AU - Williams, Brian

    AU - Crombie, Iain K.

    PY - 2012/12/26

    Y1 - 2012/12/26

    N2 - BackgroundProcess evaluation is essential in developing, piloting and evaluating complex interventions. This often involves observation of intervention delivery and interviews with study participants. Mobile telephone interventions involve no face to face contact, making conventional process evaluation difficult. This study assesses the utility of novel techniques for process evaluation involving no face to face contact.MethodsText messages were delivered to 34 disadvantaged men as part of a feasibility study of a brief alcohol intervention. Process evaluation focused on delivery of the text messages and responses received from study participants. The computerized delivery system captured data on receipt of the messages. The text messages, delivered over 28 days, included nine which asked questions. Responses to these questions served as one technique for process evaluation by ascertaining the nature of engagement with the study and with steps on the causal chain to behavior change.ResultsA total of 646 SMS text messages were sent to participants. Of these, 613 messages (95%) were recorded as delivered to participants’ telephones. 88% of participants responded to messages that asked questions. There was little attenuation in responses to the questions across the intervention period. Content analysis of the responses revealed that participants engaged with text messages, thought deeply about their content and provided carefully considered personal responses to the questions.ConclusionsSocially disadvantaged men, a hard to reach population, engaged in a meaningful way over a sustained period with an interactive intervention delivered by text message. The novel process measures used in the study are unobtrusive, low cost and collect real-time data on all participants. They assessed the fidelity of delivery of the intervention and monitored retention in the study. They measured levels of engagement and identified participants’ reactions to components of the intervention. These methods provide a valuable addition to conventional process evaluation techniques.

    AB - BackgroundProcess evaluation is essential in developing, piloting and evaluating complex interventions. This often involves observation of intervention delivery and interviews with study participants. Mobile telephone interventions involve no face to face contact, making conventional process evaluation difficult. This study assesses the utility of novel techniques for process evaluation involving no face to face contact.MethodsText messages were delivered to 34 disadvantaged men as part of a feasibility study of a brief alcohol intervention. Process evaluation focused on delivery of the text messages and responses received from study participants. The computerized delivery system captured data on receipt of the messages. The text messages, delivered over 28 days, included nine which asked questions. Responses to these questions served as one technique for process evaluation by ascertaining the nature of engagement with the study and with steps on the causal chain to behavior change.ResultsA total of 646 SMS text messages were sent to participants. Of these, 613 messages (95%) were recorded as delivered to participants’ telephones. 88% of participants responded to messages that asked questions. There was little attenuation in responses to the questions across the intervention period. Content analysis of the responses revealed that participants engaged with text messages, thought deeply about their content and provided carefully considered personal responses to the questions.ConclusionsSocially disadvantaged men, a hard to reach population, engaged in a meaningful way over a sustained period with an interactive intervention delivered by text message. The novel process measures used in the study are unobtrusive, low cost and collect real-time data on all participants. They assessed the fidelity of delivery of the intervention and monitored retention in the study. They measured levels of engagement and identified participants’ reactions to components of the intervention. These methods provide a valuable addition to conventional process evaluation techniques.

    UR - http://www.scopus.com/inward/record.url?scp=84871565501&partnerID=8YFLogxK

    U2 - 10.1371/journal.pone.0052621

    DO - 10.1371/journal.pone.0052621

    M3 - Article

    VL - 7

    SP - e52621

    JO - PLoS ONE

    JF - PLoS ONE

    SN - 1932-6203

    IS - 12

    ER -