Published on 26.04.18 in Vol 7, No 4 (2018): April
Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/9839, first published Jan 14, 2018.
Safer Prescribing and Care for the Elderly (SPACE): Protocol of a Cluster Randomized Controlled Trial in Primary Care
Background: High-risk prescribing, adverse drug events, and avoidable adverse drug event hospitalizations are common. The single greatest risk factor for high-risk prescribing and adverse drug events is the number of medications a person is taking. More people are living longer and taking more medications for multiple long-term conditions. Most on-going prescribing occurs in primary care. The most effective, cost-effective, and practical approach to safer prescribing in primary care is not yet known.
Objective: To test the effect of the Safer Prescribing And Care for the Elderly (SPACE) intervention on high-risk prescribing of nonsteroidal anti-inflammatory and antiplatelet medicines, and related adverse drug event hospitalizations.
Methods: This is a protocol of a cluster randomized controlled trial. The clusters will be primary care practices. Data collection and analysis will be at the level of patient.
Results: Recruitment started in 2018. Six-month data collection will be in 2018.
Conclusions: This study addresses an important translational gap, testing an intervention designed to prompt medicines review and support safer prescribing in routine primary care practice.
Trial Registration: Australian New Zealand Clinical Trials Registry: ACTRN12618000034235 http://www.ANZCTR.org.au/ACTRN12618000034235.aspx (Archived with Webcite at http://www.webcitation.org/6yj9RImDf)
JMIR Res Protoc 2018;7(4):e109
Crowdfunding campaign to support this specific research
We help JMIR researchers to raise funds to pursue their research and development aimed at tackling important health and technology challenges. If you would like to show your support for this author, please donate using the button below. The funds raised will directly benefit the corresponding author of this article (minus 8% admin fees). Your donations will help this author to continue publishing open access papers in JMIR journals. Donations of over $100 may also be acknowledged in future publications.
Suggested contribution levels: $20/$50/$100
Avoidable Adverse Drug Events
Adverse drug events (ADEs) and avoidable ADE hospital admissions are common, costing health systems billions of dollars every year [- ]. Internationally, approximately 7% of hospital admissions result from drug-related problems, of which 59% are considered avoidable through safer prescribing [ , , ]. Most drug-related admissions are caused by commonly prescribed drugs, notably nonsteroidal anti-inflammatory drugs (NSAIDs), antiplatelet medications, and anticoagulants, which together account for one-third of ADE admissions [ , , ].
High-risk prescribing is prescribing that places patients at increased risk of ADEs. The single greatest predictor of ADEs and high-risk prescribing is the number of medications a person is taking . With demographic ageing, there are increasing numbers of older people prescribed multiple medications for multiple co-existing medical conditions [ ]. In New Zealand, approximately 10% of people aged 65 years and older are taking ten or more regular medications, and high-risk prescribing is common, often involving NSAIDs [ - ]. The individual circumstances of a patient may justify high-risk prescribing, but to minimize harm it is necessary that medications are regularly reviewed and stopped or started as appropriate [ ].
Most on-going medications are prescribed in primary care. Despite strong evidence to guide safe prescribing, a gap remains between existing evidence and current prescribing practice. Translating research evidence into practice is difficult. There are many barriers to regular medication review in everyday practice . The large variation in prescribing between practices and regions in New Zealand suggests room for improvement [ , , ].
In New Zealand primary care, most quality improvement processes are delivered through Primary Health Organisations (PHOs), professional groupings of practices for administrative and quality improvement purposes . The most effective, cost-effective, and practical approach to safer prescribing in everyday practice is not yet known [ , ]. There is evidence to suggest education programmes can improve prescribing but education alone is not enough to induce lasting change [ , ]. Complex interventions as part of ongoing quality improvement programs show the most promise, in particular interventions combining audit and feedback, education, incentive for participation, and patient engagement [ , - ]. The Australian Veterans’ Medicines Advice and Therapeutics Education Service (MATES) quality improvement program in primary care has shown promising results in the Australian Veterans population, especially when delivering a focused message targeting single medications and less so when delivering a combination of messages targeting general topics such as interactions and potentially inappropriate medications in older people with polypharmacy [ ]. The MATES programme is based on sound theoretical underpinnings and delivers 4 interventions per year. The MATES intervention uses practice prescribing audits, patient-specific feedback, education to doctors, and a practice mail-out to selected at-risk patients to encourage their engagement.
The Safer Prescribing and Care for the Elderly (SPACE) Intervention
Adapted from the Australian Veterans’ MATES programme, we developed the Safer Prescribing and Care for the Elderly (SPACE) intervention to prompt medication reviews and support safer prescribing in the New Zealand primary care context. We recently piloted the SPACE intervention in two New Zealand primary care practices in preparation for this proposed randomized trial, focusing on the topic of NSAIDs and antiplatelet prescribing. This topic was chosen because these drugs are commonly prescribed and are associated with serious ADEs including bleeding and renal impairment. The SPACE intervention was found to be feasible to implement using existing primary care structures and both acceptable and useful to patients, doctors, and the PHO clinical advisory pharmacists . In the pilot study, we developed practice audit queries to identify patients with high-risk prescribing of NSAIDs and/or antiplatelet medications; integrated the SPACE intervention into practice management software; developed processes to collect, encrypt, and link study data; and derived information for calculating sample sizes for the randomized trial.
We will assess whether the SPACE intervention can reduce the rate of high-risk prescribing of NSAIDs and/or antiplatelet medications and related ADE hospitalizations over 12 months using existing PHO infrastructure and systems in New Zealand primary care.
We will conduct a cluster randomized control trial. The clusters will be primary care practices. Data collection and analysis will be at the level of patient.
The study will be conducted in primary care practices in Auckland and Northland, New Zealand.
Primary care practices will be eligible to participate if:
- The practice is based in the Auckland or Northland region of New Zealand and has not recently participated in a similar NSAID audit exercise or taken part in the pilot for the SPACE trial
- The practice uses electronic practice management software compatible with our data collection systems
- The practice has fewer than 15,000 enrolled patients
- All physicians in the practice consent to participate
The study will target all physicians working in participating practices since patients can receive a prescription from any physician in a practice.
Patient inclusion criteria:
- Patients of any age (“vulnerable patients”) will be included in the study if, at baseline, they fulfil one or more of the following inclusion criteria as listed in that puts them at increased risk of an ADE related to NSAIDs and/or antiplatelet medications.
- Participants are “vulnerable patients” at baseline; that is, those patients at increased risk of gastrointestinal, renal or cardiac adverse events related to NSAIDs and/or antiplatelet medications ( ).
|Type of adverse drug event||Risk factor making patients vulnerable (at increased risk of ADE)||High-risk prescribing|
|Gastrointestinal||Prior peptic ulcer||In patient with prior peptic ulcer, NSAID or aspirin without gastro-protection|
|75 years and older||In patient 75 years and older, NSAID without gastro-protection|
|65 years and older prescribed aspirin||In patient 65 years and older taking aspirin, NSAID without gastro-protection|
|In patient 65 years and older taking aspirin, clopidogrel without gastro-protection|
|Prescribed oral anticoagulant||In patient taking an oral anticoagulant, NSAID without gastro-protection|
|In patient taking an oral anticoagulant, aspirin or clopidogrel without gastro-protection|
|Renal||Prescribed both renin-angiotensin system blocker and diuretic||In patient taking both renin-angiotensin system blocker and diuretic, NSAID|
|Chronic kidney disease (Estimated Glomerular Filtration Rate[eGFR] <60)||In patient with chronic kidney disease (eGFR <60), NSAID|
|Cardiac||Heart failure||In patient with history of heart failure, NSAID|
All data collected on patients is anonymized prior to leaving the practice using a unique identifier (National Health Index number) to enable linking of clinical data over time and linking to hospitalization data.
The SPACE intervention is designed to prompt medication reviews and support safer prescribing decisions in primary care practice. The intervention comprises a practice audit to identify for each doctor a list of their patients with high-risk prescribing for the chosen topic; an outreach visit from a clinical advisory pharmacist to physicians to provide education about the prescribing topic and to go through with each physician their list of patients identified as having high-risk prescribing; a tick-box for physicians to indicate the action they will take in response to the feedback for each patient (“review medications + patient mail-out,” “review medications + no mail-out,” or “no action”); and a mail-out from the practice to patients selected by physicians with information about their medications and a letter encouraging them to discuss their medications when they are at the practice next seeing their physician . All prescribing decisions are made as usual by the doctor in discussion with the patient. The individual circumstances of the patient may justify high-risk prescribing and, after review, the prescribing may or may not be changed. The prescribing topic for the trial is the prescribing of NSAIDs and antiplatelet medications.
Control practices will deliver care as usual. If the SPACE intervention is shown to be effective, we aim to deliver the intervention to control practices after 12 months.
All practices and doctors will participate as usual in PHO quality improvement initiatives and medical education activities. Seefor the flow of practices through the study.
Assessment time-points will be baseline, 6 months, and 12 months. The outcomes of interest are the difference between intervention and control groups at 6 months controlling for baseline, and the difference between intervention and control groups at 12 months.
The primary outcome measure is:
The difference in proportion of the participants (those vulnerable at baseline) receiving high-risk prescribing of NSAID and/or antiplatelet medications between the control and intervention groups at 6 months. That is, the proportion of “vulnerable-at-baseline patients” (with gastro-intestinal, renal, or cardiac risk factors) receiving high-risk prescribing of NSAID and/or antiplatelet medications at 6 months according to the definitions listed in. Whether difference in proportion between the two groups is sustained at 12 months will also be examined. Participants will be considered to have high-risk prescribing at each time-point if they fulfil any of the high-risk prescribing criteria set out in in the 14 weeks leading up to each time-point.
Secondary outcome measures include:
- The difference in proportion of study participants at increased risk of gastrointestinal ADEs according to the definitions listed in receiving gastrointestinal high-risk prescribing of NSAID and/or antiplatelet medications between the control and intervention groups at 6 months.
- The difference in proportion of study participants at increased risk of renal ADEs according to the definitions listed in receiving renal high-risk prescribing of NSAID medications between the control and intervention groups at 6 months.
- The difference in proportion of study participants at increased risk of cardiac ADEs according to the definitions listed in receiving cardiac high-risk prescribing of NSAID medications between the control and intervention groups at 6 months.
- The difference in proportion of study participants (vulnerable patients), and those with high risk prescribing, admitted for related adverse drug events (gastrointestinal ulcer or bleeding, acute kidney injury, and heart failure) between the control and intervention groups during the 12 months after baseline for the intervention. Hospitalization data will be linked to primary care patient data by encrypted National Health Index.
- The difference in proportion of vulnerable patients in the practice overall receiving high-risk prescribing of NSAIDs and/or antiplatelet medications between the control and intervention groups at 6 months. This will include newcomers to the practice and practice patients who were not vulnerable at baseline but were at 6 months and/or 12 months.
Whether difference in proportion between the 2 groups is sustained at 12 months will also be examined for secondary outcomes 1, 2, 3, and 5 months.
These outcomes have been used in similar trials previously . Data will also be collected to enable a subsequent cost-effectiveness evaluation of the intervention from a societal and health funder perspective. The cost-effectiveness of the intervention will be measured as the cost per reduction in high-risk prescribing and cost per reduction in hospitalizations from the health funder (District Health Board) perspective. The data collected will include the cost of delivering the intervention (including pharmacist and doctor time for the feedback outreach session, travel time and costs for the outreach visit, audit time and cost); cost of medications; cost of hospitalizations.
The sample size calculation for this study is based on previous trials demonstrating a clinically relevant 25-45% relative risk reduction in the proportion of high-risk prescribing, [, ] one trial of which also demonstrated how such reduction (3.7% to 2.2%) in high-risk prescribing can translate to significant reductions in hospitalizations due to bleeding complications [ ]. Based on the local pilot data, we estimated an average of 200 “vulnerable patients” per practice and an 8% high-risk prescribing rate [ ]. We estimated an intracluster correlation coefficient of 4.68 x 10-7 for the primary outcome based on a cluster randomized trial examining similar outcome of NSAIDs prescribed to patients with a history of peptic ulcer and not prescribed gastro-protection [ ]. Assuming approximately 12% of patients would be lost to follow-up over the 12 month study period, data from 8000 patients from 40 practices (20 practices in each group) with an average of 200 vulnerable patients per practice would be required to detect a statistically significant difference of 6% in the intervention group and 8% in the control group of high-risk prescribing at 12 months (P=.90, alpha=.05).
Practices will be purposively sampled and recruited, aiming to include both medium sized (3000-7999 enrolled patients) and smaller practices (0-2999 enrolled patients) in the Auckland and Northland regions. Practices and physicians will be invited by a colleague using a comprehensive list of practices. Consent for participation will be at the practice and physician level. Written informed consent will be obtained from all participating physicians. Participants, ‘vulnerable patients’, will be identified using a standard query applied to the practice enrolled population. Consent will not be sought from individual patients because outcomes data are collected in routine patient care and will be anonymised prior to extraction for analysis and linking.
Assignment of Interventions: Randomization
Practices will be randomized 1:1 to intervention or control. Randomization will be stratified by practice location (Auckland vs Northland) and practice size (medium [3000-7999 enrolled patients] and smaller practices [0-2999 enrolled patients]). Block randomization will be carried out using randomly varying block sizes of 2, 4, and 6. Random sequence generation and allocation of randomization will be undertaken by a statistician not involved in recruitment or baseline data extraction.
Analyses will be performed according to the intention-to-treat principle, with the use of mixed-effect models to account for clustering in the data. The primary and secondary outcomes will be analyzed using generalized linear mixed effect model, GLIMMIX, with the individual as the unit of analysis and the practice included as the random effect to control for the effects of clustering. GLIMMIX with Group x Time interaction will be used to assess the overall difference between intervention and control. The model will adjust for the stratification factors including practice location (Northland or Auckland) and practice size. Baseline covariates including (age, sex, and baseline number of long-term medications) will be adjusted if appropriate.
Study approved by the University of Auckland Human Participants Ethics Committee: Ref 020092, expires 9 Oct 2020.
Recruitment will start in 2018. The SPACE trial will run for 2 years from recruitment to analyses and dissemination.
Most ongoing prescribing occurs in primary care. The prevalence of high-risk prescribing and avoidable ADE admissions, and the unnecessary cost imposed on an already stretched health system, justify greater efforts to improve the safety of prescribing in primary care. The ageing population, with more people living longer and taking more medications for more chronic conditions, means the problems of high-risk polypharmacy and avoidable ADE hospital admissions will continue to increase unless we can improve the safety of prescribing in primary care. The most effective and cost-effective intervention to support safer prescribing in everyday primary care practice is not yet known.
The SPACE intervention is based on sound theoretical underpinnings, is acceptable and useful in the New Zealand primary care context, and identifies and reaches patients with high-risk prescribing who are at increased risk of ADEs. The intervention builds on existing primary care infrastructure and uses existing primary care staff to deliver a safety improvement intervention. The intervention combines audit and feedback with mail-out to motivate patient engagement. It is amenable to repeat use, and could be used in an on-going quality improvement program to target different high-risk prescribing topics.
Practical Applications From Study Results
If shown to be effective and cost-effective, the SPACE intervention could be rolled out nationally and used regularly by PHOs to support safer prescribing in practices and minimize avoidable ADE hospital admissions in the short-to-medium term. Since the SPACE intervention is designed to support behavior change, it could be applied to other evidence-based topics, including other prescribing topics and test ordering and monitoring.
Interventions that have been shown to improve practice have been published [, ]. However, most previous trials of primary care interventions in this area have involved time-series or noncontrolled trials [ , , ]. The SPACE trial uses a cluster randomized controlled trial design to provide robust evidence to assess whether such an intervention can change prescribing and improve clinical outcomes.
Since the SPACE intervention is designed to prompt medication reviews and support safer prescribing, the primary outcome measure is designed to reflect a change in prescribing behavior (a reduction in the rate of high-risk prescribing in patients vulnerable at baseline). Since the ultimate aim is to change prescribing behavior overall and improve patient outcomes, we will also measure the rate of high-risk prescribing overall and related ADE hospital admissions.
There is a risk of contamination between intervention and control practices and between intervention practices and those waiting for the intervention; doctors might change their prescribing behavior if they are alerted to the study prescribing topic. However, rolling delivery of the intervention is the only practical and feasible way to progress this study, given the educational outreach visit component of the intervention and the limitations of our study team. We are also limited to using small to medium sized practices (fewer than 8000 enrolled patients), since all doctors in participating practices must receive one-on-one feedback from the clinical advisory pharmacist at an outreach visit.
This study addresses an important translational gap, testing an economically sustainable intervention designed to support safer prescribing in routine practice. The new knowledge generated will help to address the most important threat to patient safety in primary care: high-risk prescribing and adverse drug events.
Study funded by the Auckland Medical Research Foundation.
Conflicts of Interest
Multimedia Appendix 1
Reviewers' feedback on funding application for study.PDF File (Adobe PDF File), 246KB
- Taché SV, Sönnichsen A, Ashcroft D. Prevalence of adverse drug events in ambulatory care: a systematic review. Ann Pharmacother 2011 Jul;45(7-8):977-989. [CrossRef] [Medline]
- Budnitz DS, Lovegrove MC, Shehab N, Richards CL. Emergency hospitalizations for adverse drug events in older Americans. N Engl J Med 2011 Nov 24;365(21):2002-2012. [CrossRef] [Medline]
- Pirmohamed M, James S, Meakin S, Green C, Scott AK, Walley TJ, et al. Adverse drug reactions as cause of admission to hospital: prospective analysis of 18 820 patients. BMJ 2004 Jul 03;329(7456):15-19 [FREE Full text] [CrossRef] [Medline]
- Howard RL, Avery AJ, Slavenburg S, Royal S, Pipe G, Lucassen P, et al. Which drugs cause preventable admissions to hospital? A systematic review. Br J Clin Pharmacol 2007 Feb;63(2):136-147 [FREE Full text] [CrossRef] [Medline]
- Meier F, Maas R, Sonst A, Patapovas A, Müller F, Plank-Kiegele B, et al. Adverse drug events in patients admitted to an emergency department: an analysis of direct costs. Pharmacoepidemiol Drug Saf 2015 Feb;24(2):176-186. [CrossRef] [Medline]
- Guthrie B, McCowan C, Davey P, Simpson C, Dreischulte T, Barnett K. High risk prescribing in primary care patients particularly vulnerable to adverse drug events: cross sectional population database analysis in Scottish general practice. BMJ 2011 Jun 21;342(jun21 1):d3514-d3514. [CrossRef]
- Gyllensten H, Rehnberg C, Jönsson AK, Petzold M, Carlsten A, Andersson SK. Cost of illness of patient-reported adverse drug events: a population-based cross-sectional survey. BMJ Open 2013 Jun 20;3(6):a [FREE Full text] [CrossRef] [Medline]
- Thomsen LA, Winterstein AG, Søndergaard B, Haugbølle LS, Melander A. Systematic review of the incidence and characteristics of preventable adverse drug events in ambulatory care. Ann Pharmacother 2007 Sep;41(9):1411-1426. [CrossRef] [Medline]
- Ministry of Health. 2016. Pharmaceutical collection URL: https://www.health.govt.nz/nz-health-statistics/national-collections-and-surveys/collections/pharmaceutical-collection [accessed 2018-04-16] [WebCite Cache]
- Fried T, O'Leary J, Towle V, Goldstein M, Trentalange M, Martin D. Health outcomes associated with polypharmacy in community-dwelling older adults: a systematic review. J Am Geriatr Soc 2014 Dec;62(12):2261-2272 [FREE Full text] [CrossRef] [Medline]
- Charlesworth C, Smit E, Lee D, Alramadhan F, Odden M. Polypharmacy Among Adults Aged 65 Years and Older in the United States: 1988-2010. J Gerontol A Biol Sci Med Sci 2015 Aug;70(8):989-995 [FREE Full text] [CrossRef] [Medline]
- Nishtala P, Salahudeen M. Temporal Trends in Polypharmacy and Hyperpolypharmacy in Older New Zealanders over a 9-Year Period: 2005–2013. Gerontology 2015;61(3):195-202. [CrossRef] [Medline]
- Love T, Ehrenberg N. Variation and improving services: case studies and key questions. Wellington: Health Quality and Safety Commission; 2014. URL: http://www.hqsc.govt.nz/assets/Health-Quality-Evaluation/PR/Variation-case-studies-and-key-questions-May-2014.pdf [accessed 2018-04-16] [WebCite Cache]
- Narayan S, Nishtala P. Prevalence of potentially inappropriate medicine use in older New Zealanders: a population-level study using the updated 2012 Beers criteria. J Eval Clin Pract 2015 Aug;21(4):633-641. [CrossRef] [Medline]
- Scott I, Hilmer S, Reeve E, Potter K, Le CD, Rigby D, et al. Reducing inappropriate polypharmacy: the process of deprescribing. JAMA Intern Med 2015 May;175(5):827-834. [CrossRef] [Medline]
- Wallis K, Andrews A, Henderson M. Swimming Against the Tide: Primary Care Physicians' Views on Deprescribing in Everyday Practice. Ann Fam Med 2017 Jul;15(4):341-346 [FREE Full text] [CrossRef] [Medline]
- Health Quality & Safety Commission New Zealand. 2015. Atlas of healthcare variation: Polypharmacy in older people URL: https://www.hqsc.govt.nz/our-programmes/health-quality-evaluation/projects/atlas-of-healthcare-variation/polypharmacy/ [accessed 2018-04-16] [WebCite Cache]
- Tomlin A, Gillies T, Tilyard M, Dovey S. Variation in the pharmaceutical costs of New Zealand general practices: a national database linkage study. J Public Health (Oxf) 2016 Mar;38(1):138-146. [CrossRef] [Medline]
- Ministry of Health. NZ health system: Primary Health Organisations 2017 URL: https://www.health.govt.nz/new-zealand-health-system/key-health-sector-organisations-and-people/primary-health-organisations [accessed 2018-04-16] [WebCite Cache]
- Patterson S, Cadogan C, Kerse N, Cardwell C, Bradley M, Ryan C, et al. Interventions to improve the appropriate use of polypharmacy for older people. Cochrane Database Syst Rev 2014 Oct 07;10(10):CD008165. [CrossRef] [Medline]
- Duerden M, Avery T, Payne R. Polypharmacy and medicines optimisation: making it safe and sound. London, UK: King's Fund; 2013. URL: https://www.kingsfund.org.uk/sites/default/files/field/field_publication_file/polypharmacy-and-medicines-optimisation-kingsfund-nov13.pdf [accessed 2018-04-16] [WebCite Cache]
- Richards D, Toop L, Graham P. Do clinical practice education groups result in sustained change in GP prescribing? Family Practice 2003 Apr 01;20(2):199-206. [CrossRef]
- Dreischulte T, Donnan P, Grant A, Hapca A, McCowan C, Guthrie B. Safer Prescribing--A Trial of Education, Informatics, and Financial Incentives. N Engl J Med 2016 Mar 17;374(11):1053-1064. [CrossRef] [Medline]
- Roughead EE, Kalisch ELM, Ramsay EN, Pratt NL, Barratt JD, LeBlanc VT, et al. Bridging evidence-practice gaps: improving use of medicines in elderly Australian veterans. BMC Health Serv Res 2013 Dec 12;13:514 [FREE Full text] [CrossRef] [Medline]
- Avery A, Rodgers S, Cantrill J, Armstrong S, Cresswell K, Eden M, et al. A pharmacist-led information technology intervention for medication errors (PINCER): a multicentre, cluster randomised, controlled trial and cost-effectiveness analysis. The Lancet 2012 Apr;379(9823):1310-1319. [CrossRef]
- Mugunthan K, McGuire T, Glasziou P. Minimal interventions to decrease long-term use of benzodiazepines in primary care: a systematic review and meta-analysis. Br J Gen Pract 2011 Sep;61(590):e573-e578 [FREE Full text] [CrossRef] [Medline]
- Wallis K, Tuckey R. Safer Prescribing and Care for the Elderly (SPACE): feasibility of audit and feedback plus practice mail-out to patients with high-risk prescribing. J Prim Health Care 2017 Jun;9(2):145-152. [CrossRef] [Medline]
- Wallis K, Elley C, Moyes S, Kerse N. Safer Prescribing And Care for the Elderly (SPACE): Pilot Study in General Practice. British Journal of General Practice Open 2018 (forthcoming).
|ADE: adverse drug event|
|eGFR: estimated glomerular filtration rate|
|GLIMMIX: generalized linear mixed effect model|
|MATES: Australian Veterans’ Medicines Advice and Therapeutics Education Service|
|NSAID: nonsteroidal anti-inflammatory drug|
|PHO: Primary Health Organisation|
|SPACE: Safer Prescribing and Care for the Elderly|
Edited by G Eysenbach; submitted 14.01.18; peer-reviewed by I Scott, KNB Nor Aripin, A Iaconi; comments to author 21.03.18; revised version received 21.03.18; accepted 22.03.18; published 26.04.18
©Katharine Ann Wallis, Carolyn Raina Elley, Arier Lee, Simon Moyes, Ngaire Kerse. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 26.04.2018.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.