Skip to main content

A community-wide campaign to promote physical activity in middle-aged and elderly people: a cluster randomized controlled trial

Abstract

Background

We aimed to evaluate the effectiveness of a community-wide campaign (CWC) for promoting physical activity in middle-aged and elderly people.

Methods

A cluster randomized controlled trial (RCT) with a community as the unit of randomization was performed using a population-based random-sampled evaluation by self-administered questionnaires in the city of Unnan, Shimane Prefecture, Japan. The evaluation sample included 6000 residents aged 40 to 79 years. We randomly allocated nine communities to the intervention group and three to the control group. The intervention was a CWC from 2009 to 2010 to promote physical activity, and it comprised information, education, and support delivery. The primary outcome was a change in engaging in regular aerobic, flexibility, and/or muscle-strengthening activities evaluated at the individual level.

Results

In total, 4414 residents aged 40–79 years responded to a self-administered questionnaire (73.6% response rate). Awareness of the CWC was 79% in the intervention group. Awareness and knowledge were significantly different between the intervention and control groups, although there were no significant differences in belief and intention. The 1-year CWC did not significantly promote the recommended level of physical activity (adjusted odds ratio: 0.97; 95% confidence interval: 0.84–1.14).

Conclusions

This cluster RCT showed that the CWC did not promote physical activity in 1 year. Significant differences were observed in awareness and knowledge between intervention and control groups as short-term impacts of the campaign.

Trial registration

UMIN-CTR UMIN000002683

Background

Engaging in regular physical activity (PA) reduces the risks of many chronic diseases [15]. However, physical inactivity remains a common public health problem in developed and developing countries [6, 7].

PA behaviors are affected by diverse factors at the individual, social, environmental, and policy level [8, 9]. Therefore, multilevel and intersectoral approaches seem to be the most successful PA promotion strategies [9, 10]. Recently, community-wide interventions involving various campaigns have received broad attention for promoting PA in a wide range of community populations. Such community-wide campaigns (CWC) typically (1) involve many community sectors; (2) include highly visible, broad-based, multi-component strategies; and, (3) may also address other cardiovascular disease risk factors [11, 12]. However, well-designed trials assessing the effectiveness of CWC for promoting PA have been lacking [1322]. A recent review included only one cluster randomized controlled trial (RCT), which focused on adolescents, and concluded that there was a lack of appropriate studies which could show whether this approach is beneficial [22]. The risk of bias, including selection bias in non-randomized studies, in the existing literature might lead to a misunderstanding of effective population strategies. Therefore, it is desirable to conduct randomized studies to obtain more robust knowledge, and advance the body of public health policy and practices.

Focusing on the outcomes targeted by CWCs, there are relatively few studies on flexibility and muscle-strengthening activities compared with those on aerobic activities (e.g., walking) [1221]. Flexibility and muscle-strengthening activities are generally recommended for older people, and specifically for people with musculoskeletal disorders, as a non-pharmacological treatment [2327]. Musculoskeletal disorders are a major burden on both individuals and societies [28]. In Japan, musculoskeletal pain has been the most reported subjective symptom [29]. In addition, as arthritis is a potential barrier to PA [30], we cannot ignore the influence of these conditions when promoting PA, especially in older people.

Therefore, this study aimed to evaluate the effectiveness of a CWC for promoting not only aerobic PA, but also flexibility and muscle-strengthening activities in middle-aged and elderly people by conducting a cluster RCT. Our intention was to promote PA through a CWC delivered at the community level. To minimize contamination, the unit of randomization was the community. The hypothesis was that a CWC delivered at the community level would promote engagement in regular aerobic, flexibility, and/or muscle-strengthening activities in middle-aged and elderly people evaluated at the individual level.

Methods

The COMMUNICATE (COMMUNIty-wide CAmpaign To promote Exercise) study was a cluster randomized controlled, superiority trial, stratified by high, moderate, and low population density, with imbalanced randomization (three interventions; one control). It was conducted in the city of Unnan (population 45364, area 553.7 km2), a rural mountainous region in Shimane, Japan. To assess a community level intervention, it is preferable to randomly assign communities rather than individuals to study groups [31]. Full details of the trial protocol can be found in Additional file 1. This study was approved by the research ethics committee of the Physical Education and Medicine Research Center UNNAN.

Figure 1 is a flow diagram of the trial process. There are 32 communities within Unnan, with a median population and area of 1292 and 10.8 km2, respectively. The eligibility criterion for clusters was all communities in Unnan. The 32 clusters were divided into three groups by population density. Then, 12 clusters were randomly sampled, with stratification by blocking within population density category strata, and randomly allocated to three intervention clusters (i.e., a total of nine clusters) per control cluster (i.e., a total of three clusters). Additionally each cluster in the intervention group was randomly allocated to an aerobic activity group (Group A), a flexibility and muscle-strengthening activities group (Group FM), and an aerobic, flexibility, and muscle-strengthening activities group (Group AFM), each consisting of three clusters. This factorial designed division was for the purpose of subgroup analyses.

Figure 1
figure 1

Flow diagram of the trial process. Note. HPD: high population density. MPD: moderate population density. LPD: low population density.

Randomization of the clusters was performed by a clerical staff member of Unnan City Hall, blinded to the name and identity of the clusters, using a computer-generated list of random numbers. Another staff member had a list of all cluster names and the relevant numbers and assigned the clusters. Neither staff member was involved in the remainder of this study. We did not conduct any other cluster selection process to minimize the risk of contamination (e.g., geographical distance between individual clusters).

Intervention

A CWC to promote PA for all middle-aged and elderly (40–79 years) residents living in the communities was conducted as an Unnan City Hall public health project at the cluster level within intervention groups for 1 year (November 2009 to October 2010).

In Group A, mainly walking behavior was promoted for aerobic activity. In Group FM, mainly stretching exercises for back muscles, adductor muscles, gluteus maximus, knee extensor muscles, and knee flexor muscles, and muscle-strengthening activities for trunk flexor, knee extensor, and knee flexor were promoted. These anatomical areas were chosen as key muscle groups for treating low back and knee pain, and the exercises did not require expensive training equipment [25, 32, 33]. In Group AFM, all of these walking, stretching, and muscle-strengthening activities were promoted.

Social marketing applies marketing principles and techniques to create, communicate, and deliver value in order to influence target audience behaviors that benefit society as well as the target audience [3438]. We adopted the following social marketing processes:

  1. (1)

    Situational analysis. A situational analysis helps health professionals understand factors that may influence a health campaign and provides background and context to the social marketing plan. We conducted the following situational analyses: background and issue identification, environmental scan, and SWOT (Strengths, Weaknesses, Opportunities, Threats) analysis [37].

  2. (2)

    Market segmentation and targeting. We used the TARPARE model to determine the primary communication target segment [39]. The model assists the health promotion practitioner to systematically compare and select appropriate target groups when there are a number of segments competing for attention and resources. We placed specific emphasis on the total number of persons in the segment (T), at risk status (AR), and persuasibility (P) as segment priority factors. In the process of market (population) segmentation, we also adopted the stages of change model [40]. However, there were no data regarding the stages of change in PA behavior in this study population, so available behavioral data (i.e., walking times and engagement in stretching) was used to supplement the estimation of segment size. For promotion of aerobic activity, we selected a segment of women, 60–79 years of age, who had an interest in, but were either not engaged in or were insufficiently engaged in, regular walking behavior (less than 150 minutes/week), and who had low back or knee pain, regardless of severity. For flexibility and muscle-strengthening activities, we selected a segment of women, 60–79 years of age, who engaged in flexibility and/or muscle-strengthening activities, either occasionally or daily, and who had low back or knee pain, regardless of severity. The estimated proportion of the target segment of the 40–79-year old population was 19% for aerobic activities and 16% for flexibility and muscle-strengthening activities, based on data from the Shimane Study in Unnan [41]. This targeting did not mean that our CWC ignored PA in non-targeted subjects. Rather, we aimed that the CWC mainly influenced the primary communication target with sophisticated messages and approaches, and then it had a ripple effect on non-targeted subjects.

  3. (3)

    Setting objectives. The SMART (Specific, Measurable, Achievable, Realistic, Time-based) objective was set for behavioral change as follows: “To increase the percentage of 40–79-year-old individuals who engage in aerobic, flexibility, and/or muscle-strengthening activities in an intervention group from 58% to 66% over a 1-year period.” The baseline percentage was estimated from the available data for Unnan. A previous systematic review reported that the median net increase in the percentage of people who reported being physically active as a result of a CWC was 4.2% (range, -2.9% to 9.4%) [12]. We decided on a target increase of 8% because the area and population sizes were relatively small in this study and the effect of a CWC would be potentially greater within such a community compared with a larger scale CWC (e.g., at state or prefecture level).

  4. (4)

    Marketing strategy development. A CWC followed the “4 Ps” concept of marketing mix (i.e., making sure the right Product is available at the right Price, in the right Place and is well-Promoted). Figure 2 shows the concept of marketing mix and examples of each component for promoting PA in this study. For example, for Product (i.e., PA), the benefits of the product rather than the product itself were emphasized [38]. Thus, rather than promoting PA per se, a CWC should promote ideas such as feeling good, having increased energy or longevity, according to the identified views of the target segments [42]. The 4Ps map was devised according to the results of formative research, including interviews with target and other segments about their lives and values. Additionally, in the process of creating messages and materials, pretesting of materials was performed through interviews with the target segment about their feelings toward, and impressions of, such materials.

Figure 2
figure 2

Concept of marketing mix and example elements of the four Ps for promoting physical activity. Note. PA: physical activity

After the social marketing process was completed, the key message of “Be active to cure your low back and knee pain” (originally in Japanese) was selected and delivered within all intervention groups as the common key message. Cooperative relationships were developed with education and sports organizations, the regional development departments of Unnan City Hall, the Unnan Police Department, each community’s self-administered organization, Senior Citizens’ Club, schools and clinics.

The CWC consisted of three components, namely:

  1. (1)

    Information delivery. Flyers, leaflets, community newsletters, posters, banners, and local audio broadcasts (samples available in Additional files 2 and 3).

  2. (2)

    Education delivery. Outreach health education program and mass- and individual encouragement by professionals during medical check-ups and various community events, including sports events and festivals. Mass-encouragement included the delivery of a motivating talk and demonstration of each type of PA using a common procedure to ensure standardization of the intervention and individual encouragement, including short face-to-face promotion and counseling on PA while waiting for medical check-ups, etc.

  3. (3)

    Support delivery. Development of social (peer) support, i.e., promoting encouragement by community leaders and lay health workers; material support, i.e., arranging for residents to obtain light-reflective material for walking safety, pedometers [43] (Group A and AFM), and videotapes and DVDs on flexibility and muscle-strengthening activities (Group FM and AFM) at each relevant community center; and professional support, i.e., establishing a call center for questions about PA and requests for outreach programs.

The CWC met the definition of a community-wide intervention as set out in Baker and colleagues’ review [22]. It was possible that residents travelled between the different communities for shopping, commuting, seeing a doctor, etc. In order to avoid contamination of the intervention, flyers, leaflets, and community newsletters were delivered to the household directly in the intervention communities, and the audio messages were only delivered to households in the intervention communities by using the cable network (i.e., not radio or terrestrial TV). Educational activities were implemented only at community events in which all participants were residents living in the relevant intervention community. In the control group, public health services were delivered by Unnan City Hall as usual.

Population-based evaluation

The effectiveness of the intervention was evaluated by a population-based survey, which was a prospective cohort design. As a baseline survey, self-administered questionnaires were mailed to random participants in October 2009. A computer-based resident registry system was used for random sampling. Eligible respondents were all men and women aged 40 to 79 years living in the 12 study communities. Those excluded were individuals in assisted living facilities, those who require long-term care, or those who could not complete the questionnaires themselves due to disability. Based on the information obtained from the questionnaires, those unable to walk unaided were also excluded from the analyses. One-year follow-up questionnaires were mailed to the baseline respondents in October 2010. Respondents confirmed by the registry system as having died or moved were excluded from the follow-up.

All respondents gave written informed consent to participate in these cohort surveys at baseline. The content of the questionnaires was the same for all residents. Both participants and data collectors were randomly sampled residents. Residents and the CWC collaborators (e.g., community self-administered organization staff, Senior Citizens’ Clubs, schools and clinics) were blinded to (not informed about) the study design and hypothesis (i.e., the existence of the control group and cluster allocation) [44]. The implementing staff of the CWC (intervention providers), data analysts, the Mayor, Vice-Mayor, supervisory employees, and public health nurses of Unnan City Hall were not blinded to the cluster allocation.

Measures

Primary outcome

The primary outcome was the change in engagement in regular PA evaluated at the individual level from baseline to 1-year follow-up. If respondents met any one of the following three conditions, they were defined as “engaging in regular PA”: (1) engaging in 150 minutes/week or more of walking, (2) engaging in daily flexibility activity, or (3) engaging in muscle-strengthening activities two or more days/week. The threshold of these conditions was based on the PA recommendations of the American College of Sports Medicine and the American Heart Association [1, 23]. We chose this primary outcome, because the intervention promoted specific types of PA rather than comprehensive (all types of) PA. We considered that questions about specific varieties of PA (i.e., walking, flexibility, muscle-strengthening activities) would be more sensitive than the comprehensive PA questionnaires (e.g., the International Physical Activity Questionnaire [45]).

Walking time for both recreation and transport was considered as engagement in walking. Respondents were asked about the number of days per week and the mean number of minutes walked per day, for recreation and transport separately, to give the weekly total minutes of walking time. Frequency of engagement in flexibility activity was assessed categorically (daily, not daily but occasionally, not at all). Walking and flexibility items were adopted from the questionnaire used in the Shimane Study [41]. The 1-week test-retest reliability of the walking questionnaire was acceptable (Spearman’s ρ = 0.79) and has been described elsewhere [41]. The criterion-related validity of this self-administered walking questionnaire compared with average daily step counts recorded by a uniaxial accelerometer (Lifecorder, Suzuken Co., Ltd., Nagoya, Japan [46, 47]) was also found to be acceptable (Spearman’s ρ = 0.38) in 95 elderly subjects (40 men and 55 women) aged 74.9 ± 4.5 (range, 62–85) years living in the city of Unnan. The weekly number of days engaged in muscle-strengthening activity was assessed by asking “Do you usually do activities to maintain and/or improve muscles and/or muscle strength (e.g., sit-ups, squats, knee extensions)?” The test-retest reliability of the flexibility and muscle-strengthening activities was assessed by mailing self-administered questionnaires; the questionnaires were mailed twice at an interval of 10 days. The subjects were 500 random participants aged 40–84 years living in Unnan communities other than the 12 study communities of the COMMUNICATE study. Subsequently, the data of 206 individuals (100 men and 106 women) aged 63.4 ± 11.9 (40–84) years were analyzed. The results showed a moderate and acceptable value of weighted kappa (0.72, p < .001) for flexibility and Spearman’s rho (0.75, p < .001) for muscle-strengthening activity.

Secondary outcomes

Low back and knee pain were evaluated as secondary outcomes. A visual analog scale (VAS) from 0 mm (no pain) to 100 mm (most intense pain) was used to assess pain intensity [48]. Chronic musculoskeletal pain was defined as current pain lasting longer than 3 months within the past 12 months [49]. These pain outcomes represented possible benefits or harm related to the CWC. The test-retest reliability of the pain questionnaires also showed moderate and acceptable values of Spearman’s rho (low back: 0.70, p < .001; knee: 0.78, p < .001) for VAS scores and Cohen’s kappa (low back: 0.49, p < .001; knee: 0.72, p < .001) for chronic pain in the same population as that for the flexibility and muscle-strengthening activities questionnaires.

We hypothesized one logic model indicating that change would be induced by the CWC in the following order: awareness; knowledge; belief; intention; and finally PA (Figure 3). This model was adopted from Cavill and Bauman’s model for mass media campaigns [42]. According to our model we evaluated awareness, knowledge, belief, and intention as exploratory analyses. Awareness was evaluated by asking: “Have you seen or heard messages (the campaign) recommending PA, such as “be active to cure your low back and knee pain,” “let’s walk,” or “let’s stretch” (all originally in the Unnan dialect of Japanese) in the last year (November 2009 to October 2010)?” Then, participants answered yes or no to receiving the following CWC components: (1) posters, leaflets, and banners; (2) local audio broadcasts; (3) mass- and individual encouragement by health professionals in community-based medical check-ups and at other community events; (4) individual encouragement by family, friends, and/or neighbors; and (5) advice from physicians and medical staff in medical institutions. Knowledge, belief, and intention were evaluated by asking participants to answer yes or no to the following questions: “Do you know that physical activity is effective for reducing low back and knee pain?”; “Do you think (believe) that physical activity is effective for reducing low back and knee pain?”; and “Do you intend to engage in physical activity within the next 6 months in order to reduce low back and knee pain?” These aspects were only measured at follow-up.

Figure 3
figure 3

Logic model for community-wide campaign to promote physical activity.

As covariates, we examined sex, age, body mass index (BMI) calculated from self-reported weight and height in kg/m2, self-rated health, years of education, employment status, engagement in farming, and chronic disease history, because most of these have been reported to have an impact on PA [8, 5052].

Implementation evaluation

We assessed the implementation of the intervention as a process evaluation. For information delivery, the numbers of flyers, leaflets, posters, community newsletters, and banners distributed were recorded. The number of times and the duration of local audio broadcasts were also recorded. For education delivery, a case report form which included the number of attending participants was used, and all health education program and mass- and individual encouragement by professionals were recorded. The quasi-population coverage rate for such educational activities was calculated as gross numbers of participants divided by the population aged 40–79 years in the relevant community. Finally, for support delivery, we recorded the implemented interventions in each community, and these were tabulated and assessed for the degree to which the implementation was adequate for the relevant community.

Statistical analyses

We calculated our planned sample size of nine clusters and 4500 participants in the intervention group, and three clusters and 1500 participants in the control group (a total of 6000 participants in the 12 clusters) on the assumption of a 50% response rate at baseline to detect an 8% difference in change in engagement in regular PA between the intervention and control groups, taking into account the design effect by cluster randomization [31]. Based on available data in Unnan, the estimated rate of participation in regular PA at baseline was 58% with an estimated intracluster correlation coefficient of 0.00174. We used the chi-square test with imbalanced randomization (three interventions; one control), a two-sided 5% significance level, and a power of 90%.

Primary and secondary analyses

We conducted multi-level analyses, taking into account the cluster randomized design. We compared the nine intervention clusters to the three control clusters for the primary outcome of engagement in regular PA at 1-year follow-up using a generalized linear mixed model (GLMM) with sex, age, BMI, self-rated health, years of education, employment, farming, chronic low back and knee pain, chronic disease history, category of population density, engagement in regular PA at baseline, and group allocation (i.e., intervention or control) as fixed effects, and community (cluster) where respondents lived as a random effect.

As secondary analyses, we compared the nine intervention clusters to the three control clusters for changes in VAS pain scores and chronic low back and knee pain using the GLMM, as for the primary analysis. We also compared each intervention group (i.e., Groups A, FM, and AFM) with the control group for primary and secondary outcomes, and changes in engagement in each of the different activities (i.e., aerobic, flexibility, and muscle-strengthening activities) using the same GLMM.

As exploratory analyses, we first analyzed the difference in awareness, knowledge, belief, and intention at follow-up between the intervention and control groups using the GLMM, while controlling for other covariates. Second, in order to assess the logic model for the CWC, we analyzed the associations among variables in the logic model, i.e., awareness, knowledge, belief, intention, and regular PA, in the intervention group using the GLMM and controlling for other covariates. Because there were no baseline data on these variables, these analyses were cross-sectional.

We assigned cluster-specific mean values to missing values for the intention-to-treat analyses, which included all baseline respondents who could walk unaided. When the models did not converge, the analyses were performed using the data of respondents without missing values, i.e., per protocol analyses. For all analyses, we used the forced entry method. Significance was set at p < .05. Analyses were carried out using SAS version 9.1.3 and IBM SPSS Statistics 19.0.

Results

Campaign implementation

Table 1 indicates the dose of the implemented information, education, and support delivery in each community. All three components of the CWC were implemented in all intervention communities, although some components were weakly or not implemented in some communities because of the lack of resources and/or the features (e.g., low population) of the relevant community. Information was delivered as follows: leaflets and flyers were distributed to all 4036 households at least twice; posters were hung at 276 sites, including small assembly houses and downtown shops; banners were placed in all community centers; and 60–90 second audio messages were broadcast directly to each household 12 times using a cable network. For education delivery, mass- and individual encouragement activities were conducted by professionals 142 times in total, with a median of 14 times for each community. Approximate gross numbers of participants involved in such activities were 7160 in total, 4610 of whom were 40–79 years old. This covered about 62% of the population aged 40–79 years and living in the intervention communities. Communities with a low population tended to have a quasi-population coverage rate greater than 100%, indicating that some residents received the educational activities multiple times during the intervention period. For support delivery, light-reflective materials were distributed at community events for Group A and AFM; videotapes and DVDs were available for loan at community centers for Group FM and AFM; and a call center was established for all groups.

Table 1 Implementation of information, education, and support delivery in communities: COMMUNICATE Study

The standard public health services in control communities included medical health check-ups, 14 health education classes about general lifestyle and disease prevention (a total of 192 participants), and ad hoc health counseling during the intervention period.

Population-based evaluation

Data from a total of 4414 (73.6%) and 3507 (58.5%) respondents were analyzed in the intention-to-treat and per-protocol manner, respectively (Figure 1). Baseline characteristics of the eligible respondents are presented in Table 2. No significant differences between the control and intervention groups were observed.

Table 2 Baseline characteristics of participants randomly selected from communities: COMMUNICATE Study

Primary and secondary analyses

The proportion of respondents who engaged in regular PA decreased from 64.6% to 60.3% in the control group and from 63.9% to 58.7% in the intervention group in the intervention year. The effect size (adjusted odds ratio, OR) of the CWC was not significant (0.97; 95% confidence interval (CI): 0.84–1.14). There were also no significant changes in pain outcomes between control and intervention groups (Table 3). When comparing each intervention group (i.e., Group A, FM, and AFM) with the control group for regular PA, pain outcomes, and each different activity, no significant changes were observed.

Table 3 Changes in physical activity and musculoskeletal pain from baseline to 1-year follow-up: COMMUNICATE Study

Exploratory analyses

At follow-up, 79.3% of the respondents in the intervention group were aware of at least one component of the CWC (Table 4). However, 58.7% were also aware in the control group. Significant differences were observed in awareness and knowledge between the control and intervention groups, whereas belief and intention were not significantly different. In the intervention group, all variables in the logic model were significantly associated each other, except for awareness and belief (OR = 1.20; 95% CI 0.97–1.48) (Table 5). The variable with the largest effect size on regular PA was intention (OR = 2.29; 95% CI: 1.85–2.83).

Table 4 Awareness, knowledge, belief, and intention in control and intervention communities at 1-year follow-up: COMMUNICATE Study
Table 5 Associations among variables in the logic model of the community-wide campaign: COMMUNICATE Study

Discussion

The present study showed that the 1-year CWC did not promote PA in middle-aged and elderly people. To our knowledge, this is the first study that examined the effectiveness of a CWC for promoting PA in middle-aged and elderly people using a randomized design.

Our results regarding the hypothesized logic model suggest that changes in awareness and knowledge could be observed as short-term impacts of the CWC. Baker and his colleagues’ model also proposed that awareness and knowledge change as short-term impacts, and changes in belief, intention, and PA level are medium-term results in community-wide interventions [22]. It was unknown how long a CWC should be conducted to promote PA. The most frequent duration of interventions in the 25 studies in a recent Cochrane Systematic Review article for community-wide interventions was 1 year (six studies) and the median duration was 3 years with a range of 1–7 years [22]. Our results suggest that 1 year should be considered short-term and that more time is needed for CWCs to attain behavior (PA) change in middle-aged and elderly people.

We used cluster-specific mean values, which might increase the risk of regression to the mean. Reduced variance within each cluster increases the statistical power (increased type 1 error). However, our primary and secondary analyses indicated that the differences between intervention and control group were insignificant even in this situation. Thus, our conclusion about the insignificant difference is considered to be valid.

Significant associations among variables in our hypothesized logic model suggest that this model is effective for process evaluation of a CWC. Respondents who were aware of the campaign were more likely to engage in the recommended level of PA after the campaign than those who were not aware of the campaign. Awareness of peer support and advice from physicians was low (37.7% and 25.5%, respectively). Additional emphasis on peer support and advice from physicians and, if possible, some environmental changes might be effective in a future CWC [8, 12, 53]. Some voluntary activities (e.g., monthly walking events in two communities in Group A, and stretching exercises in a cultural, arts and recreational group in one community in Group AFM) started after the 1-year campaign finished. Therefore, intervention effects could be observed as late behavior change. In response to the results of the current study, campaign improvement and maintenance had been implemented and a 3-year follow-up evaluation planned. The CWC strategy has to focus on changing belief [54], intention, and the actual behavior of the population in this next phase.

We assessed the implementation process by using the output data. Most parts of the three components of the CWC were implemented in all intervention communities, although some components were weakly or not implemented in some communities. An effort to deliver intervention components equally at the same level of dose across all communities is an essential part of this kind of community intervention trial. In addition, in order to assess the external validity (generalizability) of this public health intervention, further analysis using the RE-AIM framework will also be of value [55]. For example, the data on the (quasi-)population coverage rate for education delivery, as indicated in this study, will be valuable data for the “Reach” component of RE-AIM and for understanding how much intervention is necessary to achieve population-level behavioral change.

We did not observe any significant changes in pain outcomes. This is not unexpected, as pain improvement generally occurs after an increase in PA level. No significant change in pain might also indicate that no harm was observed.

In this study, no differences were observed when comparing Groups A, FM, and AFM with the control group. Walking is the most common PA of adults and the elderly [56, 57]. Flexibility and muscle-strengthening activities can easily be performed at home without special equipment. However, a lack of specific knowledge of how to perform such activities may be a barrier to participation [58]. In Group AFM, the amount of information delivered was greater than that for Group A and FM, thus the burden felt by the former might be greater than by the latter. However, if the CWC could succeed in motivating people to perform all these PAs, then the achieved health benefit would be the greatest [1, 23]. In order to develop strategies to disseminate PA recommendations, further studies are necessary to examine whether information about a variety of PAs (e.g., aerobic, flexibility, and muscle-strengthening activities together) can be successfully delivered in community-wide interventions and whether differences exist by type of PA.

This study had some limitations. First, a self-administered questionnaire, which might be subject to recall bias, was used for outcome measurement. In smaller-scale clinical trials, objective measures (e.g., devices to assess movement directly) can be used as indices of change. However, in broader-reach trials, objective measures are often prohibitively expensive, burdensome to participants and logistically difficult. Thus, in broad-reach trials, self-report measures frequently must be relied on. Brief self-report measures have been suggested as useful for their comparability of population PA estimates and have low respondent burden [59]. In addition, little is known to date about objective methods to assess daily flexibility and muscle-strengthening activities in population-wide studies. A strength of this study is that we used questionnaires, whose reliability was assessed, to measure these activities. Although the term “usually” could be interpreted in a variety of ways by different participants, the test-retest reliability of the muscle-strengthening activity was moderate and acceptable.

Second, since the awareness of the CWC was extraordinarily high in the control group, it is possible that contamination of the intervention occurred. The proximity of study communities is a possible explanation. Of all the intervention components, the exposure to campaign posters and word-of-mouth from an acquaintance and friends were possible sources of contamination, although efforts to avoid contamination were made when delivering visual and audio information and educational activities. The questionnaire might also have elicited information about general exposure to PA information, rather than just exposure to the CWC. In order to confirm this, we conducted a telephone survey in randomly selected respondents (n = 60) of the 3-year evaluation (the succeeding survey of this study) in December 2012. Results indicated that only 48% (0% for audio information delivery, 7% for mass encouragement) of the respondents who answered that they were aware of the visual information delivery of the campaign in the questionnaire correctly remembered the specific features of the campaign in the control group, compared with 85% (48% for audio information delivery, 62% for mass encouragement) in the intervention group (Chi square test: p = 0.012 for visual information, p < .01 for audio information, p < .01 for mass encouragement). Most of the respondents in the control group tended to answer “yes” to the awareness question because they thought of exposures to PA-related information (e.g., promotion of exercise classes) irrelevant to the campaign. Considering the low percentages (0% and 7%) of the questions answered correctly, contamination of audio broadcast and mass encouragement did not seem to occur broadly whereas visual information delivery (e.g., posters) could be seen even by the residents in the control group. Although the absolute proportion of awareness should be interpreted with caution, it is still clear that the CWC did reach many residents in the intervention communities through the various interventions (e.g., about 62% of the population by education delivery).

Third, single items and “yes”/”no” responses were used for the logic model measures due to space limitation in the questionnaire. They could not capture the depth of knowledge, strength of belief, and/or intention. The items for knowledge and belief also seem to be leading, and it is possible that these items led to response bias. A questionnaire space limitation problem often occurs in large scale community intervention studies. A high volume questionnaire risks lowering the response rate [60]. Short and reliable psychometric items are important to evaluate the psychological factors. In addition, as these analyses on the logic model measures were cross-sectional, we cannot make conclusions about causality.

Regarding the research design of the health promotion studies, although there are some criticisms of RCTs [61], Rosen et al. argued that many of these objections can be eliminated through a better grasp of the basics of RCTs and their proper implementation, and with a better understanding of research ethics in general [62]. A cluster RCT is considered as the preferable study design for this type of community intervention study and it is definitely an important strength of our study. The high response rate and detection of harm from the intervention using a pain questionnaire, which is not usually considered in PA interventions, are also strengths of this study.

Conclusions

The results of this cluster RCT indicate that the CWC in Unnan, Japan did not promote PA in middle-aged and elderly people in 1 year. Significant differences were observed in awareness and knowledge between intervention and control groups as short-term impacts of the campaign. Our study, with its robust design and excellent community-wide coverage provides valuable information about the time required for a CWC to attain actual behavioral change. Furthermore, the logic model is useful for public health professionals involved in developing, implementing, and evaluating CWCs to promote PA.

Authors’ information

At the time of the study, MK was also with the Physical Education and Medicine Research Center UNNAN, Unnan, Shimane, Japan.

Abbreviations

PA:

Physical activity

CWC:

Community-wide campaign

RCT:

Randomized controlled trial

Group A:

Aerobic activity group

Group FM:

Flexibility and muscle-strengthening activities group

Group AFM:

Aerobic, flexibility, and muscle-strengthening activities group

VAS:

Visual analog scale

BMI:

Body mass index

GLMM:

Generalized linear mixed model

OR:

Odds ratio

CI:

Confidence interval.

References

  1. Haskell WL, Lee IM, Pate RR, Powell KE, Blair SN, Franklin BA, Macera CA, Heath GW, Thompson PD, Bauman A: Physical Activity and Public Health. Updated Recommendation for Adults From the American College of Sports Medicine and the American Heart Association. Circulation. 2007, 116 (9): 1081-1093.

    Article  Google Scholar 

  2. World Health Organization (WHO): Global recommendations on physical activity for health. 2010, Geneva, Switzerland: WHO

    Google Scholar 

  3. U.S. Department of Health and Human Services: 2008 Physical Activity Guidelines for Americans. 2008, Washington, DC, U.S.A.: U.S. Department of Health and Human Services

    Google Scholar 

  4. European Commission: EU physical activity guidelines. Recommended policy actions in support of health-enhancing physical activity. http://ec.europa.eu/youth/news/eu-physical-activity-guidelines_en.htm.

  5. Ministry of Health, Labour, and Welfare of Japan: Exercise and Physical Activity Reference for Health Promotion 2006 (EPAR2006): physical activity, exercise, and physical fitness (English Ver.). 2007, http://www0.nih.go.jp/eiken/programs/pdf/epar2006.pdf.

    Google Scholar 

  6. Bauman A, Bull F, Chey T, Craig CL, Ainsworth BE, Sallis JF, Bowles HR, Hagstromer M, Sjostrom M, Pratt M: The International Prevalence Study on Physical Activity: results from 20 countries. Int J Behav Nutr Phys Act. 2009, 6 (1): 21-10.1186/1479-5868-6-21.

    Article  Google Scholar 

  7. Guthold R, Ono T, Strong KL, Chatterji S, Morabia A: Worldwide variability in physical inactivity a 51-country survey. Am J Prev Med. 2008, 34 (6): 486-494. 10.1016/j.amepre.2008.02.013.

    Article  Google Scholar 

  8. Trost SG, Owen N, Bauman AE, Sallis JF, Brown W: Correlates of adults’ participation in physical activity: review and update. Med Sci Sports Exerc. 2002, 34 (12): 1996-2001. 10.1097/00005768-200212000-00020.

    Article  Google Scholar 

  9. Bauman AE, Reis RS, Sallis JF, Wells JC, Loos RJ, Martin BW: Correlates of physical activity: why are some people physically active and others not?. Lancet. 2012, 380 (9838): 258-271. 10.1016/S0140-6736(12)60735-1.

    Article  Google Scholar 

  10. Heath GW, Parra DC, Sarmiento OL, Andersen LB, Owen N, Goenka S, Montes F, Brownson RC: Evidence-based intervention in physical activity: lessons from around the world. Lancet. 2012, 380 (9838): 272-281. 10.1016/S0140-6736(12)60816-2.

    Article  Google Scholar 

  11. Guide to Community Preventive Services: Campaigns and informational approaches to increase physical activity: community-wide campaigns. http://www.thecommunityguide.org/pa/campaigns/community.html.

  12. Kahn EB, Ramsey LT, Brownson RC, Heath GW, Howze EH, Powell KE, Stone EJ, Rajab MW, Corso P: The effectiveness of interventions to increase physical activity. A systematic review. Am J Prev Med. 2002, 22 (4 Suppl): 73-107.

    Article  Google Scholar 

  13. Beaudoin CE, Fernandez C, Wall JL, Farley TA: Promoting healthy eating and physical activity short-term effects of a mass media campaign. Am J Prev Med. 2007, 32 (3): 217-223. 10.1016/j.amepre.2006.11.002.

    Article  Google Scholar 

  14. Luepker RV, Murray DM, Jacobs DR, Mittelmark MB, Bracht N, Carlaw R, Crow R, Elmer P, Finnegan J, Folsom AR, Grimm R, Hannan PJ, Jeffrey R, Lando H, McGovern P, Mullis R, Perry CL, Pechacek T, Pirie P, Sprafka JM, Weisbrod R, Blackburn H: Community education for cardiovascular disease prevention: risk factor changes in the Minnesota Heart Health Program. Am J Public Health. 1994, 84 (9): 1383-1393. 10.2105/AJPH.84.9.1383.

    Article  CAS  Google Scholar 

  15. Reger-Nash B, Bauman A, Booth-Butterfield S, Cooper L, Smith H, Chey T, Simon KJ: Wheeling walks: evaluation of a media-based community intervention. Fam Community Health. 2005, 28 (1): 64-78. 10.1097/00003727-200501000-00009.

    Article  Google Scholar 

  16. Reger-Nash B, Bauman A, Cooper L, Chey T, Simon KJ, Brann M, Leyden KM: WV Walks: replication with expanded reach. J Phys Act Health. 2008, 5 (1): 19-27.

    Google Scholar 

  17. Renger R, Steinfelt V, Lazarus S: Assessing the effectiveness of a community-based media campaign targeting physical inactivity. Fam Community Health. 2002, 25 (3): 18-30. 10.1097/00003727-200210000-00006.

    Article  Google Scholar 

  18. Tudor-Smith C, Nutbeam D, Moore L, Catford J: Effects of the Heartbeat Wales programme over five years on behavioural risks for cardiovascular disease: quasi-experimental comparison of results from Wales and a matched reference area. BMJ. 1998, 316 (7134): 818-822. 10.1136/bmj.316.7134.818.

    Article  CAS  Google Scholar 

  19. Wray RJ, Jupka K, Ludwig-Bell C: A community-wide media campaign to promote walking in a Missouri town. Prev Chronic Dis. 2005, 2 (4): A04.

    Google Scholar 

  20. Young DR, Haskell WL, Taylor CB, Fortmann SP: Effect of community health education on physical activity knowledge, attitudes, and behavior. The Stanford Five-City Project. Am J Epidemiol. 1996, 144 (3): 264-274. 10.1093/oxfordjournals.aje.a008921.

    Article  CAS  Google Scholar 

  21. De Cocker KA, De Bourdeaudhuij IM, Brown WJ, Cardon GM: Effects of “10,000 steps Ghent”: a whole-community intervention. Am J Prev Med. 2007, 33 (6): 455-463. 10.1016/j.amepre.2007.07.037.

    Article  Google Scholar 

  22. Baker PR, Francis DP, Soares J, Weightman AL, Foster C: Community wide interventions for increasing physical activity. Cochrane Database Syst Rev. 2011, 4: CD008366

    Google Scholar 

  23. Nelson ME, Rejeski WJ, Blair SN, Duncan PW, Judge JO, King AC, Macera CA, Castaneda-Sceppa C: Physical Activity and Public Health in Older Adults. Recommendation From the American College of Sports Medicine and the American Heart Association. Circulation. 2007, 116 (9): 1094-1105.

    Article  Google Scholar 

  24. Hayden JA, van Tulder MW, Tomlinson G: Systematic review: strategies for using exercise therapy to improve outcomes in chronic low back pain. Ann Intern Med. 2005, 142 (9): 776-785. 10.7326/0003-4819-142-9-200505030-00014.

    Article  Google Scholar 

  25. American Geriatrics Society Panel on Exercise and Osteoarthritis: Exercise prescription for older adults with osteoarthritis pain: consensus practice recommendations. A supplement to the AGS Clinical Practice Guidelines on the management of chronic pain in older adults. J Am Geriatr Soc. 2001, 49 (6): 808-823.

    Article  Google Scholar 

  26. Roddy E, Zhang W, Doherty M: Aerobic walking or strengthening exercise for osteoarthritis of the knee? A systematic review. Ann Rheum Dis. 2005, 64 (4): 544-548. 10.1136/ard.2004.028746.

    Article  CAS  Google Scholar 

  27. Zhang W, Moskowitz RW, Nuki G, Abramson S, Altman RD, Arden N, Bierma-Zeinstra S, Brandt KD, Croft P, Doherty M, Dougados M, Hochberg M, Hunter DJ, Kwoh K, Lohmander LS, Tugwell P: OARSI recommendations for the management of hip and knee osteoarthritis, Part II: OARSI evidence-based, expert consensus guidelines. Osteoarthritis Cartilage. 2008, 16 (2): 137-162. 10.1016/j.joca.2007.12.013.

    Article  CAS  Google Scholar 

  28. Woolf AD, Pfleger B: Burden of major musculoskeletal conditions. Bull World Health Organ. 2003, 81 (9): 646-656.

    Google Scholar 

  29. Japanese Ministry of Health and Welfare: Comprehensive Survey of Living Conditions of the People on Health and Welfare 2007 (in Japanese). http://www.wam.go.jp/wamappl/bb14GS50.nsf/vAdmPBigcategory40/5D7C0BC463105079492574C100019893?OpenDocument.

  30. CDC: Arthritis as a potential barrier to physical activity among adults with heart disease--United States, 2005 and 2007. MMWR Morb Mortal Wkly Rep. 2009, 58 (7): 165-169.

    Google Scholar 

  31. Campbell MK, Elbourne DR, Altman DG: CONSORT statement: extension to cluster randomised trials. BMJ. 2004, 328 (7441): 702-708. 10.1136/bmj.328.7441.702.

    Article  Google Scholar 

  32. American Academy of Orthopaedic Surgeons: Treatment of osteoarthritis of the knee (non-arthroplasty). 2008, http://www.aaos.org/research/guidelines/guidelineoaknee.asp.

    Google Scholar 

  33. Ettinger WH, Burns R, Messier SP, Applegate W, Rejeski WJ, Morgan T, Shumaker S, Berry MJ, O’Toole M, Monu J, Craven T: A randomized trial comparing aerobic exercise and resistance exercise with a health education program in older adults with knee osteoarthritis. The Fitness Arthritis and Seniors Trial (FAST). JAMA. 1997, 277 (1): 25-31. 10.1001/jama.1997.03540250033028.

    Article  Google Scholar 

  34. Kotler P, Lee N: Social maketing: influencing behaviors for good. 2008, Thousand Oaks, CA: Sage, 3

    Google Scholar 

  35. National Social Marketing Centre. http://www.nsmcentre.org.uk/.

  36. CDC: Gateway to Health Communication & Social Marketing Practice. http://www.cdc.gov/healthcommunication/.

  37. CDC: CDCynergy Social Marketing Edition. http://www.orau.gov/cdcynergy/soc2web/default.htm.

  38. Storey JD, Saffitz GB, Rimon JG: Social marketing. Health behavior and health education: theory, research, and practice. Edited by: Glanz K, Rimer BK, Viswanath K. 2008, San Francisco, CA: Jossey-Bass, 435-464. 4

    Google Scholar 

  39. Donovan RJ, Egger G, Francas M: TARPARE: a method for selecting target audiences for public health interventions. Aust N Z J Public Health. 1999, 23 (3): 280-284. 10.1111/j.1467-842X.1999.tb01256.x.

    Article  CAS  Google Scholar 

  40. Prochaska JO, DiClemente CC: Stages and processes of self-change of smoking: toward an integrative model of change. J Consult Clin Psychol. 1983, 51 (3): 390-395.

    Article  CAS  Google Scholar 

  41. Kamada M, Kitayuguchi J, Shiwaku K, Inoue S, Okada S, Mutoh Y: Differences in association of walking for recreation and for transport with maximum walking speed in an elderly Japanese community population. J Phys Act Health. 2011, 8 (6): 841-847.

    Google Scholar 

  42. Cavill N, Bauman A: Changing the way people think about health-enhancing physical activity: do mass media campaigns have a role?. J Sports Sci. 2004, 22 (8): 771-790. 10.1080/02640410410001712467.

    Article  Google Scholar 

  43. Bravata DM, Smith-Spangler C, Sundaram V, Gienger AL, Lin N, Lewis R, Stave CD, Olkin I, Sirard JR: Using pedometers to increase physical activity and improve health: a systematic review. JAMA. 2007, 298 (19): 2296-2304. 10.1001/jama.298.19.2296.

    Article  CAS  Google Scholar 

  44. Boutron I, Guittet L, Estellat C, Moher D, Hrobjartsson A, Ravaud P: Reporting methods of blinding in randomized trials assessing nonpharmacological treatments. PLoS Med. 2007, 4 (2): e61-10.1371/journal.pmed.0040061.

    Article  Google Scholar 

  45. IPAQ: International Physical Activity Questionnaire. 2008, http://www.ipaq.ki.se/ipaq.htm.

    Google Scholar 

  46. Kumahara H, Schutz Y, Ayabe M, Yoshioka M, Yoshitake Y, Shindo M, Ishii K, Tanaka H: The use of uniaxial accelerometry for the assessment of physical-activity-related energy expenditure: a validation study against whole-body indirect calorimetry. Br J Nutr. 2004, 91 (2): 235-243. 10.1079/BJN20031033.

    Article  CAS  Google Scholar 

  47. Rafamantanantsoa HH, Ebine N, Yoshioka M, Higuchi H, Yoshitake Y, Tanaka H, Saitoh S, Jones PJ: Validation of three alternative methods to measure total energy expenditure against the doubly labeled water method for older Japanese men. J Nutr Sci Vitaminol (Tokyo). 2002, 48 (6): 517-523. 10.3177/jnsv.48.517.

    Article  Google Scholar 

  48. Dixon JS, Bird HA: Reproducibility along a 10 cm vertical visual analogue scale. Ann Rheum Dis. 1981, 40 (1): 87-89. 10.1136/ard.40.1.87.

    Article  CAS  Google Scholar 

  49. Wijnhoven HA, de Vet HC, Picavet HS: Explaining sex differences in chronic musculoskeletal pain in a general population. Pain. 2006, 124 (1–2): 158-166.

    Article  Google Scholar 

  50. Sanderson BK, Foushee HR, Bittner V, Cornell CE, Stalker V, Shelton S, Pulley L: Personal, social, and physical environmental correlates of physical activity in rural African-American women in Alabama. Am J Prev Med. 2003, 25 (3 Suppl 1): 30-37.

    Article  Google Scholar 

  51. Sternfeld B, Ainsworth BE, Quesenberry CP: Physical activity patterns in a diverse population of women. Prev Med. 1999, 28 (3): 313-323. 10.1006/pmed.1998.0470.

    Article  CAS  Google Scholar 

  52. Kamada M, Kitayuguchi J, Inoue S, Kamioka H, Mutoh Y, Shiwaku K: Environmental correlates of physical activity in driving and non-driving rural Japanese women. Prev Med. 2009, 49 (6): 490-496. 10.1016/j.ypmed.2009.09.014.

    Article  Google Scholar 

  53. Grandes G, Sanchez A, Montoya I, Ortega Sanchez-Pinilla R, Torcal J: Two-year longitudinal analysis of a cluster randomized trial of physical activity promotion by general practitioners. PLoS One. 2011, 6 (3): e18363-10.1371/journal.pone.0018363.

    Article  CAS  Google Scholar 

  54. Buchbinder R, Jolley D, Wyatt M: Population based intervention to change back pain beliefs and disability: three part evaluation. BMJ. 2001, 322 (7301): 1516-1520. 10.1136/bmj.322.7301.1516.

    Article  CAS  Google Scholar 

  55. Glasgow RE, Vogt TM, Boles SM: Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999, 89 (9): 1322-1327. 10.2105/AJPH.89.9.1322.

    Article  CAS  Google Scholar 

  56. Sasakawa Sports Foundation: Sports White Paper. 2006, Tokyo: Sasakawa Sports Foundation, in Japanese

    Google Scholar 

  57. Siegel PZ, Brackbill RM, Heath GW: The epidemiology of walking for exercise: implications for promoting activity among sedentary groups. Am J Public Health. 1995, 85 (5): 706-710. 10.2105/AJPH.85.5.706.

    Article  CAS  Google Scholar 

  58. Bopp M, Wilcox S, Oberrecht L, Kammermann S, McElmurray CT: Correlates of strength training in older rural African American and Caucasian women. Women Health. 2004, 40 (1): 1-20. 10.1300/J013v40n01_01.

    Article  Google Scholar 

  59. Reeves MM, Marshall AL, Owen N, Winkler EA, Eakin EG: Measuring physical activity change in broad-reach intervention trials. J Phys Act Health. 2010, 7 (2): 194-202.

    Google Scholar 

  60. Edwards PJ, Roberts I, Clarke MJ, Diguiseppi C, Wentz R, Kwan I, Cooper R, Felix LM, Pratap S: Methods to increase response to postal and electronic questionnaires. Cochrane Database Syst Rev. 2009, 3: MR000008

    Google Scholar 

  61. World Health Organization (WHO): Health Promotion Evaluation: Recommendations to Policymakers. Report of the WHO European Working Group on Health Promotion Evaluation. 1998, Copenhagen, Denmark: WHO

    Google Scholar 

  62. Rosen L, Manor O, Engelhard D, Zucker D: In defense of the randomized controlled trial for health promotion research. Am J Public Health. 2006, 96 (7): 1181-1186. 10.2105/AJPH.2004.061713.

    Article  Google Scholar 

Download references

Acknowledgements

This study was supported by a Grant-in-aid from the Ministry of Health, Labour and Welfare of Japan (Comprehensive Research on Prevention of Cardiovascular Diseases and Other Lifestyle Related Diseases: H20-Junkankitou-Ippan-001). The funding body did not have a role in study design, intervention, data collection and analysis, decision to publish, or preparation of the manuscript.

We deeply appreciate the cooperation of the staff members and all other people involved in this study. We are grateful for the generous assistance provided by Yoshiteru Mutoh, Sang-Jun Park, Hyuntae Park, Koichiro Oka, Yoshinori Kitabatake, Ryosuke Shigematsu, Yoshio Nakata, Hiroyasu Okuizumi, Yuzuru Matsui, and Yuji Uchio.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Masamitsu Kamada.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

MK conceptualized and designed the study, supervised all aspects of its implementation, performed the data analysis, and wrote the brief. JK assisted with the intervention and data collection and analysis. YI, KH, SO, and HK helped plan the intervention and evaluation of the campaign and oversee their implementation. HN served as the biostatistician and performed the data analysis. SI and KS collaborated on all aspects of the study and provided scientific review of the study. All the authors interpreted the findings and reviewed the drafts of the article. All authors read and approved the final manuscript.

Electronic supplementary material

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Authors’ original file for figure 2

Authors’ original file for figure 3

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Kamada, M., Kitayuguchi, J., Inoue, S. et al. A community-wide campaign to promote physical activity in middle-aged and elderly people: a cluster randomized controlled trial. Int J Behav Nutr Phys Act 10, 44 (2013). https://doi.org/10.1186/1479-5868-10-44

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1479-5868-10-44

Keywords