Skip to main content

Validation of a previous day recall for measuring the location and purpose of active and sedentary behaviors compared to direct observation

Abstract

Purpose

Gathering contextual information (i.e., location and purpose) about active and sedentary behaviors is an advantage of self-report tools such as previous day recalls (PDR). However, the validity of PDR’s for measuring context has not been empirically tested. The purpose of this paper was to compare PDR estimates of location and purpose to direct observation (DO).

Methods

Fifteen adult (18–75 y) and 15 adolescent (12–17 y) participants were directly observed during at least one segment of the day (i.e., morning, afternoon or evening). Participants completed their normal daily routine while trained observers recorded the location (i.e., home, community, work/school), purpose (e.g., leisure, transportation) and whether the behavior was sedentary or active. The day following the observation, participants completed an unannounced PDR. Estimates of time in each context were compared between PDR and DO. Intra-class correlations (ICC), percent agreement and Kappa statistics were calculated.

Results

For adults, percent agreement was 85% or greater for each location and ICC values ranged from 0.71 to 0.96. The PDR-reported purpose of adults’ behaviors were highly correlated with DO for household activities and work (ICCs of 0.84 and 0.88, respectively). Transportation was not significantly correlated with DO (ICC = -0.08). For adolescents, reported classification of activity location was 80.8% or greater. The ICCs for purpose of adolescents’ behaviors ranged from 0.46 to 0.78. Participants were most accurate in classifying the location and purpose of the behaviors in which they spent the most time.

Conclusions

This study suggests that adults and adolescents can accurately report where and why they spend time in behaviors using a PDR. This information on behavioral context is essential for translating the evidence for specific behavior-disease associations to health interventions and public policy.

Background

Currently, a modest percentage of Americans are meeting physical activity guidelines [1] and the majority of one’s time is spent in sedentary behaviors [2]. There is strong evidence that an insufficient amount of moderate-to-vigorous physical activity (MVPA) is associated with increased risk of mortality, cardiovascular disease, type 2 diabetes and some cancers [3]. There is increasing evidence that high levels of sedentary behavior are associated with negative health outcomes [4, 5]. Therefore, interventions are needed to improve physical activity levels and decrease sedentary behavior [6]. We spend time each day in many different behaviors and our choices reflect our actions and inactions in response to both internal and external cues [7]. Accordingly, theories of health behavior, such as the socio-ecological model [8, 9] and dual-process theory [10] consider the reciprocal relationships between the individual and their physical and social environment(s) as important determinants of behavior. Here we operationally define behavioral context as a combination of the location (where) and purpose (why) behavior is taking place. In order to design effective interventions and inform public policy, measurement tools that quantify specific physically active and sedentary behaviors within the relevant behavioral contexts are needed.

Current technologies can provide an objective assessment of the context of active and sedentary behaviors (e.g. Geographic information systems (GIS) or the SenseCam) but are relatively costly and require time-intensive data coding and processing [11, 12]. Ecological momentary assessment methods have also been employed to gather contextual information about physical activity [13, 14] but this method is less efficient for gathering estimates of total amounts of active or sedentary time over the entire day. Short-term recalls may be a feasible and valuable method to gather contextual information about active and sedentary behaviors [1519]. We recently demonstrated the validity of a Previous Day Recall (PDR) in estimating active and sedentary time [15]. However, while our report suggests that the PDR provides accurate estimates of total active and sedentary time (hrs/d) compared to the activPAL [15], the accuracy of the PDR for classifying the context in which the activities occurred (i.e., location and purpose) has not been studied. Such details allow for the mapping of human activities to specific behavioral settings relevant to social ecological models of health behavior [8, 9]. PDRs may be particularly valuable in studies understanding where and why activity-related behaviors occur. The objective of this report is to examine the validity of the PDR for classifying the location (e.g., community, school/work) and purpose (e.g. home activity, transportation) of behavior compared to a criterion of direct observation. In addition, the accuracy of the PDR for classifying time spent in active and sedentary behaviors within each context was examined.

Methods

The study population and recruitment processes have been previously described [15]. Briefly, the study population included a sub-sample of participants that provided reliable recalls in an earlier investigation of physical activity/sedentary behavior assessment methods development (n = 219) in adolescents (12–17 yrs, N = 117) and adults (18–71 yrs, N = 102) recruited by the University of Massachusetts (Amherst, MA) and Vanderbilt University Medical Center (Nashville, TN). A comparison of the sub-sample to the overall study sample is in Table 1. In a seven day period, study participants completed three unannounced PDRs and wore ActiGraph and activPAL activity monitors [15]. Participants enrolled at the Amherst study site (n = 91) were offered the opportunity to participate in the direct observation sub-study, and 15 adolescents and 15 adults consented to the study. Adult participants and parents of the adolescents completed an informed consent document and adolescents provided assent. All study activities and documents were approved by the Institutional Review Boards at the University of Massachusetts. These participants agreed to be directly observed by a trained research assistant as they went about their normal daily activities. An unannounced PDR was completed on the day following observation.

Table 1 Descriptive characteristics of population and segment durations

Direct observation protocol

Observers completed both didactic and experiential training. The didactic portion was administered by the direct observation study leader (KL) and was comprised of a face-to-face session that included a general orientation to the direct observation method as well as technical orientation to the electronic observation system. The experiential portion consisted of face-to-face practice training using a training video as well as 10 or more hours practice observing individuals in a free-living environment. Before data collection was initiated all observers had to demonstrate acceptable accuracy (>90%) in coding active and sedentary behaviors in the video, and the location and purpose of the behaviors in the text examples. A similar direct observation system from our group was recently shown to be highly accurate and precise compared to indirect calorimetry [20].

Participants were directly observed during at least one segment of the day (i.e., morning, afternoon or evening) and up to all three segments depending on participant availability. These segments were consistent with the PDR segments of the day. The morning segment was the time from arising from bed for the day until lunchtime (or 12:00 PM if no lunch). For the morning segment, observers arrived 30 minutes after the participant got out of bed to allow privacy to get dressed/undressed. The afternoon segment was the period during lunch (or 12:00 PM) until dinner (or 6:00 PM if no dinner). Observers arrived 30 minutes before the anticipated lunch time, began observing once they began lunch and continued until the participant ate dinner. The evening segment was the time after dinner until getting into bed for the night. Observers arrived 30 minutes before the anticipated dinner time and started observing once the participant was eating dinner. They were observed until 30 minutes before they planned to go to bed or until 10:00 PM.

During the observation period, participants were instructed to complete their normal daily routine and avoid interacting with the observer. The observer was instructed not to initiate conversation with the participant, to maintain a comfortable distance and to mimic the participant’s behavior when possible (i.e., sitting when the participant was sitting). The observer used a hand-held personal digital assistant programmed with custom software (Noldus Inc., Wageningen, Netherlands) to record participant behavior. Direct observation was conducted using continuous focal sampling where each activity change is coded, regardless of the duration between activities. For this study, every time behavior changed, the observer recorded the location, purpose and body-position/intensity of the activity. To minimize the amount of coding required, the purpose and body-position/intensity were recoded every time the activity/intensity changed, but the location was only recoded when it changed. “Private Time” was coded if a participant requested private time (e.g. to use the bathroom or change clothes). These instances were deleted when the data were processed. The coding scheme is described below and corresponds to the same classification approach used in the PDR.

Location is the physical domain where a behavior takes place

  1. 1.

    Home: Activities done on “household” property, either inside or outside the house. Activities were coded as indoor or outdoor, but were combined for analysis.

  2. 2.

    Work/School: Activities done at the work site (for pay), or on school grounds.

  3. 3.

    Community: Activities done away from home, but not at work or school locations.

Purpose of the activity is meant to describe why the participant is doing the activity. The category definitions are adapted from those of the American Time Use Survey [21] and the major headings from the Compendium of Physical Activities [22]. Some categories were merged to assist observers in coding and ensure sufficient sample size within each purpose. The same behavior/activity type could be coded with a different purpose, depending on the intention. For example, using a computer to shop would be considered leisure time, while using a computer to write a manuscript would be considered work. In addition, the purpose does not designate the location of the activity. For example, “office work” can take place in the community (working on a computer in the library), at home (sitting at computer) or at work (filing papers).

  1. 1.

    Household activities: This category is the combination of the following three purposes. They were combined after data collection due to low numbers.

    1. a.

      Household chores: These activities are done by a person to maintain a household or care for another individual (i.e., elder or child). Examples include chores, meal preparation, child-care.

    2. b.

      Self-Care: Includes grooming (bathing or dressing), health-related self-care, eating and drinking [21].

    3. c.

      Lawn and garden: Activities that were related to maintaining outdoor space. Examples include gardening, raking, trimming, farming, or mowing the lawn.

  2. 2.

    Work: Includes time spent working, engaging in income-generating activities (outside ones job) and looking for work [21]. The observers could code this as the following two options.

    1. a)

      Office work: This is work completed in an indoor setting. Examples include filing papers, working at computer (not including computer games).

    2. b)

      Physical work: This category included activities that were for the purpose of work that involved manual labor. Examples include painting, construction, plumbing, electrical work, or fixing floor.

  3. 3.

    Education: This category includes activities related to school or university including research, homework and taking classes. This was only an option if the participant was a student.

  4. 4.

    Transportation: This category includes activities for the purpose of getting from one place to the next. For example, riding a bus, walking, bicycling, driving or riding in a car.

  5. 5.

    Leisure: Includes sports, recreation, socializing, personal interest activities (e.g., going to a museum or concert), playing games, watching television, listening to music and other leisure activities.

  6. 6.

    Miscellaneous: This category is for activities for which the observer was unclear of the purpose. They were instructed to make a note describing the activity for it to be recoded by PI (if appropriate) or left as miscellaneous.

Body position and intensity level were collected using the protocol from Kozey-Keadle et al. [23] and combined into the broader categories below.

  1. 1.

    Sedentary behaviors: Any behavior that was done while sitting, reclining, or lying down and that did not require substantial energy expenditure (typically < 1.5 metabolic equivalents [METS]) [24].

  2. 2.

    Physically active behaviors: Activities preformed while upright including standing still and moving. Exercise, sports and active recreation pursuits were classified as active regardless of body position (i.e., biking).

Previous Day recall

The recall employed was an updated version of an earlier recall instrument [25, 26], now called the PDR. In addition to physical activity, the instrument now gathers more detailed information about sedentary behaviors and explicitly classifies behaviors by their location and purpose. A detailed description of the PDR is provided in a previous paper [15]. Interviewers were certified to complete the PDRs using a standard training protocol composed of didactic and experiential training sessions designed to develop interviewing skills, expertise in interacting with the computer interface, and the integration of these two skills. During the study, interviewers led participants chronologically through the previous day (midnight to midnight) using a semi-structured interview based on methods developed and refined for the 7-Day Physical Activity Recall [27]. Interviewers gathered information about specific active and sedentary behaviors reported in three segments of the recall day (i.e., morning, afternoon, evening). Individual behaviors lasting at least five minutes in a given time-period were recorded/coded and the activity duration of the activities was entered directly into a database. Each behavior reported was coded as physically active or sedentary using reported body position and activity type (i.e., all exercise and sports pursuits were classified as “active”). The location and purpose of behaviors reported was classified as described above. Each activity in the database was derived from the Compendium of Physical Activities, along with the associated MET values [22]. To summarize the recall data, we summed the duration estimates of the behaviors for overall time reported by location and purpose and for both sedentary and active behaviors.

Data synchronization

The PDR data for specific behaviors were not time stamped, so the times reported at the beginning and end of each segment of the day were used to synchronize the PDR and direct observation data for each segment of observation. The PDRs were completed on the day after the direct observation day and, after the recall was complete, the interviewers asked participants about activities they did when the observer was not present (i.e., before observer arrived or after they left) within the targeted segment. The activities the participant reported completing while the observer was not present were manually removed from the file and verified by a second researcher (SKK, AH or CM). For example, if the participant reported showering for 20 minutes before the observer arrived then 20 minutes of self-care was removed from the PDR summary file so that the length of the observation was the same as the PDR. There were two instances that could not be adjudicated (difference between PDR and direct observation was > 1 hour) because the PDR was unreliable. These PDR estimates remained in the analytic dataset.

Statistical evaluation

Differences in age, BMI and sedentary time between the direct observation sample and the overall study sample were tested using a t-test with P < 0.05 indicating significant differences. For each location and purpose, PDR estimates were compared to direct observation for the total time (regardless of intensity) and then separately for active and sedentary behaviors. To do this, three statistical approaches were used. First, bias was estimated by subtracting PDR from direct observation values using repeated measures mixed effects models to account for multiple segments/observations for some individuals. To assess statistical significance of the bias 95% confidence intervals (CI) were used. Second, classification accuracy between measures was compared using percent agreement and the Kappa statistic with McNemar’s Test for statistical significance. The following interpretations are generally assigned to Kappa values (0 is chance agreement; 0.01-0.20 is slight agreement, 0.21-0.4 is fair agreement; 0.41-0.60 is moderate, 0.61-0.80 is substantial and 0.81-1.0 is strong agreement) [28]. Third, we used ICC to evaluate the level of agreement between the duration estimates using a two-way analysis of variance model. For all analyses, the N was defined as the number of segments where a participant spent at least one minute in a particular location/purpose according to direct observation. For example, if 12/26 participants spent time in the community, bias estimates for community only included those 12 observations. We used this more conservative approach because some activities were only completed by a few participants (Table 2), and because including all individuals, even if they did not complete the activity as per direct observation would make the bias artificially small (bias would be 0 since both direct observation and PDR would be 0). Similarly, mean values of time spent in each location/purpose (Table 2) are only for those participants who spent at least one minute in that location/purpose according to direct observation.

Table 2 Comparison of time spent in activity location and purpose using previous day recall and direct observation

Results

The adolescent participants in the current analysis were similar in age, BMI, sedentary time and sex distribution to the larger sample (Table 1). The adult participants in the current analysis were slightly younger than the larger convenience sample of community-living adults (P < 0.05), but were similar in BMI, sedentary time and sex distribution (Table 1). Participant characteristics and average time in each segment of the day for PDR and direct observation are shown in Table 1.

Figure 1 shows the percent of observed time spent in each location and purpose. For adults, there were 27 segments observed and the segments lasted 226.9 min on average. The majority of observed time was spent at work/school (48%), followed by home (34%), and community (18%) locations. For purpose, adults spent the most time doing work (45%), household activities (23%), and leisure activities (21%). Adolescents were observed for 26 segments that averaged 220.9 min. Most of the observed time was spent at home (54%) followed by time in the community (39%), and only 8% was spent at work/school. Adolescents spent most of their time in leisure activities (67%), followed by household activities (16%). Several categories had five or fewer observations. For completeness we report all results in our tables, but given the likely imprecision in these estimates for categories with 5 or fewer observations we do not interpret these results.

Figure 1
figure 1

Description of time in each location and purpose according to direct observation. Note: Adults N = 27 segments, average observation time was mean (SD) 226.9 (93.4) min per segment, adolescents N = 26 segments, average observation time was 220.9 (65.8) min per segment.

Total time reported, by location and purpose

For adults, the comparisons between direct observation and PDR for each location and purpose are shown Table 2. All estimates of bias and ICC are presented as value (95% CI) unless otherwise indicated. Adults reported 28.6 (6.9 to 50.3) min more of total time on the PDR than direct observation time. For activity location the percent agreement was 85% or greater for each location and Kappa values were moderate to strong, ranging from 0.58 to 0.85. There was a non-significant positive bias for the work/school and community locations and ICCs in each location were significant and relatively high (ICC ≥ 0.71). There was no statistically significant bias between PDR and direct observation for any purpose. Reported classification of activity purpose between the two methods was 74% or greater. Kappa statistics ranged from fair (0.32) for leisure activities to substantial agreement in transportation (0.74). The ICC for purpose among adults was lowest for education (0.12 [-0.29 to 0.48]) and highest for household activities (0.96 [0.91 to 0.98]).

Adolescents reported 24.4 (10.5 to 38.2) min more on the PDR than direct observation (Table 2). For location, the percent agreement was 80% or greater for each location and Kappa values were substantial for the community (0.66), perfect for home (1.0), but only slight for work/school (0.20), where only 5 observations were available for analysis. There was a significant positive bias for the home location of 21.4 (2.8 to 40.0) min, but ICCs in each location were significant and relatively high (ICC ≥ 0.47). For the activity purposes there were no significant biases though the confidence intervals were very wide for leisure activities, which were overestimated by 40.4 (-1.1 to 82) min. Bias was smallest for transportation at 1.8 (-4.7 to 8.3) min. Reported classification of activity purpose revealed percent agreement that was 80% or greater and Kappas that ranged from 0.20 for education to 1.0 for leisure activities. The ICCs were all significant, ranging from 0.46 to 0.78.

Physically active and sedentary behaviors, by location and purpose

For adults, 59% (133.9 ± 76.0 min) of the observed time was spent sedentary and the remainder was spent in active behaviors (92.9 ± 63.4 min). The bias, percent agreement, Kappa and ICCs comparing direct observation and PDR by active and sedentary behaviors are shown in Table 3. There were no significant differences between PDR and direct observation estimates of active time at home (mean [95% CI]) (-1.6 [-11.5 to 8.3] min) and active time at work/school (5.3 [-12.9 to 23.5] min) and the percent agreement and Kappas were substantial for both locations. For community, the estimates of active time were similar between methods (5.7 [-7.8 to 19.2] min) and the percent agreement (74.1%) and Kappa (0.49) and were moderate, but the ICC was not statistically significant 0.28 (-0.12 to 0.59). For activity purpose, the bias was smallest for leisure time (0.1 [-20.0 to 20.2] min) and highest for work, with PDR estimating 8.3 (-12.8 to 29.4) min higher than direct observation. The percent agreement and Kappa were lowest for leisure activities (59.3% and 0.27) and highest for work (85.2% and 0.71). ICCs were moderate for home activity, work and leisure activities (0.51 to 0.88), but not for transportation (-0.08).

Table 3 Comparison of adults time spent in active and sedentary behaviors by location and purpose using previous day recall and direct observation

For sedentary behaviors by location, there was no significant bias, the Kappas were all substantial (0.67 to 0.78), percent agreement was between 85.2 and 88.9%, and ICCs were excellent, ranging from 0.87 to 0.92. For activity purpose, the bias was smallest for leisure time (0.1 min [-20.0 to 20.2] min) and highest for work, with PDR estimates 8.3 (-12.8 to 29.4) min higher than direct observation. Percent agreement ranged from 74.1% for leisure activities to 92.6% for transportation. The Kappas ranged from 0.36 for home activity (fair) to 0.83 for transportation (strong). The ICCs ranged from 0.58 (0.26 to 0.78) for home activity to 0.82 (0.64 to 0.91) for work (Table 3).

For adolescents, 63% (139.0 ± 63.8 min) of the observed time was spent sedentary and the remainder was spent in active behaviors (81.9 ± 47.6 min) (Table 4). The active time reported from PDR was not significantly different than direct observation for any location. For community, percent agreement was 84.6%, the Kappa was 0.57, and the ICC was 0.61 (0.31 to 0.80). For the home location, the percent agreement was 65.4%, the Kappa was low (0.20), and ICC was 0.62 (0.32 to 0.81). There were only five observations of active behavior in the work/school location. For activity purpose, there was a slight underestimation of time in active transportation by -2.5 (-4.6 to -0.3) min and no other statistically significant bias. Percent agreements ranged from 53.8% for transportation to 84.6% for leisure and the Kappas were slight-to-fair. The ICCs were all statistically significant except for work and educational activities, which were only completed in two and four segments, respectively.

Table 4 Comparison of adolescent’s time spent in active and sedentary behaviors by location and purpose using previous day recall and direct observation

For sedentary behaviors at home, the bias was significant (32.2 [20.4 to 44.1] min); however percent agreement and Kappa were 100% and 1.0, respectively, and the ICC was excellent 0.85 (0.25 to 0.95). There was no significant bias and both Kappas and ICCs were good to excellent for work/school and community locations. Sedentary leisure activities were overestimated by 37.0 (0.2 to 73.8) min and home activities were overestimated by 8.4 (1.5 to 15.2) min. The bias for the remaining activity purposes ranged from -0.6 to 4.4 min. For sedentary activity purpose, percent agreement ranged from 84.6 to 100%, the Kappas were between fair (0.26) and very strong (1.0), and ICCs ranged from 0.33 to 0.75, which were statistically significant (Table 4).

Discussion

In this study, adults accurately reported that they spent most of their time at work/school and doing office work, such as filing papers, desk work, and working at the computer. In contrast, adolescents most accurately reported their time out in the community and in leisure pursuits, such as watching television, talking with friends, or playing games. In general, participants were most accurate in classifying the location and purpose of the behaviors in which they spent the most time. Adults tended to report the location and purpose of their behavior more accurately than adolescents. This may be partially due to the more structured nature of adults activities (e.g., time at work) compared to leisure activities that were more commonly reported by adolescents. The accuracy in estimating location and purpose was similar for active and sedentary behaviors, with the exception of transportation where adult participants reported sedentary transport time more accurately than active transport time. Our study suggests that participants report the location of their activities with considerable accuracy and also report useful information about the purpose of behaviors, particularly those in which they spend the most time. To our knowledge, this is the first study to validate estimates of behavioral context for active and sedentary behaviors compared to a criterion measure of direct observation.

There are other methods available to gather location and purpose of physical activities and sedentary behaviors. Some questionnaires include contextual information to improve estimates of duration, intensity and frequency of physical activity or sedentary behavior [27, 29, 30]. Questionnaires typically ask about time domains of activity (e.g., transportation, household, leisure and occupation) and are often validated compared to an activity monitor. The domain specific constructs have not been routinely validated [31, 32], in part because of the absence of strong domain-specific criterion measures. As more research has focused on domain-specific associations, researchers may be interested in validating these specific constructs but it is challenging to do so. Some studies use a behavioral log as a criterion, where people record all activities to validate the questionnaire but this still relies on the participants record rather than an objective measure [29]. The gold-standard is direct observation, which is costly, time-intensive and logistically challenging. Other objective methods (described below) may be able to estimate location and purpose of activity and be used as a criterion measure in future studies.

Activity monitors used in combination with GIS and SenseCam technology objectively assess the context of active and sedentary behaviors. GIS systems have been used to explicitly link location-specific physical activity outcomes with attributes of the built environment (e.g., walkability) [3335]. While GIS is able to characterize where physical activity or sedentary behavior is taking place, this system cannot directly assess the purpose of the behavior. The SenseCam takes first-person pictures of the environment approximately every 20 seconds [36]. The pictures are manually annotated and classify the activity context into categories based on the Compendium of Physical Activities [12, 22, 37]. This information is combined with accelerometer data to estimate the purpose of active and sedentary behaviors and identify sedentary behaviors that were misclassified by an accelerometer [12, 37]. However, when attempting to classify free-living behavior, only 81% of episodes could be classified [37]. Both ethical (e.g., privacy) [38] and practical barriers (e.g., poor lighting) currently limit widespread application of this technology [11]. Further, both GIS and SenseCam require expensive equipment and time-intensive data processing, thus these methods may be less feasible for use in large-scale epidemiological studies. Ecological momentary assessment uses a cell phone platform to gather information about the context and affect within a naturalistic setting [14, 39]. This method provides valuable insight into what the participant is doing at an exact moment in time but it does not gather estimates of total time in either active or sedentary behaviors in a given context, as participants are prompted about their current activity multiple times throughout the day [13, 39, 40].

Understanding where and why active and sedentary behaviors take place can inform individual-level and environmental-level interventions targeting these behaviors [10, 41]. All of the tools described above have both strengths and weakness and the choice of instrument should be driven by the research question of interest. For example, if a researcher is increased in long-term activity (i.e., over the past year) then a questionnaire could be preferable to the PDR [30]. Studies examining trips to a particular green-space or trail may consider GPS. Conversely, if the researcher is interested in the location and purpose of active and sedentary behaviors that are currently performed by the individual, the PDR may be preferred. The short-term recall reduces challenges associated with recalling activity over a long prolonged period and gathers detailed information on behavioral context, posture and activity intensity [17, 19]. The current data demonstrate that the PDR is a valid tool for measuring location and purpose of physically active and sedentary behaviors compared to direct observation. Previous reports demonstrate its validity for estimating posture and intensity [15], with correlation coefficients that tended to be higher than those of questionnaires that rely upon long-term recall to estimate time spent in different behaviors [31]. The development of self-administered short-term recalls furthers the potential utility of this approach in large-scale epidemiologic studies [1618].

Despite efforts to match the direct observation time with specific PDR segments, there was still approximately 9% more time reported in the PDR than for direct observation. Compared to direct observation, adults reported 28.6 (6.9, 50.3) min more and adolescents reported 24.4 (10.5, 38.2) min more on the PDR. This difference may be due to errors recalling when a segment started and stopped. For example, if the observation started at 11:50 AM and the participant reported eating lunch at 12:00 PM, there will be 10 additional minutes in the observation period that were not reported in the PDR. Because the PDR used in this study was not time stamped, it was not possible to distinguish error due to incorrect recall of specific activity versus error due to difficulties remembering when the segment started and stopped. For the majority of the segments this was not a major problem, but there were two segments included in the dataset where participant reported the segment length was >1hour more than the observation time, increasing bias. This error recalling when a segment starts and stops may be an artifact of the current study design as it was necessary for us to perform direct observation during segments of the day due to the infeasibility of observing participants for 24 consecutive hours.

The use of direct observation as a criterion is an important strength of this study. The challenges of implementing criterion measures such as direct observation to assess location and purpose of activity may explain the paucity of data in this area. Furthermore, we matched the direct observation system to the PDR in order to ensure both our criterion measure and the PDR were measuring the same constructs. This study has other important strengths as well. The study participants completed a range of activities and the time distribution of activities was fairly consistent with how Americans typically spend their time outside of work/school activities [21, 42]. Inclusion of a range of locations and purpose supports the use of the PDR in future studies where participants may complete a variety of behaviors.

There are limitations of the current study that should be considered. Participants may recall their behavior better because they were being observed, though there is no way to empirically test this. To mitigate this effect, the participants were not told the PDR was going to be conducted the following day. The ICCs between direct observation and PDR active and sedentary time in this study (0.73 to 0.83) were similar to the correlations between activPAL and PDR estimates from previous work (0.75 to 0.81), with the exception of adolescent girls who had lower correlations (0.64 to 0.80) in the previous study [14]. This suggests, at least for active and sedentary time, that the accuracy of the recall was not substantially impacted by the observation session. Another limitation to our study is that the sample size was small and may not generalize to other populations. In particular, the sample was relatively young (range 12-62y) with a mean of 42y for adults. Future studies should assess the validity of the PDR with an older adult population. The sample did include a range of BMI (15.7 to 41.0 kg/m2) and a roughly equal distribution of males and females (Table 1). There are challenges for both the observer and the PDR when they complete multiple activities at the same time, which could have introduced error. The observers were instructed to code the purpose for the primary activity. For example, if a participant was eating while watching TV, this would be coded as “self-care”, until the participant stopped eating and then it would be considered leisure time. Similarly, for the recall participants were instructed to code the primary activity. If the participant reported doing two activities with substantially different energy expenditure (e.g., reading and walking on a treadmill) the activity with the higher energy expenditure was recorded.

For some locations and purposes, there were a very small number of participants who completed the activity. The accuracy for these less common physical behaviors could not be addressed. It is possible this reflects the actual portion of time individuals spend in these activities (e.g., adults doing educational activities) [42]. For other activities, such as time at work/school for adolescents, the low number of segments (n = 5) was largely due to safety and logistic concerns of the school district in having an outside observer in the classroom. Time at school makes up a large portion of an adolescent’s day and future studies should attempt to validate measurement tools within a school setting.

Conclusions

Our study suggests that adults and adolescents accurately report where (location) and why (purpose) they spent the majority of their time using a PDR. A range of methods are available to capture information about the location of human activities, including GPS and photographic monitoring, but few methods other than self-report gather details about the purpose of a given behavior. Our results support the idea that PDRs can provide important contextual details that can be used as stand-alone measures or in combination with objective measures. The ability to determine the location and purpose of active and sedentary behaviors may help inform behavioral theories, health interventions and public policy.

References

  1. Troiano RP, Berrigan D, Dodd KW, Masse LC, Tilert T, McDowell M: Physical activity in the United States measured by accelerometer. Med Sci Sports Exerc. 2008, 40: 181-188.

    Article  Google Scholar 

  2. Matthews CE, Chen KY, Freedson PS, Buchowski MS, Beech BM, Pate RR, Troiano RP: Amount of time spent in sedentary behaviors in the United States, 2003–2004. Am J Epidemiol. 2008, 167: 875-881. 10.1093/aje/kwm390.

    Article  Google Scholar 

  3. United States Department of Health and Human Services. 2008, http://www.health.gov/paguidelines/report.

  4. Matthews CE, George SM, Moore SC, Bowles HR, Blair A, Park Y, Troiano RP, Hollenbeck A, Schatzkin A: Amount of time spent in sedentary behaviors and cause-specific mortality in US adults. Am J Clin Nutr. 2012, 95: 437-445. 10.3945/ajcn.111.019620.

    Article  Google Scholar 

  5. Thorp AA, Owen N, Neuhaus M, Dunstan DW: Sedentary behaviors and subsequent health outcomes in adults a systematic review of longitudinal studies, 1996–2011. Am J Prev Med. 2011, 41: 207-215. 10.1016/j.amepre.2011.05.004.

    Article  Google Scholar 

  6. Kohl HW, Craig CL, Lambert EV, Inoue S, Alkandari JR, Leetongin G, Kahlmeier S, Lancet Physical Activity Series Working G: The pandemic of physical inactivity: global action for public health. Lancet. 2012, 380: 294-305. 10.1016/S0140-6736(12)60898-8.

    Article  Google Scholar 

  7. Levitis DA, Lidicker WZ, Freund G: Behavioural biologists don’t agree on what constitutes behaviour. Anim Behav. 2009, 78: 103-110. 10.1016/j.anbehav.2009.03.018.

    Article  Google Scholar 

  8. Owen N: Sedentary behavior: understanding and influencing adults’ prolonged sitting time. Prev Med. 2012, 55: 535-539. 10.1016/j.ypmed.2012.08.024.

    Article  Google Scholar 

  9. Owen N, Leslie E, Salmon J, Fotheringham MJ: Environmental determinants of physical activity and sedentary behavior. Exerc Sport Sci Rev. 2000, 28: 153-158.

    Google Scholar 

  10. Conroy DE, Maher JP, Elavsky S, Hyde AL, Doerksen SE: Sedentary behavior as a daily process regulated by habits and intentions. Health Psychol. 2013, 32: 1149-1157.

    Article  Google Scholar 

  11. Doherty AR, Hodges SE, King AC, Smeaton AF, Berry E, Moulin CJ, Lindley S, Kelly P, Foster C: Wearable cameras in health: the state of the art and future possibilities. Am J Prev Med. 2013, 44: 320-323. 10.1016/j.amepre.2012.11.008.

    Article  Google Scholar 

  12. Doherty AR, Kelly P, Kerr J, Marshall S, Oliver M, Badland H, Hamilton A, Foster C: Using wearable cameras to categorise type and context of accelerometer-identified episodes of physical activity. Int J Behav Nutr Phys Act. 2013, 10: 22-10.1186/1479-5868-10-22.

    Article  Google Scholar 

  13. Dunton GF, Atienza AA, Castro CM, King AC: Using ecological momentary assessment to examine antecedents and correlates of physical activity bouts in adults age 50+ years: a pilot study. Ann Behav Med. 2009, 38: 249-255. 10.1007/s12160-009-9141-4.

    Article  Google Scholar 

  14. Dunton GF, Whalen CK, Jamner LD, Floro JN: Mapping the social and physical contexts of physical activity across adolescence using ecological momentary assessment. Ann Behav Med. 2007, 34: 144-153. 10.1007/BF02872669.

    Article  Google Scholar 

  15. Matthews CE, Keadle SK, Sampson J, Lyden K, Bowles HR, Moore SC, Libertine A, Freedson PS, Fowke JH: Validation of a previous-day recall measure of active and sedentary behaviors. Med Sci Sports Exerc. 2013, 45: 1629-1638.

    Article  Google Scholar 

  16. Matthews CE, Moore SC, George SM, Sampson J, Bowles HR: Improving self-reports of active and sedentary behaviors in large epidemiologic studies. Exerc Sport Sci Rev. 2012, 40: 118-126.

    Google Scholar 

  17. Gomersall SR, Olds TS, Ridley K: Development and evaluation of an adult use-of-time instrument with an energy expenditure focus. J Sci Med Sport. 2011, 14: 143-148. 10.1016/j.jsams.2010.08.006.

    Article  Google Scholar 

  18. Ridley K, Olds TS, Hill A: The Multimedia Activity Recall for Children and Adolescents (MARCA): development and evaluation. Int J Behav Nutr Phys Act. 2006, 3: 10-10.1186/1479-5868-3-10.

    Article  Google Scholar 

  19. Nusser SM, Beyler NK, Welk GJ, Carriquiry AL, Fuller WA, King BM: Modeling errors in physical activity recall data. J Phys Act Health. 2012, 9 (Suppl 1): S56-S67.

    Google Scholar 

  20. Lyden K, Petruski N, Mix S, Staudenmayer J, Freedson P: Direct observation is a valid criterion for estimating physical activity and sedentary behavior. J Phys Act Health. 2013, [Epud ahead of print]

    Google Scholar 

  21. Bureau of Labor and Statisitics: American Time Use Survey. http://www.bls.gov/tus/.

  22. Ainsworth BE, Haskell WL, Herrmann SD, Meckes N, Bassett DR, Tudor-Locke C, Greer JL, Vezina J, Whitt-Glover MC, Leon AS: Compendium of physical activities: a second update of codes and MET values. Med Sci Sports Exerc. 2011, 43: 1575-1581.

    Article  Google Scholar 

  23. Kozey-Keadle S, Libertine A, Lyden K, Staudenmayer J, Freedson PS: Validation of wearable monitors for assessing sedentary behavior. Med Sci Sports Exerc. 2011, 43: 1561-1567.

    Article  Google Scholar 

  24. Sedentary Behaviour Research Network: Letter to the editor: standardized use of the terms “sedentary” and “sedentary behaviours”. Appl Physiol Nutr Metab. 2012, 37: 540-542. 10.1139/h2012-024.

    Article  Google Scholar 

  25. Calabro MA, Welk GJ, Carriquiry AL, Nusser SM, Beyler NK, Mathews CE: Validation of a computerized 24-hour physical activity recall (24PAR) instrument with pattern-recognition activity monitors. J Phys Act Health. 2009, 6: 211-220.

    Google Scholar 

  26. Ockene IS, Chiriboga DE, Stanek EJ, Harmatz MG, Nicolosi R, Saperia G, Well AD, Freedson P, Merriam PA, Reed G, et al: Seasonal variation in serum cholesterol levels: treatment implications and possible mechanisms. Arch Intern Med. 2004, 164: 863-870. 10.1001/archinte.164.8.863.

    Article  Google Scholar 

  27. Sallis JF: A collection of physical activity questionnaires for health-related research. Med Sci Sports Exerc. 1997, 29: S1-S205.

    Google Scholar 

  28. Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33: 159-174. 10.2307/2529310.

    Article  Google Scholar 

  29. Marshall AL, Miller YD, Burton NW, Brown WJ: Measuring total and domain-specific sitting: a study of reliability and validity. Med Sci Sports Exerc. 2010, 42: 1094-1102.

    Google Scholar 

  30. Friedenreich CM, Courneya KS, Neilson HK, Matthews CE, Willis G, Irwin M, Troiano R, Ballard-Barbash R: Reliability and validity of the past year total physical activity questionnaire. Am J Epidemiol. 2006, 163: 959-970. 10.1093/aje/kwj112.

    Article  Google Scholar 

  31. Helmerhorst HJ, Brage S, Warren J, Besson H, Ekelund U: A systematic review of reliability and objective criterion-related validity of physical activity questionnaires. Int J Behav Nutr Phys Act. 2012, 9: 103-10.1186/1479-5868-9-103.

    Article  Google Scholar 

  32. Shephard RJ: Limits to the measurement of habitual physical activity by questionnaires. Br J Sports Med. 2003, 37: 197-206. 10.1136/bjsm.37.3.197. discussion 206

    Article  Google Scholar 

  33. Thornton LE, Pearce JR, Kavanagh AM: Using Geographic Information Systems (GIS) to assess the role of the built environment in influencing obesity: a glossary. Int J Behav Nutr Phys Act. 2011, 8: 71-10.1186/1479-5868-8-71.

    Article  Google Scholar 

  34. Troped PJ, Oliveira MS, Matthews CE, Cromley EK, Melly SJ, Craig BA: Prediction of activity mode with global positioning system and accelerometer data. Med Sci Sports Exerc. 2008, 40: 972-978.

    Article  Google Scholar 

  35. Troped PJ, Wilson JS, Matthews CE, Cromley EK, Melly SJ: The built environment and location-based physical activity. Am J Prev Med. 2010, 38: 429-438. 10.1016/j.amepre.2009.12.032.

    Article  Google Scholar 

  36. Doherty AR, Moulin CJ, Smeaton AF: Automatically assisting human memory: a SenseCam browser. Memory. 2011, 19: 785-795. 10.1080/09658211.2010.509732.

    Article  Google Scholar 

  37. Kerr J, Marshall SJ, Godbole S, Chen J, Legge A, Doherty AR, Kelly P, Oliver M, Badland HM, Foster C: Using the SenseCam to improve classifications of sedentary behavior in free-living settings. Am J Prev Med. 2013, 44: 290-296. 10.1016/j.amepre.2012.11.004.

    Article  Google Scholar 

  38. Kelly P, Marshall SJ, Badland H, Kerr J, Oliver M, Doherty AR, Foster C: An ethical framework for automated, wearable cameras in health behavior research. Am J Prev Med. 2013, 44: 314-319. 10.1016/j.amepre.2012.11.006.

    Article  Google Scholar 

  39. Dunton GF, Intille SS, Wolch J, Pentz MA: Children’s perceptions of physical activity environments captured through ecological momentary assessment: a validation study. Prev Med. 2012, 55: 119-121. 10.1016/j.ypmed.2012.05.015.

    Article  Google Scholar 

  40. Dunton GF, Whalen CK, Jamner LD, Henker B, Floro JN: Using ecologic momentary assessment to measure physical activity during adolescence. Am J Prev Med. 2005, 29: 281-287. 10.1016/j.amepre.2005.07.020.

    Article  Google Scholar 

  41. Heath GW, Parra DC, Sarmiento OL, Andersen LB, Owen N, Goenka S, Montes F, Brownson RC, Lancet Physical Activity Series Working G: Evidence-based intervention in physical activity: lessons from around the world. Lancet. 2012, 380: 272-281. 10.1016/S0140-6736(12)60816-2.

    Article  Google Scholar 

  42. Tudor-Locke C, Johnson WD, Katzmarzyk PT: Frequently reported activities by intensity for U.S. adults: the American Time Use Survey. Am J Prev Med. 2010, 39: e13-e20. 10.1016/j.amepre.2010.05.017.

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to thank the research assistants who completed the direct observation and the study participants.

Funded by: R01 NR011477.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sarah Kozey Keadle.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

Conceived of experiment: SKK KL, PF, CM, data collection and statistical analysis: KL, AH, ER, SKK, CM, wrote the paper: SKK, KL CM, provided edits and comments SKK, AH, ER, KL, CM, JF, PF. All authors read and approved the final manuscript.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Authors’ original file for figure 2

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Cite this article

Keadle, S.K., Lyden, K., Hickey, A. et al. Validation of a previous day recall for measuring the location and purpose of active and sedentary behaviors compared to direct observation. Int J Behav Nutr Phys Act 11, 12 (2014). https://doi.org/10.1186/1479-5868-11-12

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1479-5868-11-12

Keywords