Introduction

Parent smartphone use has been associated with decreased responsiveness to children,1 fewer verbal and nonverbal interactions,2 and higher ratings of child externalizing behavior.3 However, existing studies are limited by use of brief (10–15 min) observations of parents using smartphones1,4 or rely on parent self-report,3 which may be biased by social desirability. In addition, self-report of smartphone use may be inaccurate due to the brief, intermittent ways users interact with mobile devices,5 which makes recall difficult.6

The purpose of this pilot study was to improve upon these measurement limitations by implementing a novel approach—passive mobile sensing—in order to objectively assess parent smartphone use over several days. Passive mobile sensing harnesses data already collected by mobile devices, such as application (“app”) or battery usage, and generates usage logs that are transmitted to cloud-based servers or can be emailed to research teams. This approach has promise for studying daily patterns of participant behavior,7 and has been used to document associations between higher iPhone usage and depression symptoms in adults;8 however, this method has not been used in research studies of parenting or child well-being. It is also a potential powerful research tool for studies examining mobile media use and health outcomes such as obesity and sleep, which have been linked to heavy media use in prior research.9

The aims of this pilot study were to: (1) test the feasibility and acceptability of passive sensing as a measure of smartphone use; (2) describe smartphone usage by parents of young children over the course of several days, including duration, checking frequency, and app content (e.g., social media, email); and (3) examine whether parents are accurate self-reporters of daily smartphone duration and checking frequency, compared to objective passive sensing output.

Method

Parents took part in a 2-week study that involved completing surveys at enrollment, installing a passive sensing app, and completing a media use recall survey upon app uninstallation. Parents were compensated US$50 for their participation. The study was approved by the University of Michigan Medical School Institutional Review Board.

We recruited English-speaking parents via a university research participant registry to participate in a study in which they would “download a mobile device use tracking application on their smartphone.” Parents were eligible to participate if they: (1) had a child age 12 months to 5 years, (2) were biological or custodial parent, (3) lived with the child at least 5 days per week, (4) and used an Android smartphone or iPhone (the two main smartphone operating systems).10 After providing informed consent, 87 parents completed surveys reporting their demographic characteristics and depression symptoms11 and installed a passive sensing app on their smartphone (Moment for iPhones, Minuku12 for Android) for 14 days (see Supplementary Appendix for additional information about passive sensing apps).

Moment is a commercially available app used in prior research,8 which records screen on/off status to provide daily estimates of smartphone use duration (i.e., minutes screen is on) and number of pickups (i.e., screen turns from off to on). Moment also prompts users to take a screenshot of their battery usage, which undergoes image recognition to generate output of the average minutes/day each app was used. Users can export their usage data in json file format, which we instructed them to email to our secure laboratory email account.

Minuku is a prototype passive sensing app developed at the University of Michigan (PI: Chang, Newman) designed to query the Android UsageStatsManager library (https://developer.android.com/reference/android/app/usage/UsageStatsManager) every 5 s to obtain app usage history and statistics. Data are automatically sent to cloud-based storage, from which they are downloaded by the research team. We opted to use the Minuku app because of its simple data structure and because commercially available app trackers for Android devices do not allow exporting data to research teams. Minuku datafiles, which include screen on/off status, name of app last running in the foreground, and timestamp of last app usage, were automatically transmitted to a secure cloud-based server and downloaded by the researchers after 14 days. We calculated the difference between each timestamp and summed all instances when the screen was on to obtain overall duration of usage, and duration of each specific app, per day. Each time the screen status changed from off to on was considered a pickup, from which we calculated daily pickup counts. We then calculated average daily duration of smartphone use, average daily pickup frequency, and average daily minutes of eight different app categories for each participant.

We trained two research assistants to reliably categorize each app name into categories based on prior human–computer interaction research:13 social media (e.g., Facebook, Twitter, Pinterest); entertainment (e.g., on-demand streaming video services, podcasts), task-oriented apps (e.g., clock, calendar, weather); communication apps (e.g., texting, calls); Internet browser; email; photos/photoediting; and shopping (kappa = 0.77).

After 14 days of running either app on their smartphone, parents were instructed to uninstall the app and complete an online survey of family media use, including the questions: “Thinking about yourself yesterday, how much time did you personally spend using a smartphone?” and “How many times do you check your smartphone on a typical day?” We categorized parents as accurate for duration if their self-report was within 60 min of the average daily duration calculated from app output, and as accurate for checking frequency if their app output pickup frequency fell within the range they self-reported. Because smartphone usage data was positively skewed, we used Spearman’s correlations, Wilcoxon’s rank-sum tests, and Kruskal–Wallis tests to examine associations between smartphone usage variables, parent/household characteristics, and accuracy of duration and checking frequency self-report.

Results

Acceptability of passive sensing was high among participants who expressed interest in the study. No participants refused to install a passive sensing app, and none expressed concern about data privacy protections, which were described thoroughly during the informed consent process.

Feasibility of passive sensing with Moment was good, as parents reported no difficulties downloading it from the app store. However, this app requires participants to export their datafile to research teams via email, which three participants failed to do (10%). Feasibility of data collection with Minuku was lower, as 26 participants (45%) had incomplete data appear on the server, which we monitored on a daily basis. This high rate of missing data with Android phones was presumed due to built-in battery optimization applications, specific to certain manufacturers, which disable background processes such as passive sensing apps.

The final analytic sample comprised 58 parents (26 iPhone and 32 Android); included participants did not differ from excluded participants in terms of demographic characteristics. Participant characteristics and average daily smartphone usage are shown in Table 1. Average daily smartphone duration was 234.4 (SD 157.8) minutes, average checking frequency was 66.8 (SD 40.7) times per day, and the highest duration app categories were task-related apps, social media, communication, and entertainment. High duration of smartphone use was most highly correlated with more entertainment use (R = 0.62, p < 0.0001), task-oriented use (R = 0.80, p < 0.0001), communication (R = 0.40, p = 0.005), and social media use (R = 0.69, p < 0.0001), but was not correlated with average checking frequency (R = −0.01, p = 0.90).

Table 1 Participant characteristics and daily smartphone usage derived from Minuku and Moment output

Overall, few parents accurately self-reported their daily smartphone duration and checking, with most underreporting and some overreporting (Table 2). Parents from lower income households (p = 0.037), with higher depression symptoms (p = 0.002), higher daily duration of smartphone use (p = 0.0003), or more use of task-oriented (p = 0.0012) or browser apps (p = 0.001) were less accurate in their self-reported duration. Checking frequency self-report accuracy was not associated with parent characteristics. Although Moment provides visual feedback about smartphone usage, iPhone users were no more accurate in self-report of duration or checking than Android users.

Table 2 Comparison of self-reported daily duration of smartphone usage and checking frequency, compared to actual mobile app output

Discussion

This is the first study to use mobile passive sensing to measure parent smartphone usage and compare directly measured mobile device usage to self-report. This preliminary work demonstrates the feasibility and utility of this novel methodology, and suggests that parent-reported recall of their own smartphone use may not be accurate.

Although our results are exploratory and need to be replicated in larger samples, several important research implications are highlighted by this work. First, mobile data collection was highly acceptable to parents, as it conferred low participant burden and our informed consent process transparently outlined how their data would be collected, analyzed, and stored. Feasibility varied by type of smartphone: data collection from iPhones required the participant to take screen shots and export the Moment datafile to the research team, which conferred a slightly higher participant burden and led to missing data in three participants. Although Minuku data collection was automatic, we had more missing data due to updates in Android smartphones’ design and operating systems, including battery optimizing apps that scan for and disable background processes. However, participant characteristics were similar between those whose data we included vs. excluded. Given the detailed, timestamped data generated by Minuku and other passive sensing apps for Android, this approach holds promise for highly accurate assessment of parent and child mobile media use with low participant burden, and we therefore continue to develop solutions for Android-based data collection with lower rates of missing data. In addition, there have been recent requests for technology companies to share participant usage data directly with researchers,14 which would be the simplest approach to facilitate more accurate measurement of mobile media and health behaviors.

Most importantly, we found that most parents underreport their smartphone duration and checking frequency, which varies with participant characteristics such as income and depression symptoms, and thus may introduce bias into studies relying on smartphone usage self-report. Underreporting may be due to the more intermittent or immersive experiences users have with mobile technology, whose duration may be more difficult to recall. Therefore, app-based mobile sensing may be an important tool for researchers hoping to measure duration, timing, and content of smartphone usage in clinical or behavioral research. Accurate measurement of everyday media experiences is especially important in light of recent calls for higher quality evidence regarding media effects on child health.15