Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

An online expert network for high quality information on occupational safety and health: cross-sectional study of user satisfaction and impact

BMC Medical Informatics and Decision Making volume 11, Article number: 72 (2011) Cite this article

Abstract

Background

Many people have difficulties finding information on health questions, including occupational safety and health (OSH) issues. One solution to alleviate these difficulties could be to offer questioners free-of-charge, online access to a network of OSH experts who provide tailored, high-quality information. The aim of this study was to assess whether network quality, respectively information quality, as perceived by the questioners, is associated with questioners' overall satisfaction and to explore the impact of the information received on questioners' knowledge, work and work functioning.

Methods

We evaluated the experiences of OSH questioners with the online network ArboAntwoord.com over a two-year period. In this network, approximately 80 qualified experts are available to answer OSH questions. By means of a questionnaire, we assessed questioners' overall satisfaction with the network, whether the network was user-friendly, easily accessible and easy to handle and whether the information provided was complete, applicable and received in a timely manner. The impact of the information on questioners' knowledge, work or work functioning was explored with seven questions. In the study period, 460 unique OSH questioners asked 851 OSH questions. In total, 205 of the 460 questioners completed the questionnaire (response rate 45%).

Results

Of the responders, 71% were satisfied with the ArboAntwoord network. Multiple logistic regression analysis showed that the applicability of the information had a positive influence on the questioners' overall satisfaction (OR = 16.0, 95% CI: 7.0-36.4). Also, user friendliness of the network (OR = 3.3, 95% CI: 1.3-8.6) and completeness of the information provided (OR = 3.0, 95% CI: 1.3-6.8) were positively related to the questioners' satisfaction. For 74% of the questioners, the information helped to increase their knowledge and understanding. Overall, 25% of the questioners indicated that the received information improved their work, work functioning or health.

Conclusions

A free-of-charge, online expert network in the field of OSH can be a useful strategy to provide OSH questioners with applicable, complete and timely information that may help improve safety and health at work. This study provides more insight in how to satisfy network questioners and about the potential impact of provided information on OSH.

Peer Review reports

Background

Many workers, managers and occupational safety and health (OSH) professionals seek information on OSH risks, interventions and legislation [1–5]. Easy access to high-quality OSH information and advice may empower information seekers not only by increasing knowledge and understanding but also by improving how they cope with topics of work and health, such as improving poor working conditions [6–10]. However, many individuals have difficulties in finding high-quality OSH information [3, 11, 12].

Finding high-quality health information often requires specific skills or "health literacy" [13, 14]. The World Health Organisation defines health literacy as "the cognitive and social skills which determine the motivation and the ability of an individual to gain access to, understand and use information in ways that promote and maintain good health" [15]. Both promoting health literacy by education and improving access to quality information could support OSH questioners in their search for answers.

Most workers, managers and OSH professionals access the Internet, or ask advice from OSH experts to find quality information [2, 3, 11, 16–18]. Although easily accessible, the internet often provides excessive amounts of information, which is not always of high quality [19–23]. Well-trained experts might be better able to provide questioners with tailored information or advice of high quality [24, 25]; however consulting trained experts may be hampered by restricted access and high costs [11, 26]. One solution might be to offer OSH questioners the ability to approach experts by computer or telephone free-of-charge [27–32].

For this purpose, several countries have set up telephonic or online expert services that provide information and advice to OSH questioners [1, 4, 5, 16, 31]. An online expert network has the additional advantage of providing easy access to many experts [31, 33]. Online expert networks allow knowledge to be stored and re-used more easily than telephonic helpdesks. Therefore, this knowledge will not be lost for the organisation or other questioners. Online networks can be accessed by computer or (smart)phone. Recently, Google and Yahoo launched similar online networks [34, 35]. We launched the online expert network ArboAntwoord, which is meant for OSH questioners, in October 2008 by a small scale campaign [31]http://www.arboantwoord.com.

Knowledge about the satisfaction of questioners and the impact of information and advice provided might help to create or redesign health-related expert services. Although a number of expert services have been shown to result in satisfied questioners [4, 36, 37], it is still unknown which factors are associated with questioners' satisfaction and what the impact of the provided information and advice is. In other studies, perception of the quality of a new information facility (including user friendliness and accessibility) and the quality of the information provided (including information completeness and applicability) have been associated with high user satisfaction [38–40].

Accordingly, the aim of this study is to assess whether, and to what extent, perceived network quality and perceived information quality are associated with overall satisfaction with the online expert network ArboAntwoord. The information and advice provided by experts in ArboAntwoord may improve questioners' knowledge and understanding, and consequently their work or work functioning. Exploring the impact of information on OSH questioners is the second aim of this study.

Methods

Study design and participants

In a two-year study period, from May 1, 2009, until May 1, 2011, we evaluated the experiences of OSH questioners of the online network ArboAntwoord by means of a periodic questionnaire.

ArboAntwoord

The aim of the ArboAntwoord expert network is to answer OSH questions free of charge, within one week. In ArboAntwoord, individuals can pose their question directly to one or more experts whose expertise matches their needs. The network facilitates the interaction by sending an e-mail notification to the selected expert (when questioned) and to the questioner (when answered). Questions are occasionally answered by more than one expert. Eligible questions and answers are stored in a searchable database for public use after moderation and anonymisation only if informed consent by the questioner is obtained. The development and features of the ArboAntwoord network are described in detail in another paper [31].

The primary target audience is the working population with OSH questions, including employees, employers, (line) managers and human resource professionals (HRM). The network could also be used by OSH professionals such as occupational physicians and "OSH supervisors" (in Dutch: preventiemedewerkers). Initially, approximately 70 Dutch OSH experts were invited to participate in the network if they met all the following criteria: 1) working in a university, expert centre, or highly qualified OSH organisation operating on a national level, 2) having (inter)national expertise on a specific OSH topic, 3) having at least five years of experience on this topic and 4) participating in at least one knowledge dissemination activity such as authorship of scientific articles or participation on an expert committee. During the study period several new experts were invited to participate, while several others quit for various reasons (e.g., migration, change of job). Currently, a steady network of about 80 experts participate in the network encompassing a wide variety of OSH professions, such as occupational physicians, hygienists, safety engineers, human movement scientists, health scientists, (neuro) psychologists, dermatologists, internists, lawyers and OSH legislation specialists.

In the two-year study period, ArboAntwoord received 62,000 unique visitors (Google Analytics). In total, 851 questions were received from 460 different questioners, an average of 1.9 questions per questioner. During the study period, 37% of the questions were published online, and on average, each question was viewed 337 times by other information seekers. Approximately 40% of the questions were related to OSH laws and regulation, e.g., "Are safety shoes obligatory for workers in an army storage depot?" Sixteen percent of the questions focused on interventions to improve working conditions or on treatment for an occupational disease, e.g., "What is an effective intervention to prevent work-related hearing loss for physical education teachers?" Thirteen percent related to causes of and risk factors for work-related health and safety problems, e.g., "Is noise a serious risk for physical education teachers?" On average, experts answered the questions within 2.2 days. In 90% of cases, experts needed less than 30 minutes to answer a question.

Data collection

For this study, we defined four outcomes: 1) the perceived quality of the online network ArboAntwoord facility, 2) the perceived quality of the information provided by experts, 3) the questioner's overall satisfaction with the network services and 4) the impact of the provided information on the questioner. We transformed these outcomes into questions in a web-based questionnaire. The questions were directly based on questions from previous studies on the success of (new) information systems, especially studies concerning the well-known model of information systems success developed by DeLone & McLean [38–40]. Questions found in the literature were translated and adjusted to fit the purpose of our study. Three questions were related to the perceived "technical" quality of the network. We asked if the network was user friendly, easily accessible, and easy to handle. These variables have all been shown to be relevant to the perceived quality of a new information facility [38–40]. To assess the perceived quality of the actual information provided, we formulated three questions related to completeness, applicability and timeliness of the information received. These variables have been shown to be important to the quality of information that a facility provides [38–40]. One single item question was dedicated to the overall satisfaction of the questioner with the network as an information facility, i.e., "Overall, how satisfied are you with ArboAntwoord as an information facility?" The questions were answered on five-point Likert-scales (completely disagree-completely agree).

We decided to distinguish between the impact of information on the questioners' knowledge and understanding and the impact on their work or work functioning [41]. To assess the impact on the questioners' knowledge and understanding, we formulated three questions (five point Likert-scales; completely disagree-completely agree; 0-4 points): "Did the answer of the expert(s) bring you closer to the solution of your question or situation?", "Did the answer increase your knowledge or understanding of the situation?" and "Did the answer provide you with the opportunity to exclude other potential answers?" In addition, we asked "Can you please clarify your response to these three questions (open-ended)?" To explore the impact of information on questioners' work and work functioning we formulated three questions: "Did or do you have the intention to actually apply the answer to your work situation (not applicable, no, yes)?", "Did the answer affect, or will the answer affect your work or work functioning (yes or no)?" and "If yes, what did or will it affect (open-ended)?" We decided not to ask a specific question on prevention or recovery of illness or accidents because this type of impact might be difficult for questioners to estimate, and effects may only be realised after several years. To collect data on background characteristics of the questioners, we included questions on gender, age, educational level, occupation, company size, company sector and internet use. Background data from the questioners' web domains, collected during their registration to the ArboAntwoord website, was used as an additional source of information on non-responders.

The web-based questionnaire was tested for comprehensibility by four workers from different departments of the Academic Medical Center (AMC) in Amsterdam. By convenience sampling, we recruited one worker from the catering service, one from the children's day care centre, one nurse and one researcher. First, two workers were interviewed and their suggestions were included in the next two interviews and in the next version of the questionnaire. The final version of the questionnaire was sent to all individuals who posed a question to an expert in the ArboAntwoord network in the study period (N = 491). Questionnaires were sent periodically to all questioners in the preceding 90 days. We considered this period long enough to observe a potential impact of an answer and short enough to limit recall bias. A disadvantage to this approach is that the time between receiving an answer and the time to realise an impact varies between questioners from one to 90 days. Twenty-three questioners filled in more than one questionnaire (31 questionnaires). Only the first questionnaire was used for analysis (N = 460). It took questioners about 5 to 10 minutes to complete the questionnaire. Since this questionnaire study is not subject to the Dutch Medical Research Involving Human Subjects Act (WMO), approval of the Medical Ethical Committee was not required. Informed consent was obtained when a participant started the questionnaire.

Data analysis

All outcomes were first analysed by means of descriptive analyses. All analyses were carried out using SPSS 17.0 (SPSS Inc., Chicago, IL, USA).

To evaluate which background, network quality or information quality variables were associated with the questioners' overall satisfaction we used the Chi-Squared test for dichotomous variables and the Yates & Cochrane test for ordinal variables (p < 0.05). For this analysis, scores of all separate variables of network quality, information quality, and questioners' overall satisfaction were dichotomised (0-2 = disagree; 3,4 = agree). The internal consistency of the three variables referring to the perceived network quality, respectively the perceived information quality, was poor (Cronbach's alpha < 0.6).

After checking for multicollinearity (Tolerance > 0.10), all significant predictors (p < 0.10) were included in a stepwise logistic regression model (backwards procedure; Likelihood Ratio). The Hosmer and Lemeshow test was used to establish goodness of fit (p > 0.05). For the stepping method we used as criteria p < 0.05 for entry and p > 0.05 for removal.

The internal consistency of the three variables (questions) referring to the impact of information received on questioners' knowledge and understanding was good (Cronbach's alpha = 0.86). Therefore, the average scores of these three questions were processed into one single-item variable, representing the impact of information on questioners' knowledge and understanding (0-4 points). Subsequently, this variable was dichotomised by using a cut-off score of 2.33 (< 2.33 = no impact on knowledge and understanding; ≥ 2.33 = impact on knowledge and understanding).

Finally, MR and CH performed a basic thematic content analysis on the remarks from the open-ended impact question. Discussions between MR and CH led to a simple taxonomy of only one domain for the question on knowledge and understanding and three domains for the question on work and work functioning. To evaluate which background variables were associated with impact on work or work functioning we used the Chi-Squared test for dichotomous variables and the Yates & Cochrane test for ordinal variables (p < 0.05).

Results

Questioner characteristics

Overall, 205 of the 460 questioners completed the questionnaire, a response rate of 45%. There were slightly more male than female responders and most were above the age of 39 years. Many had a high or intermediate educational level, about half used the internet between zero and ten 10 hours a week. The jobs of the questioners were widely spread over various sectors and sizes of companies (Table 1). In comparison to the ArboAntwoord questioners in general (web domain data), questioners between 40 and 59 years old, questioners with a low educational level and questioners working for a large company are slightly overrepresented in the group of respondents. Young questioners between 15 and 29 years old are underrepresented. The characteristics of our sample were largely similar to those of the general working population [42, 43]. The sample has a small overrepresentation of questioners between 40 and 49 years old and of questioners working in industry. We observed an underrepresentation of respondents older than 60 years, of questioners working for a small company and of respondents working in the trade sector.

Table 1 Background characteristics.
Full size table

Quality and overall satisfaction

A large majority of the questioners perceived the network as user friendly (81%) and easily accessible (75%). A slightly smaller percentage of questioners found the network easy to handle (67%). Most questioners perceived the information received as complete (69%) and applicable (70%), and almost all believed they had received the information on time (84%). Almost three quarters of the questioners were (very) satisfied with the ArboAntwoord expert network (71%), 18% percent were not satisfied or dissatisfied and 11% were (very) unsatisfied. We analysed the relationship between the six variables related to the perceived quality of the network and information and the overall satisfaction with the network facility. All six network and information variables were positively associated with the overall satisfaction in univariate analyses (p < 0.05) (Table 2). In contrast, none of the characteristics of the questioners such as age, gender, educational level or function were related to overall satisfaction.

Table 2 Analyses of variables that may influence questioners' overall satisfaction with the online network ArboAntwoord.
Full size table

A multiple logistic regression analysis with backwards procedure including the six significant variables from the univariate analysis (p < 0.1) confirmed that three variables were positively associated with questioners' overall satisfaction. The Hosmer and Lemeshow test showed a significance level above 0.05, which indicates that this final predictor model fits (χ2 = 1.8; p = 0.8). The applicability of the received information was most strongly associated with overall satisfaction followed by the user friendliness of the network and completeness of the information received (Table 3). The regression equation of the model (constant = -2.234) showed that a worker with an OSH question who perceived the network as user friendly and the received information as applicable and complete had a 95% likelihood of being satisfied, compared to 32% for a questioner without any of these three positive judgements.

Table 3 Regression model predicting questioners' overall satisfaction with the online network ArboAntwoord.
Full size table

Impact

Information increased the knowledge and understanding of 153 of 206 questioners (74%). Qualitative analyses of the data from the related open questions showed that questioners often used the information they received from ArboAntwoord experts as a foundation for good judgement, support for a decision or a second opinion. For example, one questioner wrote "I could now provide an answer to a question that management asked me to solve." Another said "Discussion issue can be checked off: good reliable information shed better light on this."

In total, 51 of 205 questioners (25%) reported that the information had or will have an impact on their work or work functioning. This percentage increased to 34% in a subgroup analysis that only included the data of the questioners who had the intention to actually apply the answer to their work situation (67% of total). Answers to the open questions illustrated that the information often had an impact beyond that of the individual questioner. For 32 of the questioners (16% of total), the information facilitated changes in working conditions at the company or department level (Table 4). For example, one respondent mentioned "Finally, the dust accumulating tapestry was removed from the office and replaced." Also, on the individual level the information sometimes helped to improve the workplace or work situation (6%), and for some questioners, the information even helped to reduce health complaints or improve work functioning (3%). Table 4 includes several illustrative remarks made by OSH questioners who perceived that the received information had an impact on their work or work functioning. A final subgroup analysis showed that the impact of the information was influenced by company size (p = 0.049). In our sample, an answer to a question from a worker from a large company impacted work or work functioning significantly more often than an answer to a question from a worker from a small or medium-sized company. Impact was not influenced by gender, age, educational level, occupation and internet use (p > 0.05).

Table 4 Illustrative remarks of questioners related to the impact of information on work or work functioning.
Full size table

Discussion

General Findings

Overall, most OSH questioners perceived the network ArboAntwoord as user friendly (81%), easily accessible (75%) and easy to handle (67%). The majority judged the information received as complete (69%) and applicable (70%), and almost all questioners believed they had received this information on time (84%). Seventy-one percent were (very) satisfied with the network overall. A multiple logistic regression analysis showed that the applicability of information to the specific context of the question(er) had the highest association with the questioners' overall satisfaction. The completeness of the information received and the user friendliness of the expert network also had a positive influence on questioners' overall satisfaction. For 74% of the OSH questioners the received information increased knowledge and understanding. For 25% of the questioners, the received information changed their work, work functioning or health, i.e., for 16%, the impact of the information went beyond the individual questioner as it helped to improve working conditions in a company or department; for 6%, the provided information facilitated the improvement of an individual workplace or work situation, and for a limited number of questioners (3%), the information could improve work functioning or reduce health complaints.

Comparison with literature

Quality and overall satisfaction

Although research has shown that health-related expert facilities can produce satisfied health questioners [4, 29, 36, 37, 44], studies on factors that can predict questioners' overall satisfaction in the health care setting are scarce [45, 46]. In concordance with our findings, Petter and Fruhling [46] and Biemel and Hassanein [45], who both studied health-related information facilities, found that the quality of an information facility and the quality of the information it provides are associated with overall user satisfaction. Outside the field of healthcare, more information is available. An extensive literature review including 180 papers on the use and success of new information systems concluded that there is strong evidence that both the perceived quality of a new facility and the quality of the information it provides influence user satisfaction [40].

Our specific findings on the influence of user friendliness, applicability and completeness are difficult to compare to prior research because the quality of the information facility (e.g., usefulness, learnability and ease of use) and the quality of the information it provides (e.g., applicability, completeness and correctness) are to our knowledge always analysed as composed constructs. In our study, neither quality aspects were studied as composed constructs because our aim was to provide specific knowledge to help create or redesign health-related expert services and because of the poor internal consistency identified.

Our analysis of the separate variables suggests that online expert networks in the field of OSH that aim to satisfy questioners could especially focus on the applicability of information, although user friendliness of the network and completeness of information should also be addressed. In particular, experts should try to provide information that addresses not only the essential "main" question but also the context of the question(er). To accomplish this, a dialogue between questioner and expert may be important. Although the ArboAntwoord facility provides the possibility to provide feedback on a question or answer for further clarification, illustration or information, this feature is not often used. It is possible that the dialogue has to be stimulated more or that other types of dialogue features have to be added, such as a chat box with the experts. Combining network features with popular new mobile or computer application software like WhatsApp Messenger or Skype may also help stimulate the dialogue between questioner and expert. Both the construct of applicability and the construct of completeness require further exploration to determine what makes information applicable and complete to OSH questioners. Finally, usability testing before launching a new expert network is essential for addressing user friendliness [31, 47].

Impact

While we could not find specific studies on the impact of expert networks or services in the field of OSH, many studies and reviews in other fields of healthcare have shown that (online) health information and advice can have an impact on patients, health consumers, professionals and policy makers. Online information and decision support systems have been shown to impact the knowledge and understanding of its users, several health-related behaviours and treatment decisions [8, 48–52]. Similarly, research has shown that internet social networking, support groups and communities have influenced knowledge, decision making, feelings of social support, emotional well-being and health-related behavioural actions in patients with all kinds of illnesses [53–57].

In our study, the information provided by the experts had an impact on the questioners' OSH situation. The information was more likely to increase the questioners' knowledge and understanding than to directly impact their work, work functioning or health. As the majority of questioners had the intention to actually apply the information to their work situation, this finding can be partially explained by the fact it generally takes more time than 90 days to realise an effect on these outcomes. Another explanation might be that a number of questions did not require any immediate action to change behaviour or work. For example, the question "can computer work, for 8 hours a day, 5 days a week cause my low-back pain?" may worry people but often does not need direct action. Questions asked in ArboAntwoord were generally not very urgent in the sense of requiring acute care. Especially in the context of OSH questions with a relatively low urgency, another cause might explain the difficulty of accomplishing behavioural change. In the theory of planned behaviour [58] and the ASE-Model [59], behavioural intention is influenced by attitude, social influence and (self) efficacy. These factors may either facilitate or deter OSH questioners to take action. The theory of diffusion of innovations may also provide a useful perspective. In this theory, a behavioural change is preceded by several essential consecutive behavioural states and steps: knowledge, persuasion, decision, implementation and confirmation [60]. Likely, not all questioners are reaching all of these behavioural states, which may hinder them taking action. It might be interesting to further explore the factors that facilitate or hinder OSH questioners to take action on the information or advice. We did found that an answer to a question from a worker from a large company impacted work or work functioning significantly more often than an answer to a question from a worker from a small or medium-sized company. Possibly, large companies have a better internal OSH infrastructure, such as in company OSH professionals or human resource managers who can further realize changes in OSH.

In contrast to our expectations, the information provided by experts more often had an impact on working conditions at the company level than on the individual level. One might expect that managers or OSH professionals have more influence on OSH at the company or department level than individual workers. Our findings did not support that idea. It is possible that workers used the received information to try to change colleagues' behaviour or work directly or by contacting the work council, a safety engineer or human resources manager, people within a company who have the capability to introduce the issue in a broader company context.

Our study demonstrates that an online expert network can be a useful new strategy for improving both OSH knowledge and working conditions. Nevertheless, especially the perceived quality of the information and the impact on OSH requires further study. Future studies could compare the perceived quality and impact of online expert networks and other expert facilities with that of common information facilities, such as informational websites. Possibly, expert networks could be embedded within existing information sources, such as high-quality informational websites (e.g., when the questioner is not able to find an answer on the website, he can be transferred to an expert). The choice to study an expert network related to a specific OSH topic, e.g., OSH law and regulation, chemical risks or return to work, could facilitate operationalisation and comparison of the perceived quality and impact.

Limitations

Several methodological limitations should be noted. First, our study's cross-sectional design constitutes a limitation. It would have been superior to use a longitudinal study to predict questioners' satisfaction, and a comparative study, utilising another (common) information facility, to evaluate impact. Furthermore, the response rate of 45% and the limited number of 205 respondents may have resulted in some selection bias. Possibly, satisfied questioners for whom the information changed their knowledge, working conditions or work functioning might be overrepresented in our sample. Conversely, dissatisfied questioners might also have been motivated to fill in the questionnaire. Because of a potential selection bias and a lack of detailed information on the non-responders, caution is required when generalising our findings to working populations using online OSH information. That fact that our questionnaire was not extensively pre-tested and validated constitutes another limitation. In particular, the findings on impact require further consideration. Even when the provided information aided in removing or improving potential OSH risks, the actual impact can often only be expected after a longer period of time. Second, it may have been better to include specific impact related outcomes. As the OSH questions spanned a variety of topics, natures and purposes, we only asked three non-specific questions to explore the impact. Not specifically asking the questioners about the impact of the information on health complaints could partially explain why only 3% of the questioners' information impacted this outcome. Additional qualitative study designs, e.g., by interviewing questioners about the impact of information received, might have revealed more complete data on the impact of information on OSH.

Conclusions

A free-of-charge online expert network can be a useful additional strategy for providing applicable, complete and timely information to OSH questioners that may help improve safety and health at work. Our findings show that both network quality and perceived information quality are associated with questioners' overall satisfaction with an online expert network. When aiming for satisfied questioners, network experts should especially focus on the applicability of the information to the context of the questioner, as this aspect was associated most strongly with questioners' overall satisfaction. Online expert networks in the field of OSH have the potential to positively impact OSH both with regard to knowledge and working conditions at both the individual level and company level.

References

  1. Canadian Centre for Occupational Health and Safety: Report of the Council-April 1, 2007 to March 31, 2008. Hamilton. 2008

    Google Scholar 

  2. Dryson E: Occupational health needs in small industry in New Zealand: preferred sources of information. Occup Med (Lond). 1993, 43: 176-179. 10.1093/occmed/43.4.176.

    Article  CAS  Google Scholar 

  3. Hoekstra P, van der Laan N: Inventarisatie naar informatiebehoeften over arbeidsomstandigheden. [Inventory of Informational Needs in Occupational Health and Safety]. 2008, Amsterdam

    Google Scholar 

  4. Lang KH, Deilmann M, Nover H: Zusammenfassung und Fortschreibung der Ergebnisse zum Pilotprojekt REACH-Net [Summary and Follow-up of the Results of the Pilotp-project REACH-Net]. 2007, Wuppertal

    Google Scholar 

  5. Scott Porter Research and Marketing: Safe and Healthy Working-The Occupational Health Service for Small and Medium Enterprises (SMEs). 2004, Edinburgh

    Google Scholar 

  6. Car J, Lang B, Colledge A, Ung C, Majeed A: Interventions for enhancing consumers' online health literacy. Cochrane Database Syst Rev. 2011, 6: CD007092-

    PubMed  Google Scholar 

  7. Hugenholtz NI, Schreinemakers JF, Tjak MA, van Dijk FJ: Knowledge infrastructure needed for occupational health. Ind Health. 2007, 45: 13-18. 10.2486/indhealth.45.13.

    Article  PubMed  Google Scholar 

  8. Kalichman SC, Cain D, Cherry C, Pope H, Eaton L, Kalichman MO: Internet use among people living with HIV/AIDS: coping and health-related correlates. AIDS Patient Care STDS. 2005, 19: 439-448. 10.1089/apc.2005.19.439.

    Article  PubMed  Google Scholar 

  9. Pencheon D: Matching demand and supply fairly and efficiently. BMJ. 1998, 316: 1665-1667. 10.1136/bmj.316.7145.1665.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  10. van Dijk FJ, Verbeek JH, Hoving JL, Hulshof CT: A Knowledge Infrastructure for Occupational Safety and Health. Journal Occupational Environmental Medicine. 2010, 52: 1262-1268. 10.1097/JOM.0b013e318202f2c5.

    Article  Google Scholar 

  11. Hugenholtz NI, Nieuwenhuijsen K, Sluiter JK, van Dijk FJ: Do knowledge infrastructure facilities support evidence-based practice in occupational health? An exploratory study across countries among occupational physicians enrolled on Evidence-Based Medicine courses. BMC Health Serv Res. 2009, 9: 18-10.1186/1472-6963-9-18.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Schaafsma F, Verbeek J, Hulshof C, van Dijk F: Caution required when relying on a colleague's advice; a comparison between professional advice and evidence from the literature. BMC Health Serv Res. 2005, 5: 59-10.1186/1472-6963-5-59.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Anton B, Nelson R: Literacy, consumer informatics, and health care outcomes: Interrelations and implications. Stud Health Technol Inform. 2006, 122: 49-53.

    PubMed  Google Scholar 

  14. Schardt C: Health information literacy meets evidence-based practice. J Med Libr Assoc. 2011, 99: 1-2. 10.3163/1536-5050.99.1.001.

    Article  PubMed  PubMed Central  Google Scholar 

  15. World Health Organization: Health Promotion Glossary. 1998, Geneve

    Google Scholar 

  16. Morken T, Bull N, Moen BE: The activity on a Norwegian Occupational Health mailing list 1997-2006. Occup Med (Lond). 2009, 59: 56-58. 10.1093/occmed/kqn143.

    Article  Google Scholar 

  17. Schneider S, Check P: Read all about it: the role of the media in improving construction safety and health. J Safety Res. 2010, 41: 283-287. 10.1016/j.jsr.2010.05.001.

    Article  PubMed  Google Scholar 

  18. Sublet V, Spring C, Howard J: Does social media improve communication? Evaluating the NIOSH science blog. Am J Ind Med. 2011, 54: 384-394. 10.1002/ajim.20921.

    Article  PubMed  Google Scholar 

  19. Eysenbach G, Powell J, Kuss O, Sa ER: Empirical studies assessing the quality of health information for consumers on the world wide web: a systematic review. JAMA. 2002, 287: 2691-2700. 10.1001/jama.287.20.2691.

    Article  PubMed  Google Scholar 

  20. Haigh CA: Wikipedia as an evidence source for nursing and healthcare students. Nurse Educ Today. 2011, 31: 135-139. 10.1016/j.nedt.2010.05.004.

    Article  PubMed  Google Scholar 

  21. Leithner A, Maurer-Ertl W, Glehr M, Friesenbichler J, Leithner K, Windhager R: Wikipedia and osteosarcoma: a trustworthy patients' information?. J Am Med Inform Assoc. 2010, 17: 373-374. 10.1136/jamia.2010.004507.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Scangas G, Lozano-Calderon S, Ring D: Disparity between popular (Internet) and scientific illness concepts of carpal tunnel syndrome causation. J Hand Surg Am. 2008, 33: 1076-1080. 10.1016/j.jhsa.2008.03.001.

    Article  PubMed  Google Scholar 

  23. Tang H, Ng JH: Googling for a diagnosis--use of Google as a diagnostic aid: internet based study. BMJ. 2006, 333: 1143-1145. 10.1136/bmj.39003.640567.AE.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Hugenholtz NI, Schaafsma FG, Nieuwenhuijsen K, van Dijk FJ: Effect of an EBM course in combination with case method learning sessions: an RCT on professional performance, job satisfaction, and self-efficacy of occupational physicians. Int Arch Occup Environ Health. 2008, 82: 107-115. 10.1007/s00420-008-0315-3.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Schaafsma F, Hugenholtz N, de Boer A, Smits P, Hulshof C, van Dijk F: Enhancing evidence-based advice of occupational health physicians. Scand J Work Environ Health. 2007, 33: 368-378. 10.5271/sjweh.1156.

    Article  PubMed  Google Scholar 

  26. Burg MA, Zebrack B, Walsh K, Maramaldi P, Lim JW, Smolinski KM, Lawson K: Barriers to accessing quality health care for cancer patients: a survey of members of the association of oncology social work. Soc Work Health Care. 2010, 49: 38-52. 10.1080/00981380903018470.

    Article  PubMed  Google Scholar 

  27. Castren J, Huttunen T, Kunttu K: Users and non-users of web-based health advice service among Finnish university students-chronic conditions and self-reported health status (a cross-sectional study). BMC Med Inform Decis Mak. 2008, 8: 8-10.1186/1472-6947-8-8.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Marco J, Barba R, Losa JE, de la Serna CM, Sainz M, Lantigua IF, de la Serna JL: Advice from a medical expert through the Internet on queries about AIDS and hepatitis: analysis of a pilot experiment. PLoS Med. 2006, 3: e256-10.1371/journal.pmed.0030256.

    Article  PubMed  PubMed Central  Google Scholar 

  29. O'Cathain A, Munro JF, Nicholl JP, Knowles E: How helpful is NHS direct? Postal survey of callers. BMJ. 2000, 320: 1035-10.1136/bmj.320.7241.1035.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Pencheon D: NHS direct: managing demand. BMJ. 1998, 316: 215-216.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  31. Rhebergen MD, Hulshof CT, Lenderink AF, van Dijk FJ: An online network tool for quality information to answer questions about occupational safety and health: usability and applicability. BMC Med Inform Decis Mak. 2010, 10: 63-10.1186/1472-6947-10-63.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Umefjord G, Petersson G, Hamberg K: Reasons for consulting a doctor on the Internet: Web survey of users of an Ask the Doctor service. J Med Internet Res. 2003, 5: e26-10.2196/jmir.5.4.e26.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Iske P, Boersma W: Question and answer systems for knowledge sharing: concepts, implementation and return on investement. Journal of knowledge management. 2005, 9: 126-145. 10.1108/13673270510583018.

    Article  Google Scholar 

  34. Harper FM, Raban D, Rafaeli S, Konstan JA: Predictors of Answer Quality in Online Q&A Sites. Proceedings of the 26th SIGCHI annual conference on Human Factors in Computing Systems (CHI) April 5-10 2008; Florence, Italy. 2008, New York: ACM

    Google Scholar 

  35. Hsieh G, Counts S: Mimir: A Market-Based Real Time Question and Answer Service. Proceedings of the 27th SIGCHI annual conference on Human Factors in Computing Systems (CHI) April 4-9 2009; Boston, MA, USA. 2009, New York: ACM

    Google Scholar 

  36. Himmel W, Meyer J, Kochen MM, Michelmann HW: Information needs and visitors' experience of an Internet expert forum on infertility. J Med Internet Res. 2005, 7: e20-10.2196/jmir.7.2.e20.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Richter JG, Becker A, Schalis H, Koch T, Willers R, Specker C, Monser R, Schneider M: An ask-the-expert service on a rheumatology web site: who were the users and what did they look for?. Arthritis Care Res (Hoboken). 2011, 63: 604-611. 10.1002/acr.20399.

    Article  Google Scholar 

  38. DeLone W, McLean E: Information systems success: The quest for the dependent variable. Information Systems Research. 1992, 3: 60-95. 10.1287/isre.3.1.60.

    Article  Google Scholar 

  39. DeLone W, McLean E: The Delone and McLean Model of Information Systems Success: A Ten-Year Update. Journal of Management of Information Systems. 2003, 19: 9-30.

    Google Scholar 

  40. Petter S, DeLone W, McLean E: Measuring information systems success: models, dimensions, measures and interrelationships. European Journal of Information Systems. 2008, 17: 236-263. 10.1057/ejis.2008.15.

    Article  Google Scholar 

  41. Case DO: Looking for Information: A Survey of Research on Information Seeking, Needs, and Behavior. 2008, Bingley: Emerald Group Publishing Limited

    Google Scholar 

  42. Centraal Bureau voor de Statistiek (CBS): Kwartaalcijfers beroepsbevolking 2007 [Quarterly figures working population 2007]. 2007, [http://www.cbs.nl/nl-NL/menu/themas/arbeid-sociale-zekerheid/cijfers/incidenteel/maatwerk/2007-kwartaalcijfers-beroepsbevolking-cm.htm] [Quarterly figures working population 2007]

    Google Scholar 

  43. TNO: De nationale enquete arbeidsomstandigheden (NEA) 2009 [National survey working conditions 2009]. 2010, Almere

    Google Scholar 

  44. Snooks H, Peconi J, Munro J, Cheung WY, Rance J, Williams A: An evaluation of the appropriateness of advice and healthcare contacts made following calls to NHS Direct Wales. BMC Health Serv Res. 2009, 9: 178-10.1186/1472-6963-9-178.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Bliemel M, Hassanein K: Consumer Satisfaction with Online Health Information Retrieval: A Model and Empirical Study. e-Service Journal. 2006, 2: 55-83.

    Google Scholar 

  46. Petter S, Fruhling A: Evaluating the success of an emergency response medical information system. Int J Med Inform. 2011, 80: 480-489. 10.1016/j.ijmedinf.2011.03.010.

    Article  PubMed  Google Scholar 

  47. International Organization for Standardization (ISO): Human-centred design processes for interactive systems. Report ISO 13407 (2004 version) 1999. 2004, Geneva

    Google Scholar 

  48. Broom A: Virtually he@lthy: the impact of internet use on disease experience and the doctor-patient relationship. Qual Health Res. 2005, 15: 325-345. 10.1177/1049732304272916.

    Article  PubMed  Google Scholar 

  49. Fox S, Jones S: The Social Life of Health Information. 2009, Washington D.C.

    Google Scholar 

  50. Pourmand A, Sikka N: Online health information impacts patients' decisions to seek emergency department care. West J Emerg Med. 2011, 12: 174-177.

    Article  PubMed  PubMed Central  Google Scholar 

  51. Waljee JF, Rogers MA, Alderman AK: Decision aids and breast cancer: do they influence choice for surgery and knowledge of treatment options?. J Clin Oncol. 2007, 25: 1067-1073. 10.1200/JCO.2006.08.5472.

    Article  PubMed  Google Scholar 

  52. Willis L, Demiris G, Oliver DP: Internet use by hospice families and providers: a review. J Med Syst. 2007, 31: 97-101. 10.1007/s10916-006-9033-0.

    Article  PubMed  Google Scholar 

  53. Barak A, Boniel-Nissim M, Suler J: Fostering empowerment in online support groups. Computers in Human Behavior. 2008, 24: 1867-1883. 10.1016/j.chb.2008.02.004.

    Article  Google Scholar 

  54. Griffiths KM, Calear AL, Banfield M: Systematic review on Internet Support Groups (ISGs) and depression (1): Do ISGs reduce depressive symptoms?. J Med Internet Res. 2009, 11: e40-

    Article  PubMed  PubMed Central  Google Scholar 

  55. Huang CM, Chan E, Hyder AA: Web 2.0 and internet social networking: a new tool for disaster management?--lessons from Taiwan. BMC Med Inform Decis Mak. 2010, 10: 57-10.1186/1472-6947-10-57.

    Article  PubMed  PubMed Central  Google Scholar 

  56. Springer A, Reck CA, Huber C, Horcher E: Online hypospadias support group data analysis. J Pediatr Surg. 2011, 46: 520-524. 10.1016/j.jpedsurg.2010.08.017.

    Article  PubMed  Google Scholar 

  57. Wiljer D, Urowitz S, Barbera L, Chivers ML, Quartey NK, Ferguson SE, To M, Classen CC: A Qualitative Study of an Internet-Based Support Group for Women with Sexual Distress Due to Gynecologic Cancer. J Cancer Educ. 2011,

    Google Scholar 

  58. Azjen I: The Theory of Planned Behavior. Organizational Behavior and Human Decision Processes. 1991, 50: 179-211. 10.1016/0749-5978(91)90020-T.

    Article  Google Scholar 

  59. de Vries H, Dijkstra M, Kuhlman P: Self-efficacy: The third factor besides attitude and subjective norm as predictor of behavioral intentions. Health Education Research. 1988, 3: 273-282. 10.1093/her/3.3.273.

    Article  Google Scholar 

  60. Rogers EM: Diffusion of innovations. 2003, New York: Free Press

    Google Scholar 

Pre-publication history

Download references

Acknowledgements

We would like to thank the Foundation Institute GAK (Hilversum, The Netherlands) for funding this study. We would also like to thank all ArboAntwoord experts for their collaboration in this study.

Author information

Authors and Affiliations

  1. Coronel Institute of Occupational Health, Academic Medical Center Amsterdam/University of Amsterdam, PO Box: 22700, 1100, DE, Amsterdam, The Netherlands

    Martijn DF Rhebergen, Frank JH van Dijk & Carel TJ Hulshof

  2. Netherlands Center for Occupational Diseases, Academic Medical Center Amsterdam/University of Amsterdam, PO Box: 22660, 1100 DD, Amsterdam, The Netherlands

    Annet F Lenderink

  3. Centre of Excellence, Netherlands Society of Occupational Medicine (NVAB), PO Box 2113, 3500, GC, Utrecht, The Netherlands

    Carel TJ Hulshof

Authors
  1. Martijn DF Rhebergen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Annet F Lenderink
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Frank JH van Dijk
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Carel TJ Hulshof
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Martijn DF Rhebergen.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

MR, CH, FD and AL designed the study. MR and CH planned the analysis and collected data. MR analysed data. MR, CH, FD and AL wrote the paper. All authors read and approved the final manuscript.

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Rhebergen, M.D., Lenderink, A.F., van Dijk, F.J. et al. An online expert network for high quality information on occupational safety and health: cross-sectional study of user satisfaction and impact. BMC Med Inform Decis Mak 11, 72 (2011). https://doi.org/10.1186/1472-6947-11-72

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1472-6947-11-72

Keywords

BMC Medical Informatics and Decision Making

ISSN: 1472-6947

Contact us