- Research article
- Open Access
Quality of websites of obstetrics and gynecology departments: a cross-sectional study
© Rezniczek et al. 2015
- Received: 16 December 2014
- Accepted: 21 April 2015
- Published: 26 April 2015
The internet has become an easily accessible and widely used source of healthcare information. There are, however, no standardized or commonly accepted criteria for the quality of Obstetrics and Gynecology websites. In this study, we aimed to evaluate the quality of websites of Obstetrics and Gynecology departments in German-speaking countries and to compare websites nationally and internationally.
We scored 672 websites from Germany (n = 566), Austria (n = 57), and Switzerland (n = 49) using the objective criteria: Google search rank (2 items), technical aspects (11 items), navigation (8 items), and content (6 items) for a 26 point score. Scores were compared nationally and internationally. Multivariable regression models assessed good quality scores (≥50% of maximum) as the dependent variables and country, academic affiliation, being member of a healthcare consortium, confessional affiliation, and content management system (CMS) use as independent variables.
The mean score of websites was 13.8 ± 3.3. 4.2% were rated as good (≥75% of maximum), 61.8% as fair (≥50% of maximum). German (14.0 ± 3.2) and Swiss (13.8 ± 4.0) websites scored significantly higher compared to Austrian websites (11.6 ± 2.5) (P < 0.001 and P = 0.005, respectively). Within Germany, academic had higher scores than non-academic departments (14.9 ± 3.2 vs. 13.7 ± 3.1, P < 0.001). Single institutions had higher scores compared to healthcare consortium institutions (14.1 ± 3.2 vs. 13.2 ± 2.6, P = 0.003). Departments in Northern and Southern states had higher scores compared to Eastern states (14.4 ± 3.2 and 14.2 ± 3.2 vs. 13.0 ± 3.0, P < 0.001). In multivariate regression models, all subscores (all: P < 0.001) independently predicted a website’s reaching a good quality score, with navigation subscore as strongest predictor. Affiliations were predictors for some good individual subscores, but not for others. High content subscore was associated with good Google search rank, technical aspects, and navigation subscores.
The quality of websites of Obstetrics and Gynecology departments varies widely. We found marked differences depending on country, affiliation, and region.
- World Wide Web
- Obstetrics and gynecology
The Internet has become an easily accessible and widely used source of healthcare information for patients. Depending on the specific health problem, up to half of all affected patients seek information on the internet [1-3]. Of note, healthcare-related websites are among the most often accessed non-commercial websites . Gathering information on the internet, however, can be misleading. It has been frequently found that content quality of healthcare-related websites is a problem [5-10], despite initiatives like the Health On the Net Code of Conduct (HONcode, established in 1996)  and the publication of the American Medical Association Internet health information guidelines in 2000  and the eEurope 2002 Quality Criteria for health-related websites .
Looking specifically at the field of Obstetrics and Gynecology, for example, Agricola et al. demonstrated that preconception information found in a Google search is poor and inaccurate regardless whether women or health professionals performed the searches . Website contents on sensitive issues such as oral contraception and abortion may be characterized by extensive misinformation, as demonstrated by recent studies [10,14]. On the other hand, other investigators have found mostly accurate web-based information on selected issues such as nausea and vomiting in pregnancy, postmenopausal osteoporosis, and female urinary incontinence [15-17]. Thus, these mixed findings highlight the need to establish quality guidelines for Obstetrics and Gynecology website contents.
Besides patients, healthcare providers also use the Internet for marketing and information purposes . Today, websites are common means of marketing for all players in the healthcare market in industrialized countries, even for Departments of Obstetrics and Gynecology . Obstetrics and Gynecology websites are booming, as demonstrated by a Google search (July 16, 2014) using the search terms “Obstetrics” and “Gynecology” which yielded about 10.3 M and 9.5 M hits, respectively. According to Google AdWords, 60,500 and 22,200 average monthly searches with these search terms are performed worldwide. Other keywords related to women’s health issues are searched even more often, e.g. in 2013, “pregnancy” was searched for more than 500,000 times per month in the U.S. alone . In the light of this and a steadily increasing number of internet users , the importance of professional, well-maintained, and high quality websites is likely to increase in the future. Numerous attempts to define useful content quality indicators have been made, such as HONcode, including an associated quality label [11,22], DISCERN  and Brief DISCERN , MedCERTAIN , the Silberg  and Abbott  scales, and many more [28,29]. There are, however, no standardized or commonly accepted criteria for the quality of Obstetrics and Gynecology websites and to date, no studies evaluating the quality of Department of Obstetrics and Gynecology websites have been published (PUBMED search; July 16, 2014; search terms: website, internet, World Wide Web, quality, obstetrics, gynecology, score).
The PILOT Study, an online study with 1,584 participants conducted in Germany in 2011, estimated that approximately 80% of all internet users in Germany (corresponding to 40 million individuals) use the internet to obtain healthcare-related information. An additional 10 million are estimated for Austria and Switzerland . Another study, based on data from approx. 20% of Germany’s population, claims that 68% of internet users are searching the Internet for health information and that women are 52% more likely to do so than men . This again highlights the importance of good quality websites for women in general and those of women’s health care providers in particular. To evaluate the quality of Obstetrics and Gynecology websites we considered several indicators described in the literature. However, both DISCERN and HONcode appeared to be unsuitable for our task of evaluating websites of departments and clinics in the tightly regulated health care systems of Germany, Austria, and Switzerland . A lot of HONcode principles did not apply (e.g. these sites have no ads, most items are prescribed by law), and DISCERN is considering content quality only, but not other factors such as ease of use and other factors important for website visitors seeking diverse information pertaining not primarily to treatment options but to the department or clinic itself. The Silberg score  was also considered, but in our opinion was too narrow for the current state of web technology and user expectations. Furthermore, department websites in Germany, Austria and Switzerland are virtually never edited by declared and/or individual authors, so a lot of the items in the previously mentioned instruments would not have been applicable. Abbott’s aesthetic criteria , as used in several articles on medical information website quality [34,35], was also considered and found, by itself, unsuitable.
Therefore, we designed a scoring instrument specifically for websites of Obstetrics and Gynecology departments, and used it for scoring websites in Germany, Austria, and Switzerland. Our score is based on input from the relevant target audiences and elements from other scoring systems. For example, items 3, 5, and 22 correspond to criteria of Abbott’s scale, and several other items correspond to similar items in other scales, such as interactivity/intra-site search, use of headings, presence of contact details, and dedicated sections for general and professional audiences. The aim of the study was to establish a scoring instrument for websites of Departments of Obstetrics and Gynecology, to assess the quality of such websites in three countries with a homogenous health care system, i.e. Germany, Austria, and Switzerland, and to compare the scoring results among them.
Study design and population
The aim of the study was to establish a scoring instrument for websites of Departments of Obstetrics and Gynecology, to assess the quality of such websites in Germany, Austria, and Switzerland, and to compare the scoring results among them. The reason for choosing these three countries was motivated by the fact that they are all German-speaking and thus websites would be more easily comparable than different language website. Furthermore, demographics and the structure of the healthcare systems in these countries are very similar .
The institutions’ names and addresses of the websites included in our analysis were from lists provided by the national and regional boards of Obstetricians and Gynecologists in Germany, Austria, and Switzerland. Inclusion criteria were: accessible website during the study period, clear and unambiguous attribution of the website to the corresponding institution (e.g. via imprint information).
Design of the website score
Website-score using 27 test items in four categories for a maximal score of 26 points
Overall N = 672
German N = 566
Austrian N = 57
Swiss N = 49
Total website-score (26)
13.8 ± 3.3
14.0 ± 3.2 ***
11.6 ± 2.6
13.8 ± 4.0 ^^
Google search rank (2)
1.3 ± 0.8
1.4 ± 0.8 ***
0.8 ± 0.9
1.3 ± 0.8 ^^
When performing a Google search, is a link to the department (or the hosting institution) listed on the first page of results? (Y = 1, N = 0)
467 (82.5%) ***
38 (77.6%) ^^^
Is there a direct link to the departments starting page within the first page of Google results? (Y = 1, N = 0)
317 (56.0%) **
Technical aspects (10)
4.6 ± 1.4
4.6 ± 1.4
4.7 ± 1.4
4.4 ± 1.4
Do individual sub-pages have specific and meaningful titles? (Y = 1, N = 0)
For individual sub-pages, is a specific and meaningful description provided via the META/description tag? (Y = 1, N = 0)
Are the semantic HTML tags for headings (<H1>, <H2>, …), paragraphs (<P>), and tables (<TABLE>) used appropriately? (Y = 1, N = 0)
For all content-related images, are meaningful descriptions provided in the ALT-attribute of the < IMG > tags? (Y = 1, N = 0)
Does the website make use of Flash plug-in? (Y = 0, N = 1)
In case the website uses Flash, are alternatives offered for website visitors using Flash-incapable devices, or does the website at least make it obvious to visitors that they miss out on content? (Y = 1, N = 0)
Is the layout of the website responsive (i.e. does it adapt do varying screen sizes), or is a separate version for mobile devices available? (Y = 1, N = 0)
45 (8.0%) °°
11 (22.4%) ^
Does the website offer means to adjust (increase) the text size without compromising the functionality of the website? (Y = 1, N = 0)
11 (22.4%) ^
Does the website offer means to adjust (increase) the contrast of textual information for visitors with visual impairments (Y = 1, N = 0)
Does the website offer information in one or more additional languages? (Y = 1, N = 0)
5.2 ± 1.4
5.3 ± 1.4 ***
4.5 ± 1.3
5.3 ± 1.4 ^^
Does the department’s website have a dedicated starting (welcome) page? (Y = 1, N = 0)
Does the website provide a (consistently accessible) menu structure for navigating the department’s sub-pages? (Y = 1, N = 0)
470 (83.0%) ***
42 (85.7%) ^^
Does the website provide a (working) search facility? (Y = 1, N = 0)
457 (80.7%) °
Are there dedicated subsections of the website for obstetric and general gynecologic patients? (Y = 1, N = 0)
338 (59.7%) ***
32 (65.3%) ^^^
Does the website contain a subsection directed specifically at referring physicians? (Y = 1, N = 0)
54 (9.5%) °
Is there a (direct navigational) link to information about the department’s staff? (Y = 1, N = 0)
Is (department-specific) contact information easily accessible? (Y = 1, N = 0)
528 (93.3%) °
Does the website provide access to information on how to reach the clinic (by car or public transportation)? (Y = 1, N = 0)
2.6 ± 1.3
2.7 ± 1.3 ***
1.7 ± 1.1
2.8 ± 1.8 ^^
Does the website feature content-related visual impressions? (Y = 1, N = 0)
461 (81.4%) * °
Does the website contain (prominently displayed) emergency information? (Y = 1, N = 0)
136 (24.0%) *** °°°
Are photos of the medical team (physicians, nurses) available? (Y = 1, N = 0)
500 (88.3%) *** °°°
Does the website provide detailed information about the offered medical service spectrum? (Y = 1, N = 0)
167 (29.5%) °
Does the website provide an up-to-date news/events schedule? (Y = 1, N = 0)
75 (13.3%) * °°
Does the website provide information on births per year? (Y = 1, N = 0)
193 (34.1%) ** °°
Two authors (LK, GR) evaluated the websites with the help of a custom-programmed (GR) website analysis tool (a Microsoft . NET/WinForms application that takes a list of web addresses as input and then displays the individual websites inside the Firefox web browser via Selenium WebDriver (http://www.seleniumhq.org). For each website, the evaluating person was presented with a series of specific questions and a corresponding choice of answer buttons and/or input fields. The software documented each step of the process, made screen shots of the websites, and, where possible, facilitated the decision making by automatically extracting information from the HTML source and presenting it to the evaluating person (mostly for items under “technical aspects”). Finally, the results were exported to an Excel spreadsheet. Websites were tagged as academic and/or denominational and/or belonging to a healthcare consortium based on information from the websites (e.g. parent corporate websites, statements, imprints).
Scores were compared nationally for Germany (academic vs. non-academic departments, healthcare consortiums vs. single institutions, whether the department operated in a denominational setting vs. not, and by region) and internationally (Germany vs. Austria vs. Switzerland). Within Germany, comparisons were made between Eastern and Northern + Southern states, based on the historical division of Germany into the Federal Republic of Germany (FRG; Northern and Southern states) and the German Democratic Republic (GDR; Eastern states) until 1989. Within the former FRG we compared Northern and Southern states based on well-known differences in economic productivity, income, and education in favor of Southern states . Northern states are North Rhine-Westphalia, Saarland, Rhineland Palatinate, Hessen, Lower Saxony, Schleswig-Holstein, Bremen, and Hamburg; Southern states are Baden-Wurttemberg and Bavaria; Eastern states are: Mecklenburg-West Pomerania, Brandenburg, Saxony, Saxony-Anhalt, Thuringia, and Berlin. Categorical variables were analyzed by χ2-test and continuous variables were compared using the Mann–Whitney rank sum test with a significance level of 0.05. We performed a multivariate regression analysis with good quality overall and sub-scores (>50% of the maximum score) as the dependent variables and country, Google search rank, technical aspects, navigation, and content scores as well as various affiliations and content management system (CMS) usage as independent variables. Excel 2003 (Microsoft) was used to prepare the raw data, SigmaPlot 12.5 (Systat Software) was used for statistical evaluation and data visualization. Adobe Illustrator was used for final figure assembly.
Website quality differs between Germany/Switzerland and Austria
The proportions of good quality and fair quality German, Austrian, and Swiss websites were 24/566 (4.2%) and 369/566 (65.2%), 1/57 (1.8%) and 17/57 (29.8%), and 3/49 (6.1%) and 29/49 (59.2%), respectively (see stacked bars in Figure 1).
Affiliation is a predictor for website quality in Germany
Mean overall website scores and mean sub-scores of websites broken down by affiliation, region, and usage of an established content management system (CMS)
Google search rank
Healthcare Consortium vs.
CMS Usage vs.
No CMS Usage
Content management system usage correlates with higher quality scores
416/672 (61.9%) websites in Germany, Austria, and Switzerland were identified to be built upon established content management systems (CMS; Table 2 and Figure 2C). These websites scored higher than websites without underlying CMS (14.2 ± 3.1 vs. 13.1 ± 3.4, P < 0.001). TYPO3 was by far (76.4%) the most commonly used CMS, followed by Joomla! (6.7%). All others represented less than 2%. ANOVA on ranks of the overall scores of websites using the top 5 CMS (at least used in ≥ 7 websites) showed no differences in the median scores among them (P = 0.240).
Multiple regression analysis
Multiple regression analysis (overall, 672 websites)
Variables: Dependent > ∨ Independent
Good Overall Score
Good Google Search Rank Score
Good Technical Aspects Score
Good Navigation Score
Good Content Score
Google search rank score
P = 0.025
OR 1.28 (1.03-1.59)
Technical aspects score
P = 0.005
OR 1.19 (CI 1.05-1.35)
P < 0.001
OR 1.91 (CI 1.65-2.21)
P = 0.006
P = 0.036
P < 0.001
OR 1.28 (CI 1.07-1.53)
OR 1.16 (CI 1.01-1.21)
OR 2.32 (CI 1.81-2.97)
P = 0.002
P = 0.012
OR 2.00 (CI 1.03-3.08)
OR 2.05 (CI 1.17-3.57)
P = 0.043
P = 0.033
P < 0.001
OR 1.61 (CI 1.02-2.56)
OR 0.49 (CI 0.25-0.94)
OR 2.87 (CI 1.71-4.81)
P = 0.001
OR 0.45 (CI 0.28-0.73)
P < 0.001
P = 0.001
P = 0.009
OR 1.82 (CI 1.30-2.54)
OR 1.76 (CI 1.28-2.44)
OR 1.99 (CI 1.19-3.32)
In this cross-sectional study, we found that the quality of websites of Obstetrics and Gynecology departments varies widely depending on country, affiliation, and region. To our knowledge, this is the first study to evaluate the quality of department websites in the field of Obstetrics and Gynecology according to objective criteria. While 62% of the investigated websites were found to be of good quality, with good quality defined as ≥50% of the maximum score, only few (4.2%) websites reached a good score result (defined as ≥75% of the maximum score), and none were rates as excellent (≥90%). This suggests that the overall quality of current websites of Departments of Obstetrics and Gynecology in the evaluated countries is low and that in fact all departments have an opportunity to improve their internet-based communication with current and potential patients.
Within Germany, we found marked differences between Eastern states (representing the former GDR) and Northern and Southern states (representing the former FRG) regarding all major items, i.e. Google search rank, technical aspects, navigation and content. This is interesting, because it demonstrates that historical divisions are still present in at least some aspects of the healthcare system despite >25 years of German unification . However, within all German states, other major influential factors were identified. Specifically, we found that academic vs. non-academic institutions and single institutions vs. members of HCC consistently scored higher on the website score. This shows that both intellectual/academic as well as economic factors have a direct impact on the quality of Obstetrics and Gynecology department websites. This is consistent with the results of Huang et al. who assessed U.S. fertility clinic websites and found that university-affiliated sites performed significantly better. For example, university-affiliated centers were more likely to include ownership and affiliation information, web contents were significantly easier to distinguish from advertisements, reference sources were significantly easier to identify and more likely to indicate relevant financial disclosures and to include a search function . Several other authors, however, did not find marked differences when comparing Academic and Non-Academic websites in areas such as bipolar disorder, social phobia, pathological gambling, and substance abuse. In these studies, however, any form of web-based health information was investigated and not only hospital departments as in our case [34,35].
In a multivariate regression analysis, several other predictors of a good overall score as well as good subscores were identified. For example, we found that being an academic site conferred the highest likelihood for reaching a good overall score and a good Google score. Being a singular institution as opposed to being a member of a HCC best predicted a good content score. This shows that there is no single item universally predicting a good website. Some characteristics predict some quality aspects, but not others.
CMS use was a reliable predictor for reaching good technical and good navigation scores. This is not surprising as items in these subscores correspond to essential features and benefits usually provided by a CMS: separation of a website’s content, its structure and its visual design; provision of a navigation system to access content; solid and standards-conforming underlying web framework. Only 8.8% of websites supported mobile browsers, indicating that most websites were designed without recognition of the strongly increasing use of mobile devices to access the Internet . As our data show, CMS use, however, does not automatically mean good content or good Google search rank. There is clearly an opportunity to improve search ranks, especially for Austrian websites, and the need for medical information websites in general to carefully invest in search engine optimization is underscored by our data and has also been recognized by others .
Websites are an important means of information  and thus a direct-to-patient marketing opportunity for Departments of Obstetrics and Gynecology. The results of our study suggest that the potential to improve Obstetrics and Gynecology websites is considerable, especially in selected countries, regions, health consortium clinics, and non-academic departments, which tended to reach lower quality scores in our study. Although there is general agreement on what makes a good website, regarding both technical and content-related aspects, the level of practical implementation is obviously heterogeneous in Obstetrics and Gynecology websites. The website score presented in our study may be a helpful tool for some Departments of Obstetrics and Gynecology (clinic directors and other healthcare professionals, as well as for the respective economic and marketing units) to evaluate the quality of their own website, to benchmark their website against those of local and regional competitors, and to identify areas of possible improvement, especially because our score was designed by taking the website users’ perspectives into account. The strengths and weaknesses of a given website can be easily identified using the subcategories Google search rank, technical aspects, navigation, and content.
The strength of our study lies in the large sample of websites we have included in our analysis. However, our study has limitations. First, we only assessed websites from Obstetrics and Gynecology departments in German-speaking countries, i.e. Germany, Austria, and Switzerland. The website quality in these countries may not be representative for other industrialized countries. Therefore, our data may over- or underestimate the general website quality of Obstetrics and Gynecology departments in Western industrialized countries. Regarding the external validity and clinical implications of our study, the data therefore have to be interpreted with caution. Second, other developed countries and regions such as Japan or South-east Asia may put more emphasis on items other than those typical for Western nations due to cultural differences. This may result in different scores. A culturally-sensitive approach is needed when applying the website score published in this study to institutions in non-Western countries.
In summary, the data presented in this study provide evidence that the quality of websites of Departments of Obstetrics and Gynecology varies widely both within countries and internationally. Also, selected affiliation characteristics such as non-academic institution and being part of a healthcare consortium were associated with lower scores. The mean overall score of all websites was low indicating a significant potential for improvement of Obstetrics and Gynecology websites in the majority of cases. Our data may be used by healthcare providers to evaluate their own website, identify areas of improvement, and to objectively compare their own website with local and national competitors. We hope that these data will contribute to the improvement of the quality of Obstetrics and Gynecology websites, since websites have become an important source of information for women in need of specialty care.
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Huang JYJ, Al-Fozan H, Tan SL, Tulandi T. Internet use by patients seeking infertility treatment. Int J Gynaecol Obstet. 2003;83:75–6.PubMedView ArticleGoogle Scholar
- Haagen EC, Tuil W, Hendriks J, de Bruijn RPJ, Braat DDM, Kremer JAM. Current Internet use and preferences of IVF and ICSI patients. Hum Reprod. 2003;18:2073–8.PubMedView ArticleGoogle Scholar
- Weissman A, Gotlieb L, Ward S, Greenblatt E, Casper RF. Use of the internet by infertile couples. Fertil Steril. 2000;73:1179–82.PubMedView ArticleGoogle Scholar
- Lawrence S, Giles CL. Accessibility of information on the web. Nature. 1999;400:107–9.PubMedView ArticleGoogle Scholar
- Eysenbach G, Powell J, Kuss O, Sa E. Empirical studies assessing the quality of health information for consumers on the world wide web: a systematic review. JAMA. 2002;287:2691–700.PubMedView ArticleGoogle Scholar
- Covolo L, Capelli M, Ceretti E, Feretti D, Caimi L, Gelatti U. Nutritional supplements for diabetes sold on the internet: business or health promotion? BMC Public Health. 2013;13:777.PubMed CentralPubMedView ArticleGoogle Scholar
- Agricola E, Gesualdo F, Pandolfi E, Gonfiantini MV, Carloni E, Mastroiacovo P, et al. Does googling for preconception care result in information consistent with international guidelines: a comparison of information found by Italian women of childbearing age and health professionals. BMC Med Inform Decis Mak. 2013;13:14.PubMed CentralPubMedView ArticleGoogle Scholar
- Klila H, Chatton A, Zermatten A, Khan R, Preisig M, Khazaal Y. Quality of Web-based information on obsessive compulsive disorder. Neuropsychiatr Dis Treat. 2013;9:1717–23.PubMed CentralPubMedGoogle Scholar
- Ogah I, Wassersug RJ. How reliable are “reputable sources” for medical information on the internet? The case of hormonal therapy to treat prostate cancer. Urol Oncol. 2013;31:1546–52.PubMedView ArticleGoogle Scholar
- Neumark Y, Flum L, Lopez-Quintero C, Shtarkshall R. Quality of online health information about oral contraceptives from Hebrew-language websites. Isr J Health Policy Res. 2012;1:38.PubMed CentralPubMedView ArticleGoogle Scholar
- Boyer C, Selby M, Appel RD. The health on the net code of conduct for medical and health web sites. Stud Health Technol Inform. 1998;52(Pt 2):1163–6.PubMedGoogle Scholar
- Winker MA, Flanagin A, Chi-Lum B, White J, Andrews K, Kennett RL, et al. Guidelines for medical and health information sites on the internet: principles governing AMA web sites American Medical Association. JAMA. 2000;283:1600–6.PubMedView ArticleGoogle Scholar
- eEurope 2002. Quality Criteria for Health Related Websites. J Med Internet Res. 2002;4:E15.Google Scholar
- Rowlands S. Misinformation on abortion. Eur J Contracept Reprod Health Care. 2011;16:233–40.PubMedView ArticleGoogle Scholar
- Pérez-López FR, Pérez R, Gonzalo R. Assessing the content and quality of information on the treatment of postmenopausal osteoporosis on the World Wide Web. Gynecol Endocrinol. 2006;22:669–75.PubMedView ArticleGoogle Scholar
- Farrell KD, Robinson LM, Baydock SA, Farrell SA, Irving LE, O‘Connell CM. A survey of Canadian websites providing information about female urinary incontinence. J Obstet Gynaecol Can. 2006;28:700–12.PubMedGoogle Scholar
- Sacks S, Abenhaim HA. How evidence-based is the information on the internet about nausea and vomiting of pregnancy? J Obstet Gynaecol Can. 2013;35:697–703.PubMedGoogle Scholar
- Manz C, Ross JS, Grande D. Marketing to physicians in a digital world. N Engl J Med. 2014;371:1857–9.PubMedView ArticleGoogle Scholar
- Omurtag K, Jimenez PT, Ratts V, Odem R, Cooper AR. The ART of social networking: how SART member clinics are connecting with patients online. Fertil Steril. 2012;97:88–94.PubMed CentralPubMedView ArticleGoogle Scholar
- Baazeem M, Abenhaim H. Google and women‘s health-related issues: what does the search engine data reveal? Online J Public Health Inform. 2014;6:e187.PubMed CentralPubMedGoogle Scholar
- Measuring the Information Society Report. International Telecommunication Union, Geneva, Switzerland; 2014.Google Scholar
- Boyer C, Gaudinat A, Baujard V, Geissbühler A. Health on the net foundation: assessing the quality of health web pages all over the world. Stud Health Technol Inform. 2007;129:1017–21.PubMedGoogle Scholar
- Charnock D, Shepperd S, Needham G, Gann R. DISCERN: an instrument for judging the quality of written consumer health information on treatment choices. J Epidemiol Community Health. 1999;53:105–11.PubMed CentralPubMedView ArticleGoogle Scholar
- Khazaal Y, Chatton A, Cochand S, Coquard O, Fernandez S, Khan R, et al. Brief DISCERN, six questions for the evaluation of evidence-based content of health-related websites. Patient Educ Couns. 2009;77:33–7.PubMedView ArticleGoogle Scholar
- Eysenbach G, Köhler C, Yihune G, Lampe K, Cross P, Brickley D. A framework for improving the quality of health information on the world-wide-web and bettering public (e-)health: the MedCERTAIN approach. Stud Health Technol Inform. 2001;84:1450–4.PubMedGoogle Scholar
- Silberg WM, Lundberg GD, Musacchio RA. Assessing, controlling, and assuring the quality of medical information on the Internet: Caveant lector et viewor–Let the reader and viewer beware. JAMA. 1997;277:1244–5.PubMedView ArticleGoogle Scholar
- Abbott VP. Web page quality: can we measure it and what do we find? A report of exploratory findings. J Public Health Med. 2000;22:191–7.PubMedView ArticleGoogle Scholar
- Gagliardi A, Jadad AR. Examination of instruments used to rate quality of health information on the internet: chronicle of a voyage with an unclear destination. BMJ. 2002;324:569–73.PubMed CentralPubMedView ArticleGoogle Scholar
- Jadad AR, Gagliardi A. Rating health information on the internet: navigating to knowledge or to Babel? JAMA. 1998;279:611–4.PubMedView ArticleGoogle Scholar
- Alexander Schachinger: PILOT Online-Studie: Patient Involvement - Leading to Optimized Therapy?: KWHC GmbH, Uelzen, Germany (see http://www.kwhc.de/webpage/index.php/pilot-studie.html); 2011.
- Nölke L, Mensing M, Krämer A, Hornberg C. Sociodemographic and health-(care-)related characteristics of online health information seekers: a cross-sectional German study. BMC Public Health. 2015;15:31.PubMed CentralPubMedView ArticleGoogle Scholar
- Altenstetter C. Insights from health care in Germany. Am J Public Health. 2003;93:38–44.PubMed CentralPubMedView ArticleGoogle Scholar
- Kisely S, Ong G, Takyar A. A survey of the quality of web based information on the treatment of schizophrenia and attention deficit hyperactivity disorder. Aust N Z J Psychiatry. 2003;37:85–91.PubMedView ArticleGoogle Scholar
- Khazaal Y, Chatton A, Zullino D, Khan R. HON label and discern as content quality indicators of health-related websites. Psychiatr Q. 2012;83:15–27.PubMedView ArticleGoogle Scholar
- Morel V, Chatton A, Cochand S, Zullino D, Khazaal Y. Quality of web-based information on bipolar disorder. J Affect Disord. 2008;110:265–9.PubMedView ArticleGoogle Scholar
- OECD. Health at a Glance: Europe 2012. OECD Publishing; 2012 [http://0-dx.doi.org.brum.beds.ac.uk/10.1787/9789264183896-en]
- Huang Jack YJ, Discepola F, Al-Fozan H, Tulandi T. Quality of fertility clinic websites. Fertil Steril. 2005;83:538–44.PubMedView ArticleGoogle Scholar
- AT Internet: Search Engine Barometer. December 2014 [http://www.atinternet.com/en/documents/search-engine-barometer-december-2014/; http://www.webcitation.org/6XHGNH58i]
- Statistisches Jahrbuch. Deutschland und Internationales. Wiesbaden, Germany: Statistisches Bundesamt; 2014.Google Scholar
- Ryu G. Lessons from unified Germany and their implications for healthcare in the unification of the Korean Peninsula. J Prev Med Public Health. 2013;46:127–33.PubMed CentralPubMedView ArticleGoogle Scholar
- Murtagh R. Mobile Now Exceeds PC: The Biggest Shift Since the Internet Began [http://searchenginewatch.com/sew/opinion/2353616/mobile-now-exceeds-pc-the-biggest-shift-since-the-internet-began; http://www.webcitation.org/6XI77rBHc]
- Dunne S, Cummins NM, Hannigan A, Shannon B, Dunne C, Cullen W. A method for the design and development of medical or health care information websites to optimize search engine results page rankings on Google. J Med Internet Res. 2013;15:e183.PubMed CentralPubMedView ArticleGoogle Scholar