- Research article
- Open Access
- Open Peer Review
An evaluation of classification systems for stillbirth
- Vicki Flenady†1, 2Email author,
- J Frederik Frøen†3, 4,
- Halit Pinar5,
- Rozbeh Torabi5,
- Eli Saastad3, 6,
- Grace Guyon7,
- Laurie Russell8,
- Adrian Charles9,
- Catherine Harrison9,
- Lawrence Chauke9,
- Robert Pattinson10,
- Rachel Koshy11,
- Safiah Bahrin11,
- Glenn Gardener1,
- Katie Day1,
- Karin Petersson12,
- Adrienne Gordon13 and
- Kristen Gilshenan1
© Flenady et al; licensee BioMed Central Ltd. 2009
- Received: 26 August 2008
- Accepted: 19 June 2009
- Published: 19 June 2009
Audit and classification of stillbirths is an essential part of clinical practice and a crucial step towards stillbirth prevention. Due to the limitations of the ICD system and lack of an international approach to an acceptable solution, numerous disparate classification systems have emerged. We assessed the performance of six contemporary systems to inform the development of an internationally accepted approach.
We evaluated the following systems: Amended Aberdeen, Extended Wigglesworth; PSANZ-PDC, ReCoDe, Tulip and CODAC. Nine teams from 7 countries applied the classification systems to cohorts of stillbirths from their regions using 857 stillbirth cases. The main outcome measures were: the ability to retain the important information about the death using the InfoKeep rating; the ease of use according to the Ease rating (both measures used a five-point scale with a score <2 considered unsatisfactory); inter-observer agreement and the proportion of unexplained stillbirths. A randomly selected subset of 100 stillbirths was used to assess inter-observer agreement.
InfoKeep scores were significantly different across the classifications (p ≤ 0.01) due to low scores for Wigglesworth and Aberdeen. CODAC received the highest mean (SD) score of 3.40 (0.73) followed by PSANZ-PDC, ReCoDe and Tulip [2.77 (1.00), 2.36 (1.21), 1.92 (1.24) respectively]. Wigglesworth and Aberdeen resulted in a high proportion of unexplained stillbirths and CODAC and Tulip the lowest. While Ease scores were different (p ≤ 0.01), all systems received satisfactory scores; CODAC received the highest score. Aberdeen and Wigglesworth showed poor agreement with kappas of 0.35 and 0.25 respectively. Tulip performed best with a kappa of 0.74. The remainder had good to fair agreement.
The Extended Wigglesworth and Amended Aberdeen systems cannot be recommended for classification of stillbirths. Overall, CODAC performed best with PSANZ-PDC and ReCoDe performing well. Tulip was shown to have the best agreement and a low proportion of unexplained stillbirths. The virtues of these systems need to be considered in the development of an international solution to classification of stillbirths. Further studies are required on the performance of classification systems in the context of developing countries. Suboptimal agreement highlights the importance of instituting measures to ensure consistency for any classification system.
- Fetal Growth Restriction
- Perinatal Death
- Develop Country Setting
- Suboptimal Care
- Placental Pathology
Globally, over 3 million babies are stillborn every year with the vast majority occurring in developing countries . While less frequent in developed countries (<1% of births), the large contribution of stillbirth to overall perinatal deaths combined with static or increasing rates over the past decade  clearly demonstrates that stillbirth is a major public health problem in these settings.
Classification of stillbirths, predicated on systematic assembly, storage and retrieval of the underlying cause of death and/or other relevant important information, is accepted as a crucial step towards the goal of reducing the numbers of stillborn infants [2, 3]. However, the use of suboptimal classification systems may lead to a loss of important information and contributes to a high proportion of unexplained deaths. These deaths may be interpreted as unavoidable thereby diminishing the potential of immediate and longer term prevention strategies including research to address knowledge gaps. The wide variation in the reported contribution of unexplained stillbirth from 15%  to 71%  has been attributed to the classification system [5, 6], thoroughness of investigation and the definition used [7, 8]. The value of any death classification system is closely aligned with its ability to identify the underlying causes of death and the key factor which started the chain of events leading to the death. However, assigning a single cause is often challenging (and often inappropriate) due to the complexity of the clinical situation within which the fetus dies . Therefore, classification systems for stillbirths must capture both the underlying cause and also the often multiple important factors and combinations of factors associated with these deaths. Due to inadequacies of the International Classification of Diseases (ICD)  coding system for this purpose, clinicians and researchers have been considering ways of classifying stillbirths to better understand the aetiology and patterns of causation of stillbirth for more than two decades .
Stillbirths first became notifiable in Scotland in 1940  and in 1954 the classification developed by Sir Dugald Baird and his colleagues in Aberdeen for the purpose of audit and surveillance was published . Subsequently, numerous systems have emerged. In a recent search we identified 33 new systems [4, 5, 8, 9, 11, 13–40] and a further 12 modifications of these systems [5, 41–51] for the classification of causes and associated conditions and/or suboptimal care among stillbirths. While the majority of these systems were designed for both stillbirths and neonatal deaths, three systems were designed specifically for stillbirths [4, 28, 33]. Two other systems, in addition to neonatal deaths, also included postneonatal deaths; one up to hospital discharge  and the other up to 12 months of age . While it is important to analyse the causes of perinatal death according to its components of stillbirth and neonatal death , a system specifically designed to incorporate both groups enables interpretation of differences in the rates and causation across regions arising from variation in definition, reporting and registration practices for perinatal deaths .
According to Whitfield, the purpose of classification is 'to identify deficiencies in the provision of care, to focus attention where improvements are already possible and to indicate where new developments or knowledge may be expected to lead to further advance' . The overarching goal, common to all classification systems, is the reduction of stillbirths and the primary purpose of classification, also common to all, is to conserve the useful information about the death. The secondary purpose relates to the intended use of the conserved information, which varies widely. There are four main categories: 1) to enable regional and international comparisons; 2) to undertake epidemiology and health surveillance; 3) for clinical practice i.e. quality improvement and parent counselling; and 4) for research use. These four categories represent very different requirements for a classification depending on the setting, e.g. a rural region of Africa compared to a tertiary teaching hospital in Europe. Despite the differences in use, the original case information is the data source for all classifications. For some this will be an extensive protocol of clinical history, examinations and tests. For others only sparse clinical information is available. Irrespective of the completeness of the original case information, the narrative of the case history is often a crucial part of the information that needs to be conserved. In addition to information capture, ease of use and inter-rater agreement are important requirements of any classification system.
A uniform global approach to classification of stillbirths is the ideal. The current use of disparate and possibly suboptimal classification systems for stillbirths limits the potential for advancements in the understanding of stillbirth and prohibits meaningful comparisons across regions and countries to assist in identifying priorities for prevention. There have been no studies evaluating the different contemporary classifications for stillbirths over a range of different users and settings focusing on the important virtues of information retention, ease of use and inter-rater agreement. We undertook this study to address this knowledge gap for the purpose of informing the development of an internationally accepted approach to the classification of stillbirths.
Identification of classification systems
We searched for published and unpublished reports of new classification systems or major revisions of existing systems which were developed for the classification of stillbirths. We restricted the search to the English language and searched electronic databases (Medline, Cochrane Library 1996–2006) and websites of relevant professional organisations. We also contacted expert informants and cross-referenced identified publications to identify relevant publications. As we were interested in classification systems that can be used widely, not only for detection of suboptimal care, but also to classify the main factors involved in a perinatal death as ascribed by an experienced clinical team, we excluded classification systems focusing on suboptimal care or avoidable factors and automated computer classification systems. In addition, we excluded reports of informal groupings of deaths, e.g. post hoc categorization based on the findings of hospital perinatal death committee meetings and duplicate publications of the same or very similar systems. For publications of the same classification system or those which were considered to be a minor modification, the most recent publication was chosen for inclusion.
The search identified 28 reports of potentially eligible systems. Following review of the full publications, 22 reports were excluded leaving six systems for evaluation: Amended Aberdeen ; Extended Wigglesworth , PSANZ-PDC (Perinatal Society of Australia and New Zealand – Perinatal Death Classification) [11, 53], ReCoDe: Relevant conditions at death , Tulip , CODAC (Cause of Death and Associated Conditions) . The exclusions were: systems focusing on suboptimal care [16, 17, 23, 24, 34]; automated computer systems [20, 36]; duplicate publications (i.e. the same or very similar systems) [21, 44, 45, 51, 54–58]; studies reporting evaluations of systems [59–61]. Further, one system was excluded due to its major focus on postneonatal death conditions  and a further two were excluded as they were initial proposals of new systems [8, 28], one of which has been subsequently published .
Characteristics of included systems
Three systems are intended to be used in a strictly hierarchical manner (Aberdeen, Wigglesworth, ReCoDe), one system recommends a hierarchical approach to be used as a guide only (Tulip), another (PSANZ) also recommends a hierarchical approach as a guide apart from the initial category (congenital abnormalities) which takes priority. The remaining system (CODAC) uses a hierarchical approach for terminations of pregnancy only. Three classifications are intended to identify a single underlying cause of death (Tulip, Wigglesworth, Aberdeen), two aim to identify the cause of death (COD), if present, and associated conditions in secondary and tertiary levels of the system (CODAC and PSANZ-PDC). The remaining system, ReCoDe, aims to identify relevant conditions including either the cause of death and/or other relevant conditions, with the ability to assign two codes. Apart from the Tulip and CODAC classifications, the included systems use largely clinically based categories with very few categories for placental pathology. The Tulip classification, in addition to identifying a single demonstrable pathophysiological cause for the death, was also designed to identify the mechanism and the origin of the mechanism of the death, e.g. if the cause of an intrauterine death was attributed to infection, multiorgan failure would be considered the mechanism of the death and intrauterine infection the origin of the mechanism. All systems were designed in a developed country setting. Only one system was developed exclusively for stillbirths (ReCoDe). The number of categories and subcategories vary widely (Additional file 1).
Main outcome measures
1. Retaining relevant information: InfoKeep Score
To measure the extent to which the classification teams agreed that important information to aid in the understanding of the death was conserved and was retrievable after classification, we used a scoring system; InfoKeep. InfoKeep was designed specifically for this study and consisted of a five point rating scale from 0 (Disagree) to 4 (Agree). Prior to application of this scale, the classification teams responded to the question as to whether important information to assist in understanding the circumstances of the death was identified in each case by responding either as No, Somewhat or Yes across ten potential information sources. The information source categories provided were: maternal history or health; fetal history or health; intrapartum events or conditions; autopsy results; placental histopathology; examination of the cord and membranes; cultures or other tests for infection; genetic testing; other tests or examinations; and other sources.
2. Ease of application: Ease Score
The Ease scoring system, also developed for the purpose of this study, was made up of a five point scale to measure, after the cause of death and associated conditions were determined for each case, the extent to which the classification team agreed that it was easy to identify the relevant category in the classification system. The scores ranged from zero to four with zero indicating that it was not possible to identify the relevant category in the classification and four indicating a relevant category was very easily identified.
3. Inter-observer reliability
Inter-observer reliability for the major categories of the classification systems was assessed using a randomly selected subset of 100 stillbirths from five study teams who agreed to participate in this aspect of the study. Inter-observer agreement beyond chance for the main classification categories was assessed using the unweighted kappa statistic.
The overall proportion of unexplained stillbirths resulting from the application of each classification.
Classification teams and stillbirth cohorts
Study investigators made up the classification teams. As this study was designed to test how each system performed in a "real life" classification situation, membership of the classification teams was intended to reflect usual procedures at each of the participating sites. To reduce the potential for bias, developers of any of the included classification systems were excluded from participation in the classification teams.
Nine classification teams across five developed countries and two developing country settings were included: three in Australia (Brisbane, Sydney, and Perth) and one team each in Norway, Canada, US, South Africa, Malaysia and Sweden. Membership of the teams usually included two persons with varying backgrounds including: obstetrics, maternal fetal medicine specialists, midwifery, neonatology and paediatrics, perinatal pathology, and a public health specialist. All classification teams were experienced in classification of stillbirths through their usual practice either at a hospital or regional level. All stillbirth cases included in this study had been previously reviewed and classified by a multidisciplinary committee, in which the classification team members participated, using the classification system routinely used in their practice. These classifications were as follows: Australia – the PSANZ-PDC; Malaysia – modified Wigglesworth; South Africa – a modification of Aberdeen similar to PSANZ-PDC; US – an informal pathological grouping system; Sweden – The Stockholm Classification of Stillbirth; Norway – ICD 10 and an earlier version of CODAC; and Canada – modified Wigglesworth. For this study, six teams contributed population-based cases and three contributed cases from individual institutions. The primary purpose of classification for the population-based cohorts was for epidemiological analyses to identify areas for prevention through practice and policy improvements. The purpose for two hospital-based teams was primarily for clinical audit aimed at practice improvement as well as contributing to epidemiological population-based data. The remaining hospital-based team classified stillbirths for the purposes of research focusing on placental pathology.
Each classification team was asked to identify a consecutive series of 100 stillbirths according to local definition from the routinely collected data for the most recent time period and to assemble the information which is usually reviewed for each case. Eight teams used between 86 and 106 cases each and one team used 67 cases for testing, giving a total of 857 cases of stillbirths. Classification teams applied all six included classifications systems and assigned the two rating scores (InfoKeep and Ease) to each stillbirth from their own cohort.
Classification instructions, which were available in the public domain, were provided to the classification teams as well as paper-based classifications in a standardised format (Additional file 2). Teams were asked to become familiar with the instructions for each system prior to commencing the testing. As the instructions for the number of classification categories which could be assigned to each case varied across the classification, for consistency, the classification teams were asked to assign up to three categories for complicated cases. The written instructions provided for CODAC were not, at that time, available in the public domain. Five systems were used as paper-based systems and one, CODAC, in an electronic format. Four members of the research team independently applied the six classifications to a random sample (stratified by centre) of 100 stillbirths from five centres, to enable assessment of inter-rater agreement. For this analysis, deidentified case summaries from five centres were provided to the main coordinating centre for compilation and distribution to the testers.
Data collection, management and analysis
Following review of each stillbirth case, the classification teams assigned the six classifications and the scoring systems using a purpose built database developed in Microsoft Excel. Following completion of the testing, the data file was sent electronically to the main coordinating centre for analysis using StataSE 9.2. The data analyst (KG) was not involved in either the development of any of the included classifications or any other aspect of the design or conduct of the study. Classification scores InfoKeep and Ease were analysed using ANOVA. Mean scores <2 were considered unsatisfactory. InfoKeep scores were analysed for the information categories in which teams responded as either Yes or Somewhat that significant information was identified. The level for rejection of a false positive finding was set at p = 0.05 or less for all outcome measures. Post hoc analysis was undertaken using the Bonferroni technique. To assess how each system performs for common stillbirth scenarios, subgroup analyses were performed for InfoKeep according to the presence of fetal growth restriction, placental pathology, congenital abnormality, intrapartum deaths and multiple pregnancies. These subgroups were assembled by combining all stillbirths classified into one or more of the relevant categories across the classifications systems. Data from developing country teams were compared with that from developed countries. In addition, the proportion of unexplained stillbirths was analysed across the classifications and classification teams. Inter-observer agreement beyond chance for the main classification categories was assessed using the unweighted kappa statistic with the following interpretation: poor <0.40; fair 0.40–<0.55; good 0.55–<0.70; very good 0.70–<0.85; and excellent ≥0.85 .
This study was approved by the Human Research Ethics Committee, Mater Health Services, Brisbane, Australia.
Of the 857 stillbirths included in the study, 256 (29.9%) were intrapartum deaths and 56 (7.6%) were from a multiple pregnancy. Placental pathology was classified by one or more of the classification systems in 506 (59.0%), fetal growth restriction in 168 (19.6%), and congenital abnormalities in 156 (18.2%).
Four classification systems received unsatisfactory mean InfoKeep scores (<2) for one or more of the 10 information categories. Aberdeen and Wigglesworth received unsatisfactory scores for all 10 information categories. Tulip received unsatisfactory scores for five categories [mean (SD)]: maternal history and health, 1.88 (1.64); autopsy 1.99 (1.41); cord and membranes, 1.81 (1.34); infections, 1.97 (1.47); and other tests, 1.70 (1.60). ReCoDe received a single unsatisfactory score for genetic testing [1.38 (1.50)].
Ease of use
Ease scores were significantly different across the classifications (p < 0.01). However, all classifications received satisfactory scores. CODAC received the highest score [mean (SD)] 3.45 (0.79) followed by PSANZ-PDC 3.21 (0.91), ReCoDe with 2.92 (1.06), Wigglesworth 2.80 (1.19), Aberdeen 2.65 (1.18), and Tulip 2.61 (1.12) (Figure 1). Post hoc analyses revealed that ReCoDe and Wigglesworth were similar (p = 0.32), as were Aberdeen and Tulip (p = 1.0) and Aberdeen and Wigglesworth (p = 0.25).
Inter-rater agreement for the major categories of the classifications across four classifiers using 100 stillbirth cases showed Aberdeen and Wigglesworth to have poor agreement with kappas of 0.35 and 0.25 respectively. Tulip performed best with a kappa of 0.74. The remainder had good to fair agreement as follows: CODAC, 0.65; PSANZ-PDC, 0.63; and ReCoDe, 0.51.
While comparison of the proportion of unexplained stillbirth yielded by each of the classification systems is extremely problematic due to the differences in available categories and approaches to classification, Wigglesworth and Aberdeen were shown to have the highest proportion of unexplained stillbirths (50.2% and 44.3% respectively) and CODAC the least (9.5%), while Tulip performed similarly to CODAC with 10.2% of cases unexplained. Including only the subcategory of unexplained stillbirth without evidence of utero-placental insufficiency (i.e. placental examination or antenatal Doppler evidence), PSANZ-PDC was shown to have a similar proportion of unexplained stillbirths as ReCoDe (15.4% and 13.8% respectively). Variation in the proportion unexplained was shown across the classification teams reflecting differences in interpretation of the classification systems. However, these differences were not significant (p = 0.38) (Additional file 3).
All systems received satisfactory Ease scores with the ranking by score unchanged. Tulip received the lowest Ease scores most frequently (three of the five subcategories) for [mean (SD)]: fetal growth restriction, 2.31 (1.14); placental pathology, 2.36 (1.08); and multiple pregnancy, 2.39 (1.37).
Developing country settings
Information sources, by country setting
n = 676
n = 181
Intrapartum events or conditions
Cord and membranes
Cultures or other tests for infection
InfoKeep and Ease scores, developed compared with developing country setting
n = 676
n = 181
n = 676
n = 181
Three classification teams worked in the same institution as developers of two of the included classifications: the Brisbane team with a developer of the PSANZ-PDC (VF) and the Norwegian and the US teams with CODAC (JFF, HP respectively). To explore the effect of potential bias on the results we examined Ease and InfoKeep scores assigned by these teams to those systems. Two of the three classification teams scored the classifications with which they were associated lower than did other classification teams. For PSANZ-PDC assigned by the Brisbane team, the overall Ease and InfoKeep scores [mean (SD)] were lower than the rest; Ease PSANZ-PDC 2.76 (0.99) versus the rest 3.27 (0.88), InfoKeep 2.32 (1.07) versus 2.82 (0.98) (p < 0.01). This finding held when examining the three Australian teams combined versus the rest. The Norwegian and US scores for CODAC were not significantly different for Ease however (while the difference was small) InfoKeep was scored significantly higher than the rest; 3.55 (0.69) versus 3.35 (0.74) (p < 0.01).
The basic requirements for classification systems for stillbirth are to record the underlying cause of death and other relevant information to aid in understanding of the true contributors to stillbirth, to be easy to apply, and to perform robustly across different settings and classifiers. According to these criteria, this evaluation, by nine experienced international classification teams of six contemporary classifications across developed and developing country settings, did not identify any single system as clearly superior for stillbirths for the outcomes studied. However, CODAC performed consistently better than the rest in terms of information retention and ease of use and was also shown to have good inter-rater agreement. The Extended Wigglesworth and the Amended Aberdeen classifications were shown to be clearly inferior for all outcomes in this study. This result is consistent with the finding of others [5, 6] which report that Wigglesworth and Aberdeen result in a large proportion of unexplained stillbirths. CODAC and PSANZ-PDC were the only classifications receiving satisfactory scores for information retention, across all sources of important information identified. ReCoDe received only one unsatisfactory score for information retention in the area of genetic testing which was shown to be one of the less frequent sources of important information. As would be expected, these systems also resulted in a low proportion of unexplained stillbirths. The numbers of available categories probably influenced the scoring for information retention as the two highest scoring systems (CODAC and PSANZ-PDC) also had the greater numbers of available categories. Other aspects of CODAC which may have resulted in better performance include its structured approach to identifying the underlying cause and its ability to capture narrative aspects of the death through the clustering of subcategories of the relevant associated conditions. The main sources of important information about the stillbirth came from the placenta, the maternal and fetal health and history and the autopsy. Three systems, CODAC, PSANZ-PDC and ReCoDe, performed satisfactorily in terms of retaining this information with CODAC again receiving the highest scores. Placental pathology was identified as an important source of information about the death in over 60% of stillbirths, consistent with other studies [54, 61, 64]. An evaluation of seven classification systems for stillbirths was recently reported by the developers of Tulip in the Netherlands . This evaluation, which focussed on placental histopathology, found that Tulip performed best in retaining placental information and as a result reduced the proportion of unexplained stillbirths when compared with other stillbirth classifications. While our study did not confirm Tulip's superiority in this respect, comparison with this study is problematic due to differences in setting, investigation level, purpose and methodology. However, in our study Tulip resulted in a low proportion of unexplained stillbirths. This finding may result from the inclusion of an unclassifiable category for cases where it is deemed that important information was missing (e.g. adequate clinical history, autopsy or placental pathology). As placental pathology is an important finding in many stillbirths, we agree with Korteweg et al that further definition of the placental causes of stillbirth is needed and that further research to investigate the clinical manifestations of these placental causes of stillbirth is important in the prevention of these deaths.
The variation in the proportion of unexplained stillbirths across classifications is at least partly explained by the classification system. In the PSANZ system the unexplained group includes those with placental disease but who do not have growth restriction or other features. Other systems ignore growth restriction as an important factor and some ignore cases that are "unexplored" due to suboptimal investigations or where other important information is missing. Our study used materials from both developed and developing countries with varying investigation levels across the cohorts. In the participating developing countries, autopsy was not performed for any stillbirth whereas for developed countries the autopsy rate ranged from 40–80% and placental pathology rates ranged from 40–98%. Classification systems may perform quite differently in developing versus developed country settings due to dissimilar aetiologies of stillbirth  and the frequent paucity of information about the death in developing country settings. In this study, the information sources which were deemed important for stillbirths from developing country settings highlighted these differences. The placenta was an important source of information in just under one quarter of stillbirths in developing countries compared with 72% in the developed country cohorts as it was not often examined in developing countries. Maternal history was the source of important information in over 90% of cases from the developing country versus 50% in the developed countries. Important information relating to intrapartum events was identified in 42% of cases from the developing countries versus 15% in developed country settings. Despite these differences (which were likely to be largely as a result of differences in investigation level) the findings from developing country cohorts were very similar to those of the developed countries in terms of information retention and ease of use. Wigglesworth was shown to perform slightly better in terms of information retention in the developing countries than in developed countries. This may relate to a match between the lack of detail on stillbirths in these settings and the limited choice of categories in this system. The original  and modified Wigglesworth  systems have been the most frequently used classifications in developing country settings and have been found to be easy to apply and helpful in comparisons across countries . However, while small numbers do not permit meaningful conclusions to be drawn, our results suggest that more complex systems may perform better than Wigglesworth in at least some developing country settings.
The study teams rated the classifications similarly easy to use despite the differences shown in ratings for retention of information. This may be due to the experience of members of the classification teams that therefore quickly became familiar with the approaches used for the different systems and, if so, this finding may not be replicable in other situations. One might expect that the increased complexity of systems may result in a diminution of user-friendliness. However, we found that the two classifications having the highest number of categories performed best. CODAC may have performed well in terms of ease of use despite far greater numbers of categories due, in part, to the electronic format of this system. CODAC has a user-friendly interface which utilises expandable categories reducing the exposure of the user to the complexity of the system. However, this electronic format may not be suitable in all settings.
Consistency in the application of any classification system is essential. We found inter-rater agreement to be largely suboptimal. Agreement for the major classification categories showed Aberdeen and Wigglesworth perform poorly. ReCoDe was shown to have fair agreement and CODAC and PSANZ-PDC showed good agreement. Tulip performed best with a kappa of 0.74. However, the level of agreement shown is likely to reflect unacceptably low levels of agreement within subcategories even for the best performing system. In assessing agreement, the classifications were applied by individual members of the study team who were not authors of these systems. Publicly available written instructions were provided to the teams, but no other training was provided. The teams agreed that the majority of classification systems failed to provide sufficient instructions on use. While Tulip appeared more difficult to use (according to the Ease score), having been used, it performed better in enabling different observers to come to the same conclusions more often than other systems. This suggests that we should examine how Tulip, through its greater focus on pathophysiology, may have important strengths. Agreement may have been higher for all systems if we had used a multidisciplinary panel approach . Classification of stillbirths is often undertaken by individuals without specific training and consequently the finding of suboptimal agreement may reflect reality and thus raises concern about the value of comparisons across and within different settings. The reported agreement for perinatal classifications systems varies. Keeling et al in 1989  reported an 85% agreement with the earlier version of Wigglesworth. Others have reported kappas for major categories ranging from excellent to good: 0.85–0.90 for PSANZ-PDC ; 0.81 for Tulip ; 0.7 for a classification system by de Galan-Roosen [21, 54]; 0.58 for the Fetal and Neonatal Factors (a system based on experience with the Wigglesworth classification); and 0.55 for the Aberdeen system . Many evaluations of classification systems have been undertaken by the original authors or stakeholders themselves. Thus, the potential for systematic bias influencing the conclusions of such studies can not be excluded. While three investigators were closely involved in the development of two of the systems tested (CODAC and PSANZ-PDC) and bias cannot be excluded, steps were taken to minimize this risk and exploration through subgroup analyses, examining scoring for information retention and ease of use, did not reveal any major concerns.
All included systems incorporated some form a hierarchical approach with three systems (Wigglesworth, Aberdeen and ReCoDe) using a more strict approach than the others. One of the perceived benefits of using a hierarchical approach is increased consistency. While small numbers did not permit investigation of this feature, this possible benefit was not apparent in our study. Another benefit of a hierarchical system may be increased user friendliness however this was also not borne out in our study. The danger of strictly hierarchical systems is possible underestimation of the importance of factors further down the list of categories and therefore a loss of focus for research and prevention strategies. If in fact a hierarchical approach confers no benefit in terms of consistency or user friendliness and carries a risk of misleading information on the relative importance of certain factors one could argue that this approach is unwarranted. Further research is required to examine the performance of this approach. While systems which identify all relevant factors about the death are valuable to inform future research and prevention, those which confuse risk factors and associated conditions (e.g. post-maturity, smoking, uncomplicated maternal hypertension, obesity, fetal growth restriction) and/or mechanisms (e.g. "placental insufficiency") with causes of death defeat the main purpose of classifying to identify the underlying cause of death and to allow for future research towards prevention. While we did not specifically evaluate the systems in terms of the interchange between causes and associated conditions, the teams noted that this was an issue for a number of systems particularly for those in which a hierarchical approach is strictly applied. Another important virtue of a classification system is the ability to change over time as disease processes are recognised and better understood. Placental pathology remains an area where much work needs to be done to document the correlation of histological changes on placental function and therefore, ideally, classification systems should allow for expansion in this area.
While the strengths of this study include the large numbers of stillbirths included and the applicability to a wide range of settings, an important limitation was the use of non-validated instruments for assessing the outcome measures of information retention and ease of use. However, while a loss of robustness and diminished validity of our findings as a result of these measurements must be acknowledged, as the instruments were unambiguous in their intent and easy to apply we feel reasonably confident that, for the purposes of our study, they provided useful measures. The subgroup analysis according to stillbirth characteristics conditions [such as stillbirths with fetal growth restriction and placental conditions] was undertaken as these appear to be important clinical groups. However, we recognise that some classification systems are better designed than others to note such conditions leading to an inherent bias in the results.
We did not include the ICD system  in our evaluation as it is considered a listing of conditions rather than a classification system per se. The ICD is the international standard diagnostic classification for epidemiological analyses utilising routinely collected data from death certificates and hospitals medical records. There is general consensus amongst those undertaking classification of stillbirth that ICD does not meet their needs. This is largely due to the cumbersome nature of the system as a result of the large number of categories which are not relevant to stillbirth. However, we believe that a link to the ICD system and classifications systems used as a part of clinical audit is crucial for better implementation and further development of definitions of categories. Underpinning the value of any classification system for stillbirth is the collection of adequate and consistent information about these deaths. The current lack of such information is a major barrier to addressing the problem of stillbirths globally. Development and implementation of an internationally accepted minimum dataset and investigation protocol for stillbirths would greatly enhance the value of classifying stillbirths. While data from developing countries in this study were limited, the approach used by the CODAC classification appears promising as an international solution. As reported elsewhere in the BMC  the investigator team with additional international collaborators have continued further enhancement of the CODAC system and plan to use this system within their own settings over a period of time prior to re-evaluation of its performance across these diverse settings.
The basic requirements of stillbirth classification are to retain important information towards understanding the causes of stillbirth, to be easy to apply and have high inter-observer agreement. In this study of six contemporary systems, the Extended Wigglesworth and Amended Aberdeen were clearly shown to perform suboptimally and therefore cannot be recommended for classification of stillbirths. CODAC consistently performed best in terms of retaining important information and ease of use followed by PSANZ-PDC and ReCoDe. Tulip demonstrated the best agreement. All three systems resulted in a low proportion of unexplained stillbirths. Therefore, the virtues of these classifications should be considered in the development of an international classification system. However, further evaluation of the performance of systems in developing country settings is required. Future development of an international solution for classification of stillbirths should strive for alignment in categories and definitions with the ICD system and ensure relevance to developing country settings. Further research is required to better define the placental causes of stillbirth and to identify clinical manifestations of these causes. Measures to ensure consistency in the classification of stillbirths is crucial to undertaking meaningful comparisons across time and geographic locations.
The authors would like to acknowledge the support of the International Stillbirth Alliance  in facilitating the collaboration of the research team. We also thank Kristyn Middleton, Sharon Egan, Elizabeth Flenady and Laura Koopmans for assisting with formatting the manuscript and literature searching
- Stanton C, Lawn J, Rahman H, Wilczynska-Ketende K, Hill K: Stillbirth rates: delivering estimates in 190 countries. Lancet. 2006, 367: 1489-1494. 10.1016/S0140-6736(06)68586-3.View ArticleGoogle Scholar
- Smith GCS, Fretts RC: Stillbirth. Lancet. 2007, 370: 1715-1725. 10.1016/S0140-6736(07)61723-1.View ArticlePubMedGoogle Scholar
- Pattinson RC, Say L, Makin JD, Bastos MH: Critical incident audit and feedback to improve perinatal and maternal mortality and morbidity. Cochrane Database of Systematic Reviews. 2005, CD002961-4Google Scholar
- Gardosi J, Kady SM, McGeown P, Francis A, Tonks A: Classification of stillbirth by relevant condition at death (ReCoDe): population based cohort study. BMJ. 2005, 331 (7525): 1113-1117. 10.1136/bmj.38629.587639.7C.View ArticlePubMedPubMed CentralGoogle Scholar
- CESDI – Confidential Enquiry into Stillbirths and Deaths in Infancy: 8th Annual Report. 2001, London: Maternal and Child Health Research ConsortiumGoogle Scholar
- Korteweg FJ, Gordijn SJ, Timmer A, Holm JP, Rvaisé JM, Erwich JJHM: A placental cause of intra-uterine fetal death depends on the perinatal mortality classification system used. Placenta. 2007, 29: 71-80. 10.1016/j.placenta.2007.07.003.View ArticlePubMedGoogle Scholar
- Measey M, Charles A, d'Espaignet E, Harrison C, Douglass C: Aietiology of stillbirth: unexplored is not unexplained. Aust NZ J Public Health. 2007, 31: 5-10.1111/j.1753-6405.2007.00116.x.View ArticleGoogle Scholar
- Frøen JF: Sudden Intrauterine Unexplained Death. PhD thesis. 2002, Medical Faculty, University of Oslo, OsloGoogle Scholar
- Wigglesworth JS: Monitoring perinatal mortality. A pathophysiological approach. Lancet. 1980, 2 (8196): 684-686. 10.1016/S0140-6736(80)92717-8.View ArticlePubMedGoogle Scholar
- International Classification of Diseases. [http://www.who.int/classifications/icd/en/index.html]
- Chan A, King JF, Flenady V, Haslam RH, Tudehope DI: Classification of perinatal deaths: development of the Australian and New Zealand classifications. J Paediatr Child Health. 2004, 40 (7): 340-347. 10.1111/j.1440-1754.2004.00398.x.View ArticlePubMedGoogle Scholar
- Baird D, Wyper JFB: High stillbirth and neonatal mortalities. Lancet. 1941, 2: 657-659. 10.1016/S0140-6736(00)72185-4.View ArticleGoogle Scholar
- Baird D, Walker J, Thomson AM: The causes and prevention of stillbirths and first week deaths. III. A classification of deaths by clinical cause; the effect of age, parity and length of gestation on death rates by cause. J Obstet Gynaecol Br Emp. 1954, 61 (4): 433-448.View ArticlePubMedGoogle Scholar
- Pattinson RC, Makin JD, Shaw A, Delport SD: The value of incorporating avoidable factors into perinatal audits. S Afr Med J. 1995, 85 (3): 145-147.PubMedGoogle Scholar
- Whitfield CR, Smith NC, Cockburn F, Gibson AA: Perinatally related wastage – a proposed classification of primary obstetric factors. Br J Obstet Gynaecol. 1986, 93 (7): 694-703.View ArticlePubMedGoogle Scholar
- Saasted E, Vangen S, Frøen F: Suboptimal care in stillbirths – a retrospective study. Acta Obsetricia et Gynaecologica. 2007, 86 (4): 444-450. 10.1080/00016340701207724.View ArticleGoogle Scholar
- De Lange TE, Budde MP, Heard AR, Tucker G, Kennare R, Dekker G: Avoidable risk factors in perinatal deaths: A perinatal audit in South Australia. ANZJOG. 2008, 48: 50-57.PubMedGoogle Scholar
- Frøen JF, Pinar H, Flenady V: Integrating the Purposes of Stillbirth Classifications. 2006 International Stillbirth Alliance Conference in collaboration with 9th SIDS International Conference: 1–4 June; Yokohama, Japan. 2006, [http://www.stillbirthalliance.org/conference/2006/index.html]Google Scholar
- Korteweg FJ, Gordijn S, Timmer A, Erwich J, Bergman K, Bouman K, Ravise J, Heringa M, Holm J: The Tulip classification of perinatal mortality: introduction and multidisciplinary inter-rater agreement. BJOG. 2006, 113: 393-401. 10.1111/j.1471-0528.2006.00881.x.View ArticlePubMedGoogle Scholar
- Winbo IG, Serenius FH, Dahlquist GG, Kallen BA: NICE, a new cause of death classification for stillbirths and neonatal deaths. Neonatal and Intrauterine Death Classification according to Etiology. Int J Epidemiol. 1998, 27 (3): 499-504. 10.1093/ije/27.3.499.View ArticlePubMedGoogle Scholar
- de Galan-Roosen AE, Kuijpers JC, Straaten van der PJ, Merkus JM: Fundamental classification of perinatal death. Validation of a new classification system of perinatal death. Eur J Obstet Gynecol Reprod Biol. 2002, 103 (1): 30-36. 10.1016/S0301-2115(02)00023-4.View ArticlePubMedGoogle Scholar
- Myers SA, Fisher DE, Moawad A, Paton JB, Lee KS, Ferguson M: Assessment of potentially avoidable perinatal mortality in a regionalized program. J Reprod Med. 1990, 35 (1): 29-34.PubMedGoogle Scholar
- Coria-Soto I, Zambrana-Castaneda M, Reyes-Zapata H, Salinas-Martinez AM: Comparison of two methods for the discrimination of avoidable perinatal deaths. J Perinat Med. 1997, 25 (2): 205-212.View ArticlePubMedGoogle Scholar
- Richardus JH, Graafmans WC, Verloove-Vanhorick SP, Mackenbach JP: Differences in perinatal mortality and suboptimal care between 10 European regions: results of an international audit. BJOG. 2003, 110 (2): 97-105. 10.1046/j.1471-0528.2003.02053.x.View ArticlePubMedGoogle Scholar
- Alberman E, Botting B, Blatchley N, Twidell A: A new hierarchical classification of causes of infant deaths in England and Wales. Arch Dis Child. 1994, 70 (5): 403-409. 10.1136/adc.70.5.403.View ArticlePubMedPubMed CentralGoogle Scholar
- Alessandri LM, Chambers HM, Blair EM, Read AW: Perinatal and postneonatal mortality among Indigenous and non-Indigenous infants born in Western Australia, 1980–1998. Med J Aust. 2001, 175 (4): 185-189.PubMedGoogle Scholar
- Hey EN, Lloyd DJ, Wigglesworth JS: Classifying perinatal death: fetal and neonatal factors. Br J Obstet Gynaecol. 1986, 93 (12): 1213-1223.View ArticlePubMedGoogle Scholar
- Hültén-Varli I, Hofsjö A, Bottinga R, Bremme K, Holm M, Holste C, Norman M, Papadogiannakis N, Pilo C, Thomassen P, Wolff K, Petersson K: A New Classification of Fetal Death, the Swedish Experience. 2005 International Stillbirth Conference: Washington, DC, USA. 2005, [http://firstcandle.org/conf2005/index.htm]Google Scholar
- Low JA, Boston RW, Crussi FG: Classification of perinatal mortality. Can Med Assoc J. 1971, 105 (10): 1044-1046.PubMedPubMed CentralGoogle Scholar
- Knutzen VK, Baillie P, Malan AF: Clinical classification of perinatal deaths. S Afr Med J. 1975, 49 (35): 1434-1436.PubMedGoogle Scholar
- Naeye RL: Causes of perinatal mortality in the US Collaborative Perinatal Project. JAMA. 1977, 238 (3): 228-229. 10.1001/jama.238.3.228.View ArticlePubMedGoogle Scholar
- Davies BR, Arroyo P: The importance of primary diagnosis in perinatal death. Am J Obstet Gynecol. 1985, 152 (1): 17-23.View ArticlePubMedGoogle Scholar
- Hovatta O, Lipasti A, Rapola J, Karjalainen O: Causes of stillbirth: a clinicopathological study of 243 patients. Br J Obstet Gynaecol. 1983, 90 (8): 691-696.View ArticlePubMedGoogle Scholar
- Borch-Christensen H, Langhoff-Roos J, Larsen S, Lindberg B, Wennergren M: The Nordic/Baltic perinatal death classification. Acta Obstet Gynecol Scand Suppl. 1997, 164: 40-42.PubMedGoogle Scholar
- Fairweather DV, Russell JK, Anderson GS, Bird T, Millar DG, Pearcy PA: Perinatal mortality in Newcastle upon Tyne 1960–62. Lancet. 1966, 1 (7429): 140-142. 10.1016/S0140-6736(66)91276-1.View ArticlePubMedGoogle Scholar
- Winbo IG, Serenius FH, Dahlquist GG, Kallen BA: A computer-based method for cause of death classification in stillbirths and neonatal deaths. Int J Epidemiol. 1997, 26 (6): 1298-1306. 10.1093/ije/26.6.1298.View ArticlePubMedGoogle Scholar
- Chang A, Keeping JD, Morrison J, Esler EJ: Perinatal death: audit and classification. Aust N Z J Obstet Gynaecol. 1979, 19 (4): 207-211. 10.1111/j.1479-828X.1979.tb01374.x.View ArticlePubMedGoogle Scholar
- Fretts RC, Boyd ME, Usher RH, Usher HA: The changing pattern of fetal death, 1961–1988. Obstet Gynecol. 1992, 79 (1): 35-39.PubMedGoogle Scholar
- Stanley FJ, Hobbs MST: Perinatal outcome in Western Australia, 1968 to 1975. 3. Causes of stillbirths and neonatal deaths excluding congenital malformations. Med J Aust. 1981, 1: 483-486.PubMedGoogle Scholar
- Lammer EJ, Brown LE, Anderka MT, Guyer B: Classification and analysis of fetal deaths in Massachusetts. JAMA. 1989, 261 (12): 1757-1762. 10.1001/jama.261.12.1757.View ArticlePubMedGoogle Scholar
- Cole SK, Hey EN, Thomson AM: Classifying perinatal death: an obstetric approach. Br J Obstet Gynaecol. 1986, 93 (12): 1204-1212.View ArticlePubMedGoogle Scholar
- Dickson N, Bhula P, Wilson PD: Use of classification of primary obstetric factors in perinatally related mortality surveillance. N Z Med J. 1988, 101 (845): 228-231.PubMedGoogle Scholar
- Keeling JW, MacGillivray I, Golding J, Wigglesworth J, Berry J, Dunn PM: Classification of perinatal death. Arch Dis Child. 1989, 64 (10 Spec No): 1345-1351. 10.1136/adc.64.10_Spec_No.1345.View ArticlePubMedPubMed CentralGoogle Scholar
- Alberman E, Blatchley N, Botting B, Schuman J, Dunn A: Medical causes on stillbirth certificates in England and Wales: distribution and results of hierarchical classifications tested by the Office for National Statistics. Br J Obstet Gynaecol. 1997, 104 (9): 1043-1049.View ArticlePubMedGoogle Scholar
- Flenady V, King JF, Hockey RL, Tudehope DI: The rationale for clinical perinatal mortality classification – what more does it tell us than ICD codes?. Perinatal Society of Australia and New Zealand 3rd Annual Congress Proceedings: 21–24 March 1999; Melbourne. 1999, P119-Google Scholar
- Georgsdottir I, Geirsson RT, Johannsson JH, Biering G, Snaedal G: Classification of perinatal and neonatal deaths in Iceland. A survey from a defined population. Acta Obstet Gynecol Scand. 1989, 68: 101-108. 10.3109/00016348909009895.View ArticlePubMedGoogle Scholar
- McIlwaine GM, Dunn FH, Howat RC, Smalls M, Wyllie MM, MacNaughton MC: A routine system for monitoring perinatal deaths in Scotland. Br J Obstet Gynaecol. 1985, 92: 9-13.View ArticlePubMedGoogle Scholar
- Morrison I, Olsen J: Weight-specific stillbirths and associated causes of death: an analysis of 765 stillbirths. Am J Obstet Gynecol. 1985, 152 (8): 975-980.View ArticlePubMedGoogle Scholar
- Baird D, Thomson A: The survey perinatal deaths re-classified by special clinico-pathological assessment. Perinatal Problems. The second report of the 1958 British Perinatal Mortality survey. Edited by: Butler NR, Alberman E. 1969, Edinburgh: Churchill-Livingstone, 200-210.Google Scholar
- Butler NR, Bonham DG: Perinatal Mortality. The First Report of the 1958 British Perinatal Mortality Survey. 1963, Edinburgh: E. & S. Livingstone, 202-205.Google Scholar
- Maternal and Perinatal Infant Mortality Committee: Maternal and Perinatal Infant Mortality in South Australia 2006. 2007, Adelaide: South Australian Department of HealthGoogle Scholar
- Kramer MS, Shiliang L, Zhongcheng L, Hongbo Y, Platt R, Joseph K: Analysis of Perinatal Mortality and Its Components: Time for a Change?. Am J Epidemiol. 2002, 156 (6): 493-497. 10.1093/aje/kwf077.View ArticlePubMedGoogle Scholar
- Flenady V, King J, Charles A, Gardener G, Ellwood D, Day K, McGowan L, Kent A, Tudehope D, Richardson R, Conway L, Chan A, Haslam R, Khong Y: The PSANZ Clinical Practice Guideline for Perinatal Mortality. Perinatal Society of Australia and New Zealand (PSANZ) Perinatal Mortality Group. Version 2.2. 2009, [http://www.psanzpnmsig.org]Google Scholar
- de Galan-Roosen AE, Kuijpers JC, Straaten van der PJ, Merkus JM: Evaluation of 239 cases of perinatal death using a fundamental classification system. Eur J Obstet Gynecol Reprod Biol. 2002, 103 (1): 37-42. 10.1016/S0301-2115(02)00024-6.View ArticlePubMedGoogle Scholar
- Holt J, Vold IN, Odland JO, Forde OH: Perinatal deaths in a Norwegian county 1986–96 classified by the Nordic-Baltic perinatal classification: geographical contrasts as a basis for quality assessment. Acta Obstet Gynecol Scand. 2000, 79 (2): 107-112. 10.1034/j.1600-0412.2000.079002107.x.View ArticlePubMedGoogle Scholar
- Jansone M, Lazdane G: Audit of perinatal deaths in a tertiary hospital in Latvia (1995–1999) using the Nordic-Baltic perinatal death classification: Evidence of suboptimal care. J Matern Fetal Neonatal Med. 2006, 19 (8): 503-507. 10.1080/14767050600852577.View ArticlePubMedGoogle Scholar
- Langhoff-Roos J, Borch-Christensen H, Larsen S, Lindberg B, Wennergren M: Potentially avoidable perinatal deaths in Denmark and Sweden 1991. Acta Obstet Gynecol Scand. 1996, 75 (9): 820-825. 10.3109/00016349609054710.View ArticlePubMedGoogle Scholar
- Langhoff-Roos J, Larsen S, Basys V, Lindmark G, Badokynote M: Potentially avoidable perinatal deaths in Denmark, Sweden and Lithuania as classified by the Nordic-Baltic classification. Br J Obstet Gynaecol. 1998, 105 (11): 1189-1194.View ArticlePubMedGoogle Scholar
- Amar HS, Maimunah AH, Wong SL: Use of Wigglesworth pathophysiological classification for perinatal mortality in Malaysia. Arch Dis Child Fetal Neonatal Ed. 1996, 74 (1): F56-59. 10.1136/fn.74.1.F56.View ArticlePubMedPubMed CentralGoogle Scholar
- Elamin S, Langhoff-Roos J, Boedker B, Ibrahim SA, Ashmeig AL, Lindmark G: Classification of perinatal death in a developing country. Int J Gynaecol Obstet. 2003, 80 (3): 327-333. 10.1016/S0020-7292(02)00380-6.View ArticlePubMedGoogle Scholar
- Korteweg FJ, Gordijn SJ, Timmer A, Holm JP, Rvaisé JM, Erwich JJHM: A placental cause of intra-uterine fetal death depends on the perinatal mortality classification system used. Placenta. 2008, 29: 71-80. 10.1016/j.placenta.2007.07.003.View ArticlePubMedGoogle Scholar
- Varli IH, Petersson K, Bottinga R, Bremme K, Hofsjo A, Holm M, Holste C, Kublickas M, Norman M, Pilo C, et al: The Stockholm classification of stillbirth. Acta Obstet Gynecol Scand. 2008, 87 (11): 1202-1212. 10.1080/00016340802460271.View ArticlePubMedGoogle Scholar
- Fleiss J: Statistical Methods for Rates and Proportions. 1981, New York: Wiley, 2Google Scholar
- Horn LC, Langner A, Stiehl P, Wittekind C, Faber R: Identification of the causes of intrauterine death during 310 consecutive autopsies. Eur J Obstet Gynecol Reprod Biol. 2004, 113 (2): 134-138. 10.1016/S0301-2115(03)00371-3.View ArticlePubMedGoogle Scholar
- McClure EM, Goldenberg RL, Bann CM: Maternal mortality, stillbirth and measures of obstetric care in developing and developed countries. Int J Gynaecol Obstet. 2007, 96 (2): 139-146. 10.1016/j.ijgo.2006.10.010.View ArticlePubMedGoogle Scholar
- Settatree RS, Watkinson M: Classifying perinatal death: experience from a regional survey. Br J Obstet Gynaecol. 1993, 100 (2): 110-121.View ArticlePubMedGoogle Scholar
- Froen JF, Pinar H, Flenady V, Bahrin S, Charles A, Chauke Lawrence, Day K, Duke C, Facchinetti F, Fretts R, Gardener G, Gilshenan K, Gordijn S, Gordon A, Guyon G, Harrison C, Koshy R, Pattinson R, Petersson K, Russell L, Saastad E, Smith G, Torabi R: Causes of Death and Associated Conditions (CODAC) – a utilitarian approach to the classification of perinatal deaths. BMC Pregnancy Childbirth. 2009, 9: 22-10.1186/1471-2393-9-22.View ArticlePubMedPubMed CentralGoogle Scholar
- International Stillbirth Alliance. [http://www.stillbirthalliance.org]
- The pre-publication history for this paper can be accessed here:http://0-www.biomedcentral.com.brum.beds.ac.uk/1471-2393/9/24/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.