Multiple Comparisons Procedures
2008; Lippincott Williams & Wilkins; Volume: 117; Issue: 5 Linguagem: Francês
10.1161/circulationaha.107.700971
ISSN1524-4539
Autores Tópico(s)Drug Solubulity and Delivery Systems
ResumoHomeCirculationVol. 117, No. 5Multiple Comparisons Procedures Free AccessReview ArticlePDF/EPUBAboutView PDFView EPUBSections ToolsAdd to favoritesDownload citationsTrack citationsPermissions ShareShare onFacebookTwitterLinked InMendeleyReddit Jump toFree AccessReview ArticlePDF/EPUBMultiple Comparisons Procedures Howard J. Cabral Howard J. CabralHoward J. Cabral From the Department of Biostatistics, Boston University School of Public Health, Boston, Mass. Originally published5 Feb 2008https://doi.org/10.1161/CIRCULATIONAHA.107.700971Circulation. 2008;117:698–701In biomedical research, a common question posed by investigators is whether or not an outcome of interest differs significantly between multiple independent groups of subjects in the study sample. For example, in a randomized clinical trial focusing on differences in a parameter of cardiovascular health such as systolic blood pressure or heart rate that is measured on a continuum, one might make the comparison of those who received a placebo, those who received a particular active drug, and those who received a different active drug. Another example of a multiple group comparison might arise in an observational study when comparisons between categories of race or ethnicity are of interest.The statistical problem that arises from the use of multiple comparisons tests is that any subsequent tests of hypotheses will be performed on the outcome with the same data on which the global test was performed. This can result in an uncontrolled type I error rate (the rate of rejecting the null hypothesis when it should not be rejected). These tests can produce this statistical problem, which can be encountered in analyses of multiple treatment or exposure groups, multiple end points, or multiple interim analyses. This problem has been addressed from a broad perspective.1 The present report, however, will focus on the statistical analysis strategies used when the global or omnibus test of differences on a continuous outcome across the multiple groups has been performed and statistical tests contrasting subgroups are then conducted. It serves as a follow-up to an earlier article2 in the series of statistical tutorials in Circulation that addressed the use of the ANOVA in performing the global test of hypothesis for a continuous outcome. These statistical tests are often referred to as multiple comparisons procedures (MCPs). We will first present a brief review of the statistical foundations of 1-factor ANOVA and then will describe the 2 main types of MCPs with specific reference to the more commonly used MCPs. Finally, we will show a worked example of an analysis of data from a study of heart size in animals exposed to different conditions of physical exercise that will illustrate the use of 1-factor ANOVA with supplementary MCPs.Review of 1-Factor ANOVAThe 1-factor ANOVA is used to compare mean values for a continuous outcome of interest across 2 or more independent groups, ie, groups in which subjects belong to only 1 group. In this analysis, the outcome, or dependent variable, is compared between the categories of the grouping, or independent, variable, which is referred to as the "factor." The categories of the factor are referred to as "levels" (whether or not they are ordered in some fashion). We will henceforth refer to these categories as "groups." In the population to which statistical inference is to be made, the outcome is assumed to be measured on a continuum and to follow a gaussian distribution for each group, with statistically independent values across individual subjects. Furthermore, the variances of the outcome are assumed to be equal across the groups. For k groups, the null hypothesis (H0) is that the population means (μ) of the outcome are the same for all of the groups. This is commonly written in symbolic form as: equationDownload figureversus the alternative hypothesis, H1, that the k population means are not equal. This null hypothesis is referred to as the "global" hypothesis and its statistical testing as an "omnibus" test. Note that if the null hypothesis is rejected in the face of sufficient sample data, the question of where particular differences were present between the mean values is not addressed.In situations such as tests of treatment efficacy in a phase-III clinical trial in which a placebo control is used, for example, it has been argued that rejection of the global null hypothesis is required before one proceeds with additional analyses to identify specific differences between subgroups of the factor of interest.3 In contrast, it can also be argued that with a limited number of a priori (ie, preplanned) multiple comparisons (for example, in a confirmatory study), one should not have to reject the global null hypothesis to perform the preplanned MCPs.4 We will adopt the former strategy and thus will next discuss the use of MCPs to answer the question of the significance of differences between specific subgroups assuming that the global test has been rejected at a given α, or "significance," level.Multiple Comparisons ProceduresAs noted above, the performance of multiple hypothesis tests subsequent to the global test can result in an uncontrolled type I error rate (the rate of rejecting the null hypothesis when it should not be rejected). MCPs are applied when the global null hypothesis of the study has been rejected at a given α-level either (1) in an a priori fashion when specific preselected comparisons are of interest or (2) in a post hoc fashion when the data suggest that specific groups be compared statistically. Commonly, this α-level is set at 0.05 for the experiment or study and is applied to the global test whether or not a priori or post hoc MCPs are conducted.In determining how to maintain the overall α-level, an investigator must consider an MCP to reduce the α-level for each MCP test or to apply the same α-level for each MCP test as applied in the global test. In mathematical terms, each additional statistical test performed in addition to the global test in such a situation will actually increase the overall α-level for the study. For example, with k groups and interest in comparing each pair of the k mean values, k(k−1)/2 possible comparisons exist. If a separate α-level is applied here to each test of hypothesis, the actual α-level for the set of comparisons could be as large as α[k(k−1)/2]. Thus, when k=4 and α=0.05 for each test, the overall α-level for the set of tests could be as large as 0.30: ie, 0.05[4(3)/2]. Furthermore, if interest exists in comparisons beyond those between pairs of means, the number of multiple comparisons tests will increase. For example, in a study of 3 groups (A, B, and C), one might have interest in the following comparisons: A versus B, A versus C, B versus C, A and B versus C, A and C versus B, and B and C versus A (6 total, 3 pairwise comparisons). MCPs that maintain the overall α-level for the set of tests are said to control the "experimentwise" error rate; a related type, called "familywise" error rate control procedures, also effectively reduce the α-level for each post hoc test. We will simplify matters by referring to these 2 classes of procedures as "experimentwise," although technical differences between the 2 must be acknowledged and have been left to the reader to investigate independently.4In contrast, MCPs that apply a separate α-level for each test are called "comparisonwise" error control procedures. In the case of the study with groups A, B, and C, the use of comparisonwise error control after the global null hypothesis has been rejected would entail the performance of 6 individual tests and application of an α-level of 0.05 for each test. Statistically oriented overviews of MCPs,3 as well as general biostatistical and research texts,5–8 cover in more detail the distinction between these classes of MCPs and their relative strengths and weaknesses. In addition, the use of MCPs in additional analytical frameworks, such as multiway ANOVA and repeated-measures analysis, is beyond the scope of this article.Experimentwise Error Control ProceduresAs noted above, when interest exists in maintaining the overall α-level for the experiment or study, an investigator may choose an MCP that controls the experimentwise error. Many MCPs have been developed to maintain this overall α-level (the term "experiment" stems from the early development of ANOVA in the context of experimental research). Most statistical software packages that offer applications for general linear models analyses such as ANOVA have also implemented MCPs with an array of choices for these tests. Among the more commonly used procedures in this class are the Tukey (John W. Tukey, PhD, unpublished data, 1953), Dunnett,9 Scheffé,10 and Bonferroni (Dunn)11 tests. The options available for MCPs vary by software package. Investigators should consider their scientific question when choosing an MCP and not limit their choice by the availability of MCPs in the statistical software used for their global test.The Tukey test is appropriate for the comparison of pairs of group means; originally developed for equal sample sizes per group, a modified version accommodates unequal sample sizes. A Dunnett test is applied in situations in which contrasts are limited to comparisons with a control group and not, for example, between the means of active treatment groups. The Scheffé test is applicable for more general comparisons than the comparison of pairs of group means and is more appropriate than the Tukey test if sample sizes per group differ markedly. It is considered to be more conservative than the Tukey test when pairs of group means are being compared. The Scheffé test can be computed for a specific contrast of group means by first determining the critical value of the F statistic for the α-level of interest, with k−1 degrees of freedom (df) for the numerator and N−-k degrees of freedom for the denominator when k groups are present and N subjects overall. This F value is then multiplied by k−1 to yield a new critical F value for the multiple comparisons contrast.The Bonferroni (Dunn) procedure takes into account the number of comparisons to be made and is more conservative (less likely to find a significant difference) than the Tukey or Scheffé test in comparisons of pairs of group means, and it is considered to be the most conservative option among MCPs in most situations. It can be applied to general hypothesis tests in addition to ANOVA. The Bonferroni (Dunn) procedure is implemented by computing a new α-level for each multiple comparisons test based only on the overall α-level for the study and the number of comparisons to be made. In this approach, the new α, α″, is equal to α/C, where C is the number of post hoc tests to be performed. Thus, in the previously discussed example with 3 groups, A, B, and C, and interest in all possible comparisons, the new alpha, α″, would be equal to α/6. Modifications have been made to the Bonferroni procedure with the goal of improving statistical power and include the Holm12 and Hochberg13,14 procedures among the more prominent methods.Comparisonwise Error Control ProceduresWhen an investigator has a limited number of comparisons to be made after the rejection of the global null hypothesis, especially if these were prespecified before this test was conducted, it may be of interest to employ an MCP that controls the comparisonwise error. As noted previously, MCPs that control the comparisonwise error rate typically use the same α-level for each test that is applied in the test of the global null hypothesis for the study. Thus, the likelihood of falsely rejecting each null hypothesis increases with additional tests. They also, however, provide the benefit to the investigator of being more powerful, ie, more likely to reject the null hypothesis of each test when it should be rejected. Examples of such procedures include the application of Fisher's LSD (least significant difference) test and linear contrasts.6 In the LSD test, a variant of the standard 2-sample t test is used in which the within-subjects mean square from the global test on the full data set is used as an estimate of the pooled variance, as opposed to using the variance estimates only from the 2 groups being compared. Linear contrasts can be used for more general comparisons, for example, when a set of groups is to be compared with another set of groups or when the study groups represent different dose levels of a treatment or exposure.Worked ExampleWe now present an example of an analysis of data from a study of heart size in mice exposed to different conditions of physical exercise15 that will illustrate the use of 1-factor ANOVA with supplementary MCPs. The design used 2 randomly assigned factors, long-term exercise versus no exercise (control), and exercise duration at 7 different ages after baseline. The sample included 30 mice in total, 21 assigned to the 7 different durations of long-term exercise (swimming) and 9 assigned to 3 durations in the control group (8, 12, and 13 weeks of age). The heart weight–to–body weight ratio at the time of euthanasia was examined as the outcome of interest in this study. We will limit our analyses here to the long-term exercise group to illustrate the use of 1-factor ANOVA. In Table 1, we show the data for this sample. Table 1. Heart Weight/Body Weight Ratio by Exercise-Duration GroupExercise Duration10 min2.5 d1 wk2 wk3 wk4 wk4 wk, 1-wk RestValues are heart weight/body weight ratios.4.294.495.385.445.505.544.664.434.545.185.596.475.704.904.174.654.835.646.035.474.91For these 21 animals, the global F test of differences in mean heart weight–to–body weight ratio for the 1-factor ANOVA was 20.59 (numerator df=6, denominator df=14; R2=0.90) with P<0.0001. Thus, we reject the global null hypothesis of no difference in population mean heart weight–to–body weight ratio between groups using α=0.05 and are next interested in where significant differences can be found between subgroups. Although one should in practice restrict the choice of multiple comparisons to those that are substantively meaningful, we will assume for the purpose of illustration in this case that all pairs of means are of interest and will examine results of contrasts between pairs of means using MCPs among those discussed earlier.In Table 2, we present the means and SDs for the outcome of interest, heart weight–to–body weight ratio, together with a summary of the results of the application of 4 procedures that control the experimentwise type I error rate (Tukey test, Scheffé test, and the Bonferroni [Dunn] procedure) and one that controls the comparisonwise type I error rate (Fisher LSD test). To aid in the interpretation of differences between groups, means have been arranged so that the highest is presented at the top of the table and the lowest at the bottom the table (higher values indicating greater cardiac hypertrophy as a result of exercise). Table 2. Means and SDs of Heart Weight/Body Weight Ratio With Results of Multiple Comparisons Procedures (n=21 Mice, 3 per Group)Exercise-Duration GroupMean (SD)Multiple Comparisons ProcedureTukeySchefféBonferroni (Dunn)Fisher LSDMeans are sorted from largest to smallest, and means of groups that do not share a letter are significantly different.3 wk6.00 (0.49)AAAA4 wk5.57 (0.12)ABABABB2 wk5.56 (0.10)ABABABB1 wk5.13 (0.28)BCBCBCC4 wk, 1 wk of rest4.82 (0.14)BCBCDCDCD2.5 d4.56 (0.08)CDCDCDDE10 min4.30 (0.13)DDDEIn Table 2, we adopt a system used in the statistical software, SAS,16 to identify statistically significant differences between groups. We apply a level of α=0.05 to denote statistical significance. In this system, means of groups that share a letter are not significantly different, whereas the means of any groups that do not share a letter are significantly different. For example, for the results of the Tukey test, the "3 weeks" group is significantly different from all groups except "4 weeks" and "2 weeks," because they all share the letter "A" in the display. Likewise, the "10 minutes" group is significantly different from all groups except the "2.5 days" group, because it shares the letter "D" only with that group.In the table overall, we see a similar set of results for comparisons of all pairs of means among the procedures that control the experimentwise error rate. These tests, however, are rejected at the 0.05 level less frequently than the Fisher's LSD test, which is expected given that the LSD test controls the comparisonwise error rate and should be more powerful. We note, however, that the actual type I error rate for the set of all pairwise comparisons here could be as large as 0.05[(7×6)/2)]≤1.00 (k=7). In interpreting these results, however, one should keep in mind that the results of hypothesis tests are highly dependent on sample size, and only 3 mice in each of the 7 groups were examined in this sample. Greater distinction between the findings of these procedures may be observed in larger samples.SummaryWe have presented information that should be helpful to investigators in biomedical research who have an interest in addressing study questions in which multiple comparisons of study groups are appropriate. We have reviewed the statistical framework for 1-factor ANOVA and have discussed how multiple comparisons after the rejection of the global null hypothesis are conceptually linked to the global test. We have described selected, commonly applied MCPs and have utilized them in the analysis of data from an animal study.Several of the procedures discussed here can be applied in common statistical software in the context of ANCOVA models when variables are present that need to be controlled statistically to obtain valid inferences about differences between treatment or exposure groups (eg, Bonferroni, Scheffé, Tukey, and Dunnett tests in SAS). We have not covered this situation and leave this to the reader to investigate within their statistical software of choice. Researchers without extensive statistical analysis experience should be able to use this information to work with a professional statistician to better design and analyze data from studies in which multiple comparisons are of interest.DisclosuresNone.FootnotesCorrespondence to Howard J. Cabral, PhD, MPH, Department of Biostatistics, Boston University School of Public Health, 715 Albany St, Crosstown Center, 3rd Floor, Boston, MA 02118. E-mail [email protected] References 1 Koch GG, Gansky SA. Statistical considerations for multiplicity in confirmatory protocols. Drug Inf J. 1996; 30: 523–533.CrossrefGoogle Scholar2 Larson MG. Analysis of variance. Circulation. 2008; 117: 115–121.LinkGoogle Scholar3 D'Agostino RB, Heeren TC. Multiple comparisons in over-the counter drug clinical trials with both positive and placebo controls. Stat Med. 1991; 10: 1–6.CrossrefMedlineGoogle Scholar4 D'Agostino RB, Massaro J, Kwan H, Cabral H. Strategies for dealing with multiple treatment comparisons in confirmatory clinical trials. Drug Inf J. 1993; 27: 625–641.CrossrefGoogle Scholar5 D'Agostino RB, Sullivan L, Beiser A. Introductory Applied Biostatistics. Belmont, Calif: Duxbury-Brooks/Cole; 2004.Google Scholar6 Rosner B. Fundamentals of Biostatistics. 6th ed. Boston, Mass: Duxbury Press; 2005.Google Scholar7 Kleinbaum DG, Kupper LL, Mueller KE, Nizam A. Applied Regression Analysis and Multivariable Methods. 5th ed. Boston, Mass: Duxbury Press; 1997.Google Scholar8 Toothaker L. Multiple Comparisons for Researchers. New York, NY: Sage Publications; 1991.Google Scholar9 Dunnett CW. New tables for multiple comparisons with a control. Biometrics. 1964; 20: 482–491.CrossrefGoogle Scholar10 Scheffé H. The Analysis of Variance. New York, NY: Wiley; 1959.Google Scholar11 Dunn OJ. Multiple comparisons among means. J Am Stat Assoc. 1961; 56: 52–64.CrossrefGoogle Scholar12 Holm S. A simple sequentially rejective multiple test procedure. Scand J Stat. 1979; 6: 65–70.Google Scholar13 Hochberg Y. A sharper Bonferroni procedure for multiple tests of significance. Biometrika. 1988; 75: 800–803.CrossrefGoogle Scholar14 Hochberg Y, Benjamini Y. More powerful procedures for multiple significance testing. Stat Med. 1990; 9: 811–818.CrossrefMedlineGoogle Scholar15 Available at: http://cardiogenomics.med.harvard.edu/groups/proj1/pages/swim_home.html. Accessed January 15, 2008.Google Scholar16 Statistical Analysis System (SAS), Version 9.1. Cary, NC: SAS Institute; 2007.Google Scholar eLetters(0)eLetters should relate to an article recently published in the journal and are not a forum for providing unpublished data. Comments are reviewed for appropriate use of tone and language. Comments are not peer-reviewed. Acceptable comments are posted to the journal website only. Comments are not published in an issue and are not indexed in PubMed. Comments should be no longer than 500 words and will only be posted online. References are limited to 10. Authors of the article cited in the comment will be invited to reply, as appropriate.Comments and feedback on AHA/ASA Scientific Statements and Guidelines should be directed to the AHA/ASA Manuscript Oversight Committee via its Correspondence page.Sign In to Submit a Response to This Article Previous Back to top Next FiguresReferencesRelatedDetailsCited By Pan H, Ran Q, Hong Y, Wang J, Chen X and Ye S (2023) Long-term impacts of ecosystem restoration on saturated hydraulic conductivity in the Loess Plateau, Journal of Hydrology, 10.1016/j.jhydrol.2023.129337, 620, (129337), Online publication date: 1-May-2023. Patel D, Goruk S, Richard C and Field C (2022) Combined Supplementation with Arachidonic and Docosahexaenoic Acids in T Helper Type-2 Skewed Brown Norway Rat Offspring is Beneficial in the Induction of Oral Tolerance toward Ovalbumin and Immune System Development, The Journal of Nutrition, 10.1093/jn/nxac118, 152:9, (2165-2178), Online publication date: 1-Sep-2022. Chopard R, Albertsen I, Ecarnot F, Guth S, Besutti M, Falvo N, Piazza G and Meneveau N (2022) Extended Anticoagulation After Pulmonary Embolism: A Multicenter Observational Cohort Analysis, Journal of the American Heart Association, 11:13, Online publication date: 5-Jul-2022. Khomami M, Meybodi M and Ameri R (2022) Cellular goore game with application to finding maximum clique in social networks, Journal of Computational Design and Engineering, 10.1093/jcde/qwac010, 9:3, (966-991), Online publication date: 23-May-2022. Dhari Z, Leonetti C, Lin S, Prince A, Howick J, Zurakowski D, Wang P, Jonas R and Ishibashi N (2021) Impact of Cardiopulmonary Bypass on Neurogenesis and Cortical Maturation, Annals of Neurology, 10.1002/ana.26235, 90:6, (913-926), Online publication date: 1-Dec-2021. Zhang B, Chester S, Nadimpalli S, Suriano J, Theis D and Lieber S (2021) Mechanical Characterization of Porcine Skin Starting Material, Journal of Engineering and Science in Medical Diagnostics and Therapy, 10.1115/1.4051563, 4:4, Online publication date: 1-Nov-2021. Gupta M, Gouda G, Donde R, Sabarinathan S, Dash G, Ponnana M, Pati P, Rathore S, Vadde R and Behera L (2021) Statistics for Bioinformatics Bioinformatics in Rice Research, 10.1007/978-981-16-3993-7_2, (21-50), . Yang M, Hsu J, Hsiao H, Yang L, Pan Y, Lai M, Chu S, Huang H, Chiang M, Fu R and Tsai M (2020) Use of high frequency oscillatory ventilator in neonates with respiratory failure: the clinical practice in Taiwan and early multimodal outcome prediction, Scientific Reports, 10.1038/s41598-020-63655-8, 10:1, Online publication date: 1-Dec-2020. Staffa S and Zurakowski D (2020) Strategies in adjusting for multiple comparisons: A primer for pediatric surgeons, Journal of Pediatric Surgery, 10.1016/j.jpedsurg.2020.01.003, 55:9, (1699-1705), Online publication date: 1-Sep-2020. Staffa S and Zurakowski D (2020) Statistical power and sample size calculations: A primer for pediatric surgeons, Journal of Pediatric Surgery, 10.1016/j.jpedsurg.2019.05.007, 55:7, (1173-1179), Online publication date: 1-Jul-2020. Scotina A, Beaudoin F and Gutman R (2019) Matching estimators for causal effects of multiple treatments, Statistical Methods in Medical Research, 10.1177/0962280219850858, 29:4, (1051-1066), Online publication date: 1-Apr-2020. Boelhouwer A, van den Beukel A, van der Voort M, Hottentot C, de Wit R and Martens M (2020) How are car buyers and car sellers currently informed about ADAS? An investigation among drivers and car sellers in the Netherlands, Transportation Research Interdisciplinary Perspectives, 10.1016/j.trip.2020.100103, 4, (100103), Online publication date: 1-Mar-2020. Kohli S and Casson A (2019) Removal of Gross Artifacts of Transcranial Alternating Current Stimulation in Simultaneous EEG Monitoring, Sensors, 10.3390/s19010190, 19:1, (190) You X, Chen J, Bian C, Yi Y, Ruan Z, Li J, Zhang X, Yu H, Xu J and Shi Q (2018) Transcriptomic evidence of adaptive tolerance to high environmental ammonia in mudskippers, Genomics, 10.1016/j.ygeno.2018.09.001, 110:6, (404-413), Online publication date: 1-Nov-2018. Schober P and Vetter T (2018) Repeated Measures Designs and Analysis of Longitudinal Data, Anesthesia & Analgesia, 10.1213/ANE.0000000000003511, 127:2, (569-575), Online publication date: 1-Aug-2018. Giuffrida M (2017) Basic Statistics for the Exotic Animal Practitioner, Veterinary Clinics of North America: Exotic Animal Practice, 10.1016/j.cvex.2017.04.007, 20:3, (947-959), Online publication date: 1-Sep-2017. Stinnett G, Lin S, Korotcov A, Korotcova L, Morton P, Ramachandra S, Pham A, Kumar S, Agematsu K, Zurakowski D, Wang P, Jonas R and Ishibashi N (2017) Microstructural Alterations and Oligodendrocyte Dysmaturation in White Matter After Cardiopulmonary Bypass in a Juvenile Porcine Model, Journal of the American Heart Association, 6:8, Online publication date: 2-Aug-2017. Yagura T, Schuch A, Garcia C, Rocha C, Moreno N, Angeli J, Mendes D, Severino D, Bianchini Sanchez A, Di Mascio P, de Medeiros M and Menck C (2017) Direct participation of DNA in the formation of singlet oxygen and base damage under UVA irradiation, Free Radical Biology and Medicine, 10.1016/j.freeradbiomed.2017.03.018, 108, (86-93), Online publication date: 1-Jul-2017. Ng J and Brownlee I (2017) The effect of high β-glucan flour incorporation into instant rice porridge on satiety and energy intake, Bioactive Carbohydrates and Dietary Fibre, 10.1016/j.bcdf.2017.07.011, 11, (60-66), Online publication date: 1-Jul-2017. Li G, Taljaard M, Van den Heuvel E, Levine M, Cook D, Wells G, Devereaux P and Thabane L (2016) An introduction to multiplicity issues in clinical trials: the what, why, when and how, International Journal of Epidemiology, 10.1093/ije/dyw320, (dyw320) Czajkowski M and Kretowski M (2016) The role of decision tree representation in regression problems – An evolutionary perspective, Applied Soft Computing, 10.1016/j.asoc.2016.07.007, 48, (458-475), Online publication date: 1-Nov-2016. Sullivan L, Weinberg J and Keaney J (2016) Common Statistical Pitfalls in Basic Science Research, Journal of the American Heart Association, 5:10, Online publication date: 3-Oct-2016. Xu G, Du F, Li Y, Nie Z and Xu P (2016) Integrated application of transcriptomics and metabolomics yields insights into population-asynchronous ovary development in Coilia nasus, Scientific Reports, 10.1038/srep31835, 6:1 Wang S, Quah X, Amjadi S, Tong J and Francis I (2015) Hydropolish: A Controlled Trial on a Technique to Eradicate Residual Cortical Lens Fibers in Phacoemulsification Cataract Surgery, European Journal of Ophthalmology, 10.5301/ejo.5000622, 25:6, (571-574), Online publication date: 1-Dec-2015. Rettig J, Smallwood C, Walsh B, Rimensberger P, Bachman T, Bollen C, Duval E, Gebistorf F, Markhorst D, Tinnevelt M, Todd M, Zurakowski D and Arnold J (2015) High-Frequency Oscillatory Ventilation in Pediatric Acute Lung Injury, Critical Care Medicine, 10.1097/CCM.0000000000001278, 43:12, (2660-2667), Online publication date: 1-Dec-2015. Dionigi B, Brazzo J, Ahmed A, Feng C, Wu Y, Zurakowski D and Fauza D (2015) Trans-amniotic stem cell therapy (TRASCET) minimizes Chiari-II malformation in experimental spina bifida, Journal of Pediatric Surgery, 10.1016/j.jpedsurg.2015.03.034, 50:6, (1037-1041), Online publication date: 1-Jun-2015. Lenarczyk M, Su J, Haworth S, Komorowski R, Fish B, Migrino R, Harmann L, Hopewell J, Kronenberg A, Patel S, Moulder J and Baker J (2015) Simvastatin mitigates increases in risk factors for and the occurrence of cardiac disease following 10 Gy total body irradiation, Pharmacology Research & Perspectives, 10.1002/prp2.145, 3:3, Online publication date: 1-Jun-2015. Ishigami S, Ohtsuki S, Tarui S, Ousaka D, Eitoku T, Kondo M, Okuyama M, Kobayashi J, Baba K, Arai S, Kawabata T, Yoshizumi K, Tateishi A, Kuroko Y, Iwasaki T, Sato S, Kasahara S, Sano S and Oh H (2014) Intracoronary Autologous Cardiac Progenitor Cell Transfer in Patients With Hypoplastic Left Heart Syndrome, Circulation Research, 116:4, (653-664), Online publication date: 13-Feb-2015. Du F, Xu G, Nie Z, Xu P and Gu R (2014) Transcriptome analysis gene expression in the liver of Coilia nasus during the stress response, BMC Genomics, 10.1186/1471-2164-15-558, 15:1, Online publication date: 1-Dec-2014. Barhoumi A, Wang W, Zurakowski D, Langer R and Kohane D (2014) Photothermally Targeted Thermosensitive Polymer-Masked Nanoparticles, Nano Letters, 10.1021/nl403733z, 14:7, (3697-3701), Online publication date: 9-Jul-2014. Lehoucq F and Pérez-Liñán A (2013) Breaking Out of the Coup Trap, Comparative Political Studies, 10.1177/0010414013488561, 47:8, (1105-1129), Online publication date: 1-Jul-2014. Howe T, Sheu C, Wang T and Hsu Y (2014) Parenting stress in famili
Referência(s)