Welcome to visit Zhongnan Medical Journal Press Series journal website!

Home Articles Vol 36,2023 No.7 Detail

The comparison of hypothesis testing methods for two independent quantitative data with extremely small samples

Published on Aug. 01, 2023Total Views: 2780 times Total Downloads: 873 times Download Mobile

Author: Yi-Bin GUO 1 Jia-Xun LI 2 Cheng WU 1 Wei GUO 1 Qian HE 1

Affiliation: 1. Department of Military Health Statistics, Naval Medical University, Shanghai 200433, China 2. School of Basic Medicine, Naval Medical University, Shanghai 200433, China

Keywords: Extremely small sample Quantitative data Data simulation Hypothesis test Non-parametric test

DOI: 10.12173/j.issn.1004-4337.202302073

Reference: Guo YB, Li JX, Wu C, Guo W, He Q. The comparison of hypothesis testing methods for two independent quantitative data with extremely small samples[J]. Journal of Mathematical Medicine, 2023, 36(7): 481-485. DOI: 10.12173/j.issn.1004-4337.202302073.[Article in Chinese]

  • Abstract
  • Full-text
  • References
Abstract

Objective  To explore the performance of hypothesis testing methods for two independent quantitative data hypothesis tests with extremely small samples.

Methods  Monte Carlo method was used to generate data with different mean difference, dis-tribution and sample size. T-test, Wilcoxon rank sum test and Bootstrap method were used to test the hypothesis, and the statistical efficiency was estimated in different scenarios.

Results  When the sample size was extremely small, the statistical efficiency of Wilcoxon rank sum test was very low. The Bootstrap confidence interval method was prone to make type II errors when the data were skew distributed. When the mean difference was large, the method still had high statistical efficiency. Whether the data followed normal distribution or not, when the sample size was extremely small, t-test performed better than Wilcoxon rank sum test.

Conclusion  According to the results of this simulation study, when the data follow the normal distribution, it is suggested to use t-test to analyze the extremely small samples. When the data does not follow the normal distribution, it is suggested to use the Bootstrap confidence interval method to analyze the extremely small samples.

Full-text
Please download the PDF version to read the full text: download
References

1.白雪, 孟宪玉, 朱菊茹, 等. 2型糖尿病小型猪模型制备方法的研究进展[J]. 中华实用诊断与治疗杂志, 2019, 33(7): 717-719. [Bai X, Meng XY, Zhu JR, et al. Preparation of minipig models of type 2 diabetes mellitus[J]. Journal of Chinese Practical Diagnosis and Therapy, 2019, 33(7): 717-719.] DOI: 10.13507/j.issn.1674-3474.2019.07.026.

2.顾鹏, 陈傍柱, 徐涛, 等. Hpd基因修饰制备高酪氨酸血症Ⅲ型巴马小型猪模型[J]. 中国比较医学杂志, 2019, 29(5): 11-16. [Gu P, Chen BZ, Xu T, et al. Generation of a Bama minipig model of hereditary tyrosinemia type III by modifying the Hpd gene[J]. Chinese Journal of Comparative Medicine, 2019, 29(5): 11-16.] DOI: 10.3969/j.issn.1671-7856.2019.05.002.

3.周莹, 杜湧瑞, Zelinski Mary B, 等. 慢性炎症在X射线诱发恒河猴卵巢组织持续损伤中的潜在作用[J]. 天津医科大学学报, 2022, 28(2): 160-164. [Zhou Y, Du YR, Zelinski MB, et al. Potential role of chronic inflammation in persistent ovarian injury exposed to X-ray targeted irradiation in rhesus monkeys[J]. Journal of Tianjin Medical University, 2022, 28(2): 160-164.] https://d.wanfangdata.com.cn/periodical/ChlQZXJpb2RpY2FsQ0hJTmV3UzIwMjMwNDI2EhR0aWFuanlrZHh4YjIwMjIwMjAxMBoIaWU5NTVndmI%3D.

4.Bland JM, Altman DG. Analysis of continuous data from small samples[J]. BMJ, 2009, 338: a3166. DOI: 10.1136/bmj.a3166.

5.祝国强. 医药数理统计方法(第2版)(BZ)[M]. 北京: 高等教育出版社. 2009. [Zhu GQ. Mathematical and Statistical Methods in Medicine (2nd edition) (BZ)[M].Beijing: Higher Education Press. 2009.]

6.娄冬华. 秩和检验的统计思想[J]. 中国卫生统计, 2005, 22(4): 264-265, 267. [Lou DH. Statistical thought of rank sum test[J]. Chinese Journal of Health Statistics, 2005, 22(4): 264-265, 267.] DOI: 10.3969/j.issn.1002-3674.2005.04.028.

7.王俊, 吴熙. 实际应用中方差分析与秩和检验结果比较[J]. 中国卫生统计, 2008, 25(1): 55, 58. [Wang J, Wu X. The results of variance analysis and rank sum test were compared in practical application[J]. Chinese Journal of Health Statistics, 2008, 25(1): 55, 58.] DOI: 10.3969/j.issn.1002-3674.2008.01.019.

8.Siegel S. Nonparametric statistics for the behavioral sciences(1st ed)[M]. Tokyo: McGraw-Hill Kogakusha. 1956.

9.祝国强, 杭国明, 滕海英, 等. 谈谈两总体比较的非参数检验方法[J]. 数理医药学杂志, 2011, 24(5): 524-525. [Zhu GQ, Hang GM, Teng HY, et al. On two types of non-parametric tests[J]. Journal of Mathematical Medicine, 2011, 24(5): 524-525.] DOI: 10.3969/j.issn.1004-4337.2011.05.006.

10.林正大, 刘平, 黄士铮, 等. 方差非齐及小样本下总体均值差检验的探讨[J]. 上海师范大学学报(自然科学版), 1995, 24(4): 19-23. [Lin ZD, Liu P, Huang SZ, et al. Inquisition into the testing of population mean difference under small sample and non-homo geneity variance[J].Journal of Shanghai Normal University (Natural Sciences), 1995, 24(4): 19-23.] DOI: CNKI:SUN:SHDZ.0.1995-04-003.

11.Efron, Bradley. The jackknife, the bootstrap and other resampling plans[J]. Society for Industrial and Ap-plied Mathematics, 1982. DOI: 10.1137/1.9781611970319.ch3.

12.Fleishman A. A method for simulating non-normal distributions[J]. Psychometrika, 1978, 43(4): 521-532. DOI: 10.1007/bf02293811.

Popular papers
Last 6 months