Biometrical Letters vol. 47(2), 2010, pp. 107-118


Show full-size cover
THE IMPACT OF DISTRIBUTIONAL SHAPE ON THE POWER
OF RANDOMIZATION TESTS FOR TWO INDEPENDENT GROUPS:
A SIMULATION STUDY USING SMALL BALANCED SAMPLES


Fernando Branco1, T. Azinheira Oliveira2, Amílcar Oliveira2

1ULHT - Universidade Lusófona de Humanidades e Tecnologias, Avenida do Campo Grande, 376, 1749-024 Lisboa, Portugal, branco.fernando@netcabo.pt
2Departamento de Ciências e Tecnologia, Universidade Aberta and CEAUL-Center of Statistics and Applications, University of Lisbon, Rua Fernão Lopes, 9, 2o Dir. 1000-132 Lisboa, Portugal, aoliveira@univ-ab.pt, toliveir@univ-ab.pt


The importance of randomization tests is very well known in experimental research, particularly in biometry. The aim of the present research is to evaluate the impact of distributional shape on the power of the randomization test for difference between the means of two independent groups (with n1=n2=16). To manipulate shape in terms of asymmetry and kurtosis, we used g-and-h distributions. We evaluated the power of the randomization test, and also the power of the Student-t test, as a comparison standard, with data simulated from 12 g-and-h distributions for seven values of effect size. For each condition, we generated 20 000 samples, and for each one the power of randomization tests was estimated using 1000 permutations. We set the value of Type I error probability at 0.05. The results show gains in power for both tests with increasing skewness and/or kurtosis, with a slight advantage for the randomization tests over the Student-t test.


Randomization tests, statistical power, g-and-h distributions.