Kybernetika 47 no. 2, 179-206, 2011

Consistency of the least weighted squares under heteroscedasticity

Jan Ámos Víšek

Abstract:

A robust version of the Ordinary Least Squares accommodating the idea of weighting the order statistics of the squared residuals (rather than directly the squares of residuals) is recalled and its properties are studied. The existence of solution of the corresponding extremal problem and the consistency under heteroscedasticity is proved.

Keywords:

robustness, weighting the order statistics of the squared residuals, consistency of the least weighted squares under heteroscedasticity

Classification:

62J02, 62F35

References:

  1. P. J. Bickel: One-step Huber estimates in the linear model. J. Amer. Statist. Assoc. 70 (1975), 428-433.   CrossRef
  2. L. Breiman: Probability. Addison-Wesley Publishing Company, London 1968.   CrossRef
  3. C. Croux and P. J. Rousseeuw: A class of high-breakdown scale estimators based on subranges. Commun. Statist. Theory Methods 21 (1992), 1935-1951.   CrossRef
  4. J. Hájek and Z. Šidák: Theory of Rank Test. Academic Press, New York 1967.   CrossRef
  5. F. R. Hampel, E. M. Ronchetti, P. J. Rousseeuw and W. A. Stahel: Robust Statistics - The Approach Based on Influence Functions. Wiley, New York 1986.   CrossRef
  6. T. P. Hettmansperger and S. J. Sheather: A cautionary note on the method of Least Median Squares. Amer. Statist. 46 (1992), 79-83.   CrossRef
  7. G. G. Judge, W. E. Griffiths, R. C. Hill, H. Lütkepohl and T. C. Lee: The Theory and Practice of Econometrics. Second edition. Wiley, New York 1985.   CrossRef
  8. J. Jurečková and P. K. Sen: Regression rank scores scale statistics and studentization in linear models. In: Proc. Fifth Prague Symposium on Asymptotic Statistics, Physica Verlag 1993, 111-121.   CrossRef
  9. H. L. Koul: Weighted Empirical Processes in Dynamic Nonlinear Models. Lecture Notes in Statist. 166, Springer Verlag, New York 2002.   CrossRef
  10. J. Mašíček: Consistency of the least weighted squares estimator. In: Statistics for Industry and Technology, Birkh\H{a}ser Verlag Basel 2004 , 183-194.   CrossRef
  11. P. J. Rousseeuw: Least median of square regression. J. Amer. Statist. Assoc. 79 (1984), 871-880.   CrossRef
  12. P. J. Rousseeuw and A. M. Leroy: Robust Regression and Outlier Detection. Wiley, New York 1987.   CrossRef
  13. J. Štepán: Teorie pravděpodobnosti. Academia, Praha 1987.   CrossRef
  14. H. Tucker: A Graduate Course in Probability. Academic Press, London 1967.   CrossRef
  15. A. W. van der Vaart and J. A. Welner: Weak Convergence and Empirical Processes. Second edition. Springer-Verlag, New York 2000.   CrossRef
  16. J. Á. Víšek: A cautionary note on the method of the Least Median of Squares reconsidered. In: Trans. Twelfth Prague Conference on Information Theory, Statistical Decision Functions and Random Processes 1994, 254-259.   CrossRef
  17. J. Á. Víšek: Sensitivity analysis of $M$-estimates. Ann. Inst. Statist. Math. 48 (1996), 469-495.   CrossRef
  18. J. Á. Víšek: On high breakdown point estimation. Computational Statistics 11 (1996), 137-146.   CrossRef
  19. J. Á. Víšek: Regression with high breakdown point. In: Robust 2000 (J Antoch and G. Dohnal, eds.), Union of Czech Math. and Phys. 2001, 324-356.   CrossRef
  20. J. Á. Víšek: The least weighted squares I. The asymptotic linearity of normal equations. Bull. Czech Econometr. Soc. 9 (2002), 15, 31-58, 2002   CrossRef
  21. J. Á. Víšek: Sensitivity analysis of $M$-estimates of nonlinear regression model: Influence of data subsets. Ann. Inst. Statist. Math. 54 (2002), 261-290   CrossRef
  22. J. Á. Víšek: The least trimmed squares. Sensitivity study. In: Proc. Prague Stochastics 2006, (M. Hušková and M. Janžura, eds.) Matfyzpress 2006, 728-738.   CrossRef
  23. J. Á. Víšek: Robust error-term-scale estimate. IMS Collections. Nonparametrics and Robustness in Modern Statistical Inference and Time Series Analysis: Festschrift for Jana Jurečková, 7 (2010), 254-267.   CrossRef
  24. J. Á. Víšek: Empirical distribution function under heteroscedasticity. To appear in {Statistics} \href{http://www.informaworld.com/smpp/content db=all content=a922317072}{http://www.informaworld.com/smpp/content$\sim$db=all$\sim$content=a922317072}   CrossRef