Mathematical Statistics

Explores mathematical statistics in its entirety—from the fundamentals to modern methods This book introduces readers to point estimation, confidence intervals, and statistical tests. Based on the general theory of linear models, it provides an in-depth overview of the following: analysis of variance (ANOVA) for models with fixed, random, and mixed effects; regression analysis is also first presented for linear models with fixed, random, and mixed effects before being expanded to nonlinear models; statistical multi-decision problems like statistical selection procedures (Bechhofer and Gupta) and sequential tests; and design of experiments from a mathematical-statistical point of view. Most analysis methods have been supplemented by formulae for minimal sample sizes. The chapters also contain exercises with hints for solutions. Translated from the successful German text, Mathematical Statistics requires knowledge of probability theory (combinatorics, probability distributions, functions and sequences of random variables), which is typically taught in the earlier semesters of scientific and mathematical study courses. It teaches readers all about statistical analysis and covers the design of experiments. The book also describes optimal allocation in the chapters on regression analysis. Additionally, it features a chapter devoted solely to experimental designs. Classroom-tested with exercises included Practice-oriented (taken from day-to-day statistical work of the authors) Includes further studies including design of experiments and sample sizing Presents and uses IBM SPSS Statistics 24 for practical calculations of data Mathematical Statistics is a recommended text for advanced students and practitioners of math, probability, and statistics.  

Table of Contents:
Preface xiii 1 Basic Ideas of Mathematical Statistics 1 1.1 Statistical Population and Samples 2 1.1.1 Concrete Samples and Statistical Populations 2 1.1.2 Sampling Procedures 4 1.2 Mathematical Models for Population and Sample 8 1.3 Sufficiency and Completeness 9 1.4 The Notion of Information in Statistics 20 1.5 Statistical Decision Theory 28 1.6 Exercises 32 References 37 2 Point Estimation 39 2.1 Optimal Unbiased Estimators 41 2.2 Variance-Invariant Estimation 53 2.3 Methods for Construction and Improvement of Estimators 57 2.3.1 Maximum Likelihood Method 57 2.3.2 Least Squares Method 60 2.3.3 Minimum Chi-Squared Method 61 2.3.4 Method of Moments 62 2.3.5 Jackknife Estimators 63 2.3.6 Estimators Based on Order Statistics 64 2.3.6.1 Order and Rank Statistics 64 2.3.6.2 L-Estimators 66 2.3.6.3 M-Estimators 67 2.3.6.4 R-Estimators 68 2.4 Properties of Estimators 68 2.4.1 Small Samples 69 2.4.2 Asymptotic Properties 71 2.5 Exercises 75 References 78 3 Statistical Tests and Confidence Estimations 79 3.1 Basic Ideas of Test Theory 79 3.2 The Neyman–Pearson Lemma 87 3.3 Tests for Composite Alternative Hypotheses and One-Parametric Distribution Families 96 3.3.1 Distributions with Monotone Likelihood Ratio and Uniformly Most Powerful Tests for One-Sided Hypotheses 96 3.3.2 UMPU-Tests for Two-Sided Alternative Hypotheses 105 3.4 Tests for Multi-Parametric Distribution Families 110 3.4.1 General Theory 111 3.4.2 The Two-Sample Problem: Properties of Various Tests and Robustness 124 3.4.2.1 Comparison of Two Expectations 125 3.4.3 Comparison of Two Variances 137 3.4.4 Table for Sample Sizes 138 3.5 Confidence Estimation 139 3.5.1 One-Sided Confidence Intervals in One-Parametric Distribution Families 140 3.5.2 Two-Sided Confidence Intervals in One-Parametric and Confidence Intervals in Multi-Parametric Distribution Families 143 3.5.3 Table for Sample Sizes 146 3.6 Sequential Tests 147 3.6.1 Introduction 147 3.6.2 Wald’s Sequential Likelihood Ratio Test for One-Parametric Exponential Families 149 3.6.3 Test about Mean Values for Unknown Variances 153 3.6.4 Approximate Tests for the Two-Sample Problem 158 3.6.5 Sequential Triangular Tests 160 3.6.6 A Sequential Triangular Test for the Correlation Coefficient 162 3.7 Remarks about Interpretation 169 3.8 Exercises 170 References 176 4 Linear Models: General Theory 179 4.1 Linear Models with Fixed Effects 179 4.1.1 Least Squares Method 180 4.1.2 Maximum Likelihood Method 184 4.1.3 Tests of Hypotheses 185 4.1.4 Construction of Confidence Regions 190 4.1.5 Special Linear Models 191 4.1.6 The Generalised Least Squares Method (GLSM) 198 4.2 Linear Models with Random Effects: Mixed Models 199 4.2.1 Best Linear Unbiased Prediction (BLUP) 200 4.2.2 Estimation of Variance Components 202 4.3 Exercises 203 References 204 5 Analysis of Variance (ANOVA): Fixed Effects Models (Model I of Analysis of Variance) 207 5.1 Introduction 207 5.2 Analysis of Variance with One Factor (Simple- or One-Way Analysis of Variance) 215 5.2.1 The Model and the Analysis 215 5.2.2 Planning the Size of an Experiment 228 5.2.2.1 General Description for All Sections of This Chapter 228 5.2.2.2 The Experimental Size for the One-Way Classification 231 5.3 Two-Way Analysis of Variance 232 5.3.1 Cross-Classification (A × B) 233 5.3.1.1 Parameter Estimation 236 5.3.1.2 Testing Hypotheses 244 5.3.2 Nested Classification (A B) 260 5.4 Three-Way Classification 272 5.4.1 Complete Cross-Classification (A × B × C) 272 5.4.2 Nested Classification (C≺B≺A) 279 5.4.3 Mixed Classification 282 5.4.3.1 Cross-Classification between Two Factors Where One of Them Is Subordinated to a Third Factor B≺A × C 282 5.4.3.2 Cross-Classification of Two Factors in Which a Third Factor Is Nested C≺ A× B 288 5.5 Exercises 291 References 291 6 Analysis of Variance: Estimation of Variance Components (Model II of the Analysis of Variance) 293 6.1 Introduction: Linear Models with Random Effects 293 6.2 One-Way Classification 297 6.2.1 Estimation of Variance Components 300 6.2.1.1 Analysis of Variance Method 300 6.2.1.2 Estimators in Case of Normally Distributed Y 302 6.2.1.3 REML: Estimation 304 6.2.1.4 Matrix Norm Minimising Quadratic Estimation 305 6.2.1.5 Comparison of Several Estimators 306 6.2.2 Tests of Hypotheses and Confidence Intervals 308 6.2.3 Variances and Properties of the Estimators of the Variance Components 310 6.3 Estimators of Variance Components in the Two-Way and Three-Way Classification 315 6.3.1 General Description for Equal and Unequal Subclass Numbers 315 6.3.2 Two-Way Cross-Classification 319 6.3.3 Two-Way Nested Classification 324 6.3.4 Three-Way Cross-Classification with Equal Subclass Numbers 326 6.3.5 Three-Way Nested Classification 334 6.3.6 Three-Way Mixed Classification 334 6.4 Planning Experiments 336 6.5 Exercises 338 References 339 7 Analysis of Variance: Models with Finite Level Populations and Mixed Models 341 7.1 Introduction: Models with Finite Level Populations 341 7.2 Rules for the Derivation of SS, df, MS and E(MS) in Balanced ANOVA Models 343 7.3 Variance Component Estimators in Mixed Models 348 7.3.1 An Example for the Balanced Case 349 7.3.2 The Unbalanced Case 351 7.4 Tests for Fixed Effects and Variance Components 353 7.5 Variance Component Estimation and Tests of Hypotheses in Special Mixed Models 354 7.5.1 Two-Way Cross-Classification 355 7.5.2 Two-Way Nested Classification B ≺ A 358 7.5.2.1 Levels of A Random 360 7.5.2.2 Levels of B Random 361 7.5.3 Three-Way Cross-Classification 362 7.5.4 Three-Way Nested Classification 365 7.5.5 Three-Way Mixed Classification 369 7.5.5.1 The Type (B ≺ A) × C 369 7.5.5.2 The Type C ≺ AB 374 7.6 Exercises 376 References 376 8 Regression Analysis: Linear Models with Non-random Regressors (Model I of Regression Analysis) and with Random Regressors (Model II of Regression Analysis) 377 8.1 Introduction 377 8.2 Parameter Estimation 380 8.2.1 Least Squares Method 380 8.2.2 Optimal Experimental Design 394 8.3 Testing Hypotheses 397 8.4 Confidence Regions 406 8.5 Models with Random Regressors 410 8.5.1 Analysis 410 8.5.2 Experimental Designs 415 8.6 Mixed Models 416 8.7 Concluding Remarks about Models of Regression Analysis 417 8.8 Exercises 419 References 419 9 Regression Analysis: Intrinsically Non-linear Model I 421 9.1 Estimating by the Least Squares Method 424 9.1.1 Gauß–Newton Method 425 9.1.2 Internal Regression 431 9.1.3 Determining Initial Values for Iteration Methods 433 9.2 Geometrical Properties 434 9.2.1 Expectation Surface and Tangent Plane 434 9.2.2 Curvature Measures 440 9.3 Asymptotic Properties and the Bias of LS Estimators 443 9.4 Confidence Estimations and Tests 447 9.4.1 Introduction 447 9.4.2 Tests and Confidence Estimations Based on the Asymptotic Covariance Matrix 451 9.4.3 Simulation Experiments to Check Asymptotic Tests and Confidence Estimations 452 9.5 Optimal Experimental Design 454 9.6 Special Regression Functions 458 9.6.1 Exponential Regression 458 9.6.1.1 Point Estimator 458 9.6.1.2 Confidence Estimations and Tests 460 9.6.1.3 Results of Simulation Experiments 463 9.6.1.4 Experimental Designs 466 9.6.2 The Bertalanffy Function 468 9.6.3 The Logistic (Three-Parametric Hyperbolic Tangent) Function 473 9.6.4 The Gompertz Function 476 9.6.5 The Hyperbolic Tangent Function with Four Parameters 479 9.6.6 The arc tangent Function with Four Parameters 484 9.6.7 The Richards Function 487 9.6.8 Summarising the Results of Sections 9.6.1–9.6.7 487 9.6.9 Problems of Model Choice 488 9.7 Exercises 489 References 490 10 Analysis of Covariance (ANCOVA) 495 10.1 Introduction 495 10.2 General Model I–I of the Analysis of Covariance 496 10.3 Special Models of the Analysis of Covariance for the Simple Classification 503 10.3.1 One Covariable with Constant γ 504 10.3.2 A Covariable with Regression Coefficients γi Depending on the Levels of the Classification Factor 506 10.3.3 A Numerical Example 507 10.4 Exercises 510 References 511 11 Multiple Decision Problems 513 11.1 Selection Procedures 514 11.1.1 Basic Ideas 514 11.1.2 Indifference Zone Formulation for Expectations 516 11.1.2.1 Selection of Populations with Normal Distribution 517 11.1.2.2 Approximate Solutions for Non-normal Distributions and t = 1 529 11.1.3 Selection of a Subset Containing the Best Population with Given Probability 530 11.1.3.1 Selection of the Normal Distribution with the Largest Expectation 534 11.1.3.2 Selection of the Normal Distribution with Smallest Variance 535 11.2 Multiple Comparisons 536 11.2.1 Confidence Intervals for All Contrasts: Scheffé’s Method 542 11.2.2 Confidence Intervals for Given Contrast: Bonferroni’s and Dunn’s Method 547 11.2.3 Confidence Intervals for All Contrasts for ni = n: Tukey’s Method 550 11.2.4 Confidence Intervals for All Contrast: Generalised Tukey’s Method 553 11.2.5 Confidence Intervals for the Differences of Treatments with a Control: Dunnett’s Method 555 11.2.6 Multiple Comparisons and Confidence Intervals 556 11.2.7 Which Multiple Comparisons Shall Be Used? 559 11.3 A Numerical Example 560 11.4 Exercises 564 References 564 12 Experimental Designs 567 12.1 Introduction 568 12.2 Block Designs 571 12.2.1 Completely Balanced Incomplete Block Designs (BIBD) 574 12.2.2 Construction Methods of BIBD 582 12.2.3 Partially Balanced Incomplete Block Designs 596 12.3 Row–Column Designs 600 12.4 Factorial Designs 603 12.5 Programs for Construction of Experimental Designs 604 12.6 Exercises 604 References 605 Appendix A: Symbolism 609 Appendix B: Abbreviations 611 Appendix C: Probability and Density Functions 613 Appendix D: Tables 615 Solutions and Hints for Exercises 627 Index 659

About the Author :
DIETER RASCH, PhD, is scientific advisor at the Center for Design of Experiments at the University of Natural Resources and Life Sciences, Vienna, Austria. He has published more than 275 scientific papers and 56 books as author or editor. DIETER SCHOTT obtained his PhD in analysis from the University of Rostock in 1976 and did his habilitation in the field of numerical functional analysis in 1982. He has published more than 100 scientific papers and is active as author, co-author and editor of numerous books and scientific journals.