Applied Statistics Theory and Problem Solutions with R

Instructs readers on how to use methods of statistics and experimental design with R software 

Applied statistics covers both the theory and the application of modern statistical and mathematical modelling techniques to applied problems in industry, public services, commerce, and research. It proceeds from a strong theoretical background, but it is practically oriented to develop one's ability to tackle new and non-standard problems confidently. Taking a practical approach to applied statistics, this user-friendly guide teaches readers how to use methods of statistics and experimental design without going deep into the theory.

Applied Statistics: Theory and Problem Solutions with R includes chapters that cover R package sampling procedures, analysis of variance, point estimation, and more. It follows on the heels of Rasch and Schott's Mathematical Statistics via that book's theoretical background—taking the lessons learned from there to another level with this book’s addition of instructions on how to employ the methods using R. But there are two important chapters not mentioned in the theoretical back ground as Generalised Linear Models and Spatial Statistics. 

• Offers a practical over theoretical approach to the subject of applied statistics
• Provides a pre-experimental as well as post-experimental approach to applied statistics
• Features classroom tested material
• Applicable to a wide range of people working in experimental design and all empirical sciences
• Includes 300 different procedures with R and examples with R-programs for the analysis and for determining minimal experimental sizes

Applied Statistics: Theory and Problem Solutions with R will appeal to experimenters, statisticians, mathematicians, and all scientists using statistical procedures in the natural sciences, medicine, and psychology amongst others. 

DIETER RASCH, PHD, is scientific advisor at the Center for Design of Experiments at the University of Natural Resources and Life Sciences, Vienna, Austria. He is also an elected member of the International Statistical Institute (ISI) and the Institute of Mathematical Statistics (IMS).

ROB VERDOOREN, PHD, is a Consultant Statistician at Danone Nutricia Research, Utrecht, The Netherlands.

JÜRGEN PILZ, PHD, is the Head of the Department of Applied Statistics at AAU Klagenfurt, Austria. He is also an elected member of the International Statistical Institute (ISI) and the Institute of Mathematical Statistics (IMS).

Preface xi

1 The R-Package, Sampling Procedures, and Random Variables 1

1.1 Introduction 1

1.2 The Statistical Software Package R 1

1.3 Sampling Procedures and Random Variables 4

References 10

2 Point Estimation 11

2.1 Introduction 11

2.2 Estimating Location Parameters 12

2.2.1 Maximum Likelihood Estimation of Location Parameters 17

2.2.2 Estimating Expectations from Censored Samples and Truncated Distributions 20

2.2.3 Estimating Location Parameters of Finite Populations 23

2.3 Estimating Scale Parameters 24

2.4 Estimating Higher Moments 27

2.5 Contingency Tables 29

2.5.1 Models of Two-Dimensional Contingency Tables 29

2.5.1.1 Model I 29

2.5.1.2 Model II 29

2.5.1.3 Model III 30

2.5.2 Association Coefficients for 2 ×2 Tables 30

References 38

3 Testing Hypotheses – One- and Two-Sample Problems 39

3.1 Introduction 39

3.2 The One-Sample Problem 41

3.2.1 Tests on an Expectation 41

3.2.1.1 Testing the Hypothesis on the Expectation of a Normal Distribution with Known Variance 41

3.2.1.2 Testing the Hypothesis on the Expectation of a Normal Distribution with Unknown Variance 47

3.2.2 Test on the Median 51

3.2.3 Test on the Variance of a Normal Distribution 54

3.2.4 Test on a Probability 56

3.2.5 Paired Comparisons 57

3.2.6 Sequential Tests 59

3.3 The Two-Sample Problem 63

3.3.1 Tests on Two Expectations 63

3.3.1.1 The Two-Sample t-Test 63

3.3.1.2 The Welch Test 66

3.3.1.3 The Wilcoxon Rank Sum Test 70

3.3.1.4 Definition of Robustness and Results of Comparing Tests by Simulation 72

3.3.1.5 Sequential Two-Sample Tests 74

3.3.2 Test on Two Medians 76

3.3.2.1 Rationale 77

3.3.3 Test on Two Probabilities 78

3.3.4 Tests on Two Variances 79

References 81

4 Confidence Estimations – One- and Two-Sample Problems 83

4.1 Introduction 83

4.2 The One-Sample Case 84

4.2.1 A Confidence Interval for the Expectation of a Normal Distribution 84

4.2.2 A Confidence Interval for the Variance of a Normal Distribution 91

4.2.3 A Confidence Interval for a Probability 93

4.3 The Two-Sample Case 96

4.3.1 A Confidence Interval for the Difference of Two Expectations – Equal Variances 96

4.3.2 A Confidence Interval for the Difference of Two Expectations – Unequal Variances 98

4.3.3 A Confidence Interval for the Difference of Two Probabilities 100

References 104

5 Analysis of Variance (ANOVA) – Fixed Effects Models 105

5.1 Introduction 105

5.1.1 Remarks about Program Packages 106

5.2 Planning the Size of an Experiment 106

5.3 One-Way Analysis of Variance 108

5.3.1 Analysing Observations 109

5.3.2 Determination of the Size of an Experiment 112

5.4 Two-Way Analysis of Variance 115

5.4.1 Cross-Classification (A× B) 115

5.4.1.1 Parameter Estimation 117

5.4.1.2 Testing Hypotheses 119

5.4.2 Nested Classification (A≻B) 131

5.5 Three-Way Classification 134

5.5.1 Complete Cross-Classification (A×B ×C) 135

5.5.2 Nested Classification (C ≺B≺A) 144

5.5.3 Mixed Classifications 147

5.5.3.1 Cross-Classification between Two Factors where One of Them Is Sub-Ordinated to a Third Factor ((B≺A)xC) 148

5.5.3.2 Cross-Classification of Two Factors, in which a Third Factor is Nested (C≺(A× B)) 153

References 157

6 Analysis of Variance –Models with Random Effects 159

6.1 Introduction 159

6.2 One-Way Classification 159

6.2.1 Estimation of the Variance Components 160

6.2.1.1 ANOVA Method 160

6.2.1.2 Maximum Likelihood Method 164

6.2.1.3 REML – Estimation 166

6.2.2 Tests of Hypotheses and Confidence Intervals 169

6.2.3 Expectation and Variances of the ANOVA Estimators 174

6.3 Two-Way Classification 176

6.3.1 Two-Way Cross Classification 176

6.3.2 Two-Way Nested Classification 182

6.4 Three-Way Classification 186

6.4.1 Three-Way Cross-Classification with Equal Sub-Class Numbers 186

6.4.2 Three-Way Nested Classification 192

6.4.3 Three-Way Mixed Classifications 195

6.4.3.1 Cross-Classification Between Two Factors Where One of Them is Sub-Ordinated to a Third Factor ((B≺A)×C) 195

6.4.3.2 Cross-Classification of Two Factors in Which a Third Factor is Nested (C≺(A×B)) 197

References 199

7 Analysis of Variance –Mixed Models 201

7.1 Introduction 201

7.2 Two-Way Classification 201

7.2.1 Balanced Two-Way Cross-Classification 201

7.2.2 Two-Way Nested Classification 214

7.3 Three-Way Layout 223

7.3.1 Three-Way Analysis of Variance – Cross-Classification A × B × C 223

7.3.2 Three-Way Analysis of Variance – Nested Classification A≻B≻C 230

7.3.2.1 Three-Way Analysis of Variance – Nested Classification – Model III – Balanced Case 230

7.3.2.2 Three-Way Analysis of Variance – Nested Classification – Model IV – Balanced Case 232

7.3.2.3 Three-Way Analysis of Variance – Nested Classification – Model V – Balanced Case 234

7.3.2.4 Three-Way Analysis of Variance – Nested Classification – Model VI – Balanced Case 236

7.3.2.5 Three-Way Analysis of Variance – Nested Classification – Model VII – Balanced Case 237

7.3.2.6 Three-Way Analysis of Variance – Nested Classification – Model VIII – Balanced Case 238

7.3.3 Three-Way Analysis of Variance – Mixed Classification – (A× B)≻C 239

7.3.3.1 Three-Way Analysis of Variance – Mixed Classification – (A× B)≻C Model III 239

7.3.3.2 Three-Way Analysis of Variance – Mixed Classification – (A× B)≻C Model IV 242

7.3.3.3 Three-Way Analysis of Variance – Mixed Classification – (A× B)≻C Model V 243

7.3.3.4 Three-Way Analysis of Variance – Mixed Classification – (A× B)≻C Model VI 245

7.3.4 Three-Way Analysis of Variance – Mixed Classification – (A≻B) ×C 247

7.3.4.1 Three-Way Analysis of Variance – Mixed Classification – (A≻B) ×C Model III 247

7.3.4.2 Three-Way Analysis of Variance – Mixed Classification – (A≻B) ×C Model IV 249

7.3.4.3 Three-Way Analysis of Variance – Mixed Classification – (A≻B) ×C Model V 251

7.3.4.4 Three-Way Analysis of Variance – Mixed Classification – (A≻B) ×C Model VI 253

7.3.4.5 Three-Way Analysis of Variance – Mixed Classification – (A≻B) ×C model VII 254

7.3.4.6 Three-Way Analysis of Variance – Mixed Classification – (A≻B) ×C Model VIII 255

References 256

8 Regression Analysis 257

8.1 Introduction 257

8.2 Regression with Non-Random Regressors – Model I of Regression 262

8.2.1 Linear and Quasilinear Regression 262

8.2.1.1 Parameter Estimation 263

8.2.1.2 Confidence Intervals and Hypotheses Testing 274

8.2.2 Intrinsically Non-Linear Regression 282

8.2.2.1 The Asymptotic Distribution of the Least Squares Estimators 283

8.2.2.2 The Michaelis–Menten Regression 285

8.2.2.3 Exponential Regression 290

8.2.2.4 The Logistic Regression 298

8.2.2.5 The Bertalanffy Function 306

8.2.2.6 The Gompertz Function 312

8.2.3 Optimal Experimental Designs 315

8.2.3.1 Simple Linear and Quasilinear Regression 316

8.2.3.2 Intrinsically Non-linear Regression 317

8.2.3.3 The Michaelis-Menten Regression 319

8.2.3.4 Exponential Regression 319

8.2.3.5 The Logistic Regression 320

8.2.3.6 The Bertalanffy Function 321

8.2.3.7 The Gompertz Function 321

8.3 Models with Random Regressors 322

8.3.1 The Simple Linear Case 322

8.3.2 The Multiple Linear Case and the Quasilinear Case 330

8.3.2.1 Hypotheses Testing - General 333

8.3.2.2 Confidence Estimation 333

8.3.3 The Allometric Model 334

8.3.4 Experimental Designs 335

References 335

9 Analysis of Covariance (ANCOVA) 339

9.1 Introduction 339

9.2 Completely Randomised Design with Covariate 340

9.2.1 Balanced Completely Randomised Design 340

9.2.2 Unbalanced Completely Randomised Design 350

9.3 Randomised Complete Block Design with Covariate 358

9.4 Concluding Remarks 365

References 366

10 Multiple Decision Problems 367

10.1 Introduction 367

10.2 Selection Procedures 367

10.2.1 The Indifference Zone Formulation for Selecting Expectations 368

10.2.1.1 Indifference Zone Selection, 𝜎² Known 368

10.2.1.2 Indifference Zone Selection, 𝜎² Unknown 371

10.3 The Subset Selection Procedure for Expectations 371

10.4 Optimal Combination of the Indifference Zone and the Subset Selection Procedure 372

10.5 Selection of the Normal Distribution with the Smallest Variance 375

10.6 Multiple Comparisons 375

10.6.1 The Solution of MC Problem 10.1 377

10.6.1.1 The F-test for MC Problem 10.1 377

10.6.1.2 Scheffé’s Method for MC Problem 10.1 378

10.6.1.3 Bonferroni’s Method for MC Problem 10.1 379

10.6.1.4 Tukey’s Method for MC Problem 10.1 for n_i = n 382

10.6.1.5 Generalised Tukey’s Method for MC Problem 10.1 for n_i ≠n 383

10.6.2 The Solution of MC Problem 10.2 – the Multiple t-Test 384

10.6.3 The Solution of MC Problem 10.3 – Pairwise and Simultaneous Comparisons with a Control 385

10.6.3.1 Pairwise Comparisons – The Multiple t-Test 385

10.6.3.2 Simultaneous Comparisons –The Dunnett Method 387

References 390

11 Generalised Linear Models 393

11.1 Introduction 393

11.2 Exponential Families of Distributions 394

11.3 Generalised Linear Models – An Overview 396

11.4 Analysis – Fitting a GLM – The Linear Case 398

11.5 Binary Logistic Regression 399

11.5.1 Analysis 400

11.5.2 Overdispersion 408

11.6 Poisson Regression 411

11.6.1 Analysis 411

11.6.2 Overdispersion 417

11.7 The Gamma Regression 417

11.8 GLM for Gamma Regression 418

11.9 GLM for the Multinomial Distribution 425

References 428

12 Spatial Statistics 429

12.1 Introduction 429

12.2 Geostatistics 431

12.2.1 Semi-variogram Function 432

12.2.2 Semi-variogram Parameter Estimation 439

12.2.3 Kriging 440

12.2.4 Trans-Gaussian Kriging 446

12.3 Special Problems and Outlook 450

12.3.1 Generalised Linear Models in Geostatistics 450

12.3.2 Copula Based Geostatistical Prediction 451

References 451

Appendix A List of Problems 455

Appendix B Symbolism 483

Appendix C Abbreviations 485

Appendix D Probability and Density Functions 487

Index 489

The New copy of this book will include any supplemental materials advertised. Please check the title of the book to determine if it should include any access cards, study guides, lab manuals, CDs, etc.

The Used, Rental and eBook copies of this book are not guaranteed to include any supplemental materials. Typically, only the book itself is included. This is true even if the title states it includes any access cards, study guides, lab manuals, CDs, etc.