[PDF] Mathematical Statistics 2.9.3 The distribution





Previous PDF Next PDF



Chapter 3 FRAPPY Student Samples

Two statistics students went to a flower shop and randomly selected 12 carnations. When they got home the students prepared 12 identical vases with the same 



Digest of Education Statistics 2019

Chapter 3. Postsecondary Education. Overview and Historical. 301.10. Enrollment staff



TI 83/84 Calculator – The Basics of Statistical Functions

Chapters 3-4-5 – Summary Notes. Chapter 3 – Statistics for Describing Exploring and Comparing Data. Calculating Standard Deviation.



Mathematical Statistics

2.9.3 The distribution of the maximum of two random variables 42. 2.10 Sufficiency . When further developing the theory (see Chapter 6) we.



Frequently Used Statistics Formulas and Tables

Chapter 2 highest value - lowest value. Class Width = (increase to next integer) number classes upper limit + lower limit. Class Midpoint = 2. Chapter 3.



International Statistics on Crime and Justice UNODC

3. International Statistics on Crime and Criminal Justice. Contents This chapter presents available data on the crime of intentional homicide – the ...



CHAPTER 3 COMMONLY USED STATISTICAL TERMS

The importance of statistics in the research process is sometimes exaggerated. Thus a highly sophisticated statistical analysis rarely



Organisation of Data Ch.-3 (Ver-5).pmd

If you present. 2022-23. Page 3. 24. STATISTICS FOR ECONOMICS them as a table they may appear something like Table 3.1. TABLE 3.1. Marks in Mathematics 



Chapter 3. The Basis of Official Statistics

Chapter 3. The Basis of Official Statistics. 3.1 Introduction. The key concept and the main topic in this handbook is official statistics.



Chapter 3. The Basis of Official Statistics

Handbook Official statistics3 are defined as comprising the following three Fundamental Principles of Official Statistics Chapter 3.4 - Legislative ...

Mathematical Statistics

Sara van de Geer

September 2010

2

Contents

1 Introduction 7

1.1 Some notation and model assumptions . . . . . . . . . . . . . . . 7

1.2 Estimation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10

1.3 Comparison of estimators: risk functions . . . . . . . . . . . . . . 12

1.4 Comparison of estimators: sensitivity . . . . . . . . . . . . . . . . 12

1.5 Confidence intervals . . . . . . . . . . . . . . . . . . . . . . . . . 13

1.5.1 Equivalence confidence sets and tests . . . . . . . . . . . . 13

1.6 Intermezzo: quantile functions . . . . . . . . . . . . . . . . . . . 14

1.7 How to construct tests and confidence sets . . . . . . . . . . . . . 14

1.8 An illustration: the two-sample problem . . . . . . . . . . . . . . 16

1.8.1 Assuming normality . . . . . . . . . . . . . . . . . . . . . 17

1.8.2 A nonparametric test . . . . . . . . . . . . . . . . . . . . 18

1.8.3 Comparison of Student"s test and Wilcoxon"s test . . . . . 20

1.9 How to construct estimators . . . . . . . . . . . . . . . . . . . . . 21

1.9.1 Plug-in estimators . . . . . . . . . . . . . . . . . . . . . . 21

1.9.2 The method of moments . . . . . . . . . . . . . . . . . . . 22

1.9.3 Likelihood methods . . . . . . . . . . . . . . . . . . . . . 23

2 Decision theory 29

2.1 Decisions and their risk . . . . . . . . . . . . . . . . . . . . . . . 29

2.2 Admissibility . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31

2.3 Minimaxity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33

2.4 Bayes decisions . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34

2.5 Intermezzo: conditional distributions . . . . . . . . . . . . . . . . 35

2.6 Bayes methods . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36

2.7 Discussion of Bayesian approach (to be written) . . . . . . . . . . 39

2.8 Integrating parameters out (to be written) . . . . . . . . . . . . . 39

2.9 Intermezzo: some distribution theory . . . . . . . . . . . . . . . . 39

2.9.1 The multinomial distribution . . . . . . . . . . . . . . . . 39

2.9.2 The Poisson distribution . . . . . . . . . . . . . . . . . . . 41

2.9.3 The distribution of the maximum of two random variables 42

2.10 Sufficiency . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42

2.10.1 Rao-Blackwell . . . . . . . . . . . . . . . . . . . . . . . . . 44

2.10.2 Factorization Theorem of Neyman . . . . . . . . . . . . . 45

2.10.3 Exponential families . . . . . . . . . . . . . . . . . . . . . 47

2.10.4 Canonical form of an exponential family . . . . . . . . . . 48

3

4CONTENTS

2.10.5 Minimal sufficiency . . . . . . . . . . . . . . . . . . . . . . 53

3 Unbiased estimators 55

3.1 What is an unbiased estimator? . . . . . . . . . . . . . . . . . . . 55

3.2 UMVU estimators . . . . . . . . . . . . . . . . . . . . . . . . . . 56

3.2.1 Complete statistics . . . . . . . . . . . . . . . . . . . . . . 59

3.3 The Cramer-Rao lower bound . . . . . . . . . . . . . . . . . . . . 62

3.4 Higher-dimensional extensions . . . . . . . . . . . . . . . . . . . . 66

3.5 Uniformly most powerful tests . . . . . . . . . . . . . . . . . . . . 68

3.5.1 An example . . . . . . . . . . . . . . . . . . . . . . . . . . 68

3.5.2 UMP tests and exponential families . . . . . . . . . . . . 71

3.5.3 Unbiased tests . . . . . . . . . . . . . . . . . . . . . . . . 74

3.5.4 Conditional tests . . . . . . . . . . . . . . . . . . . . . . . 77

4 Equivariant statistics 81

4.1 Equivariance in the location model . . . . . . . . . . . . . . . . . 81

4.2 Equivariance in the location-scale model (to be written) . . . . . 86

5 Proving admissibility and minimaxity 87

5.1 Minimaxity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 88

5.2 Admissibility . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 89

5.3 Inadmissibility in higher-dimensional settings (to be written) . . . 95

6 Asymptotic theory 97

6.1 Types of convergence . . . . . . . . . . . . . . . . . . . . . . . . . 97

6.1.1 Stochastic order symbols . . . . . . . . . . . . . . . . . . . 99

6.1.2 Some implications of convergence . . . . . . . . . . . . . . 99

6.2 Consistency and asymptotic normality . . . . . . . . . . . . . . . 101

6.2.1 Asymptotic linearity . . . . . . . . . . . . . . . . . . . . . 101

6.2.2 Theδ-technique . . . . . . . . . . . . . . . . . . . . . . . 102

6.3 M-estimators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 104

6.3.1 Consistency of M-estimators . . . . . . . . . . . . . . . . . 106

6.3.2 Asymptotic normality of M-estimators . . . . . . . . . . . 109

6.4 Plug-in estimators . . . . . . . . . . . . . . . . . . . . . . . . . . 114

6.4.1 Consistency of plug-in estimators . . . . . . . . . . . . . . 117

6.4.2 Asymptotic normality of plug-in estimators . . . . . . . . 118

6.5 Asymptotic relative efficiency . . . . . . . . . . . . . . . . . . . . 121

6.6 Asymptotic Cramer Rao lower bound . . . . . . . . . . . . . . . 123

6.6.1 Le Cam"s 3

rdLemma . . . . . . . . . . . . . . . . . . . . . 126

6.7 Asymptotic confidence intervals and tests . . . . . . . . . . . . . 129

6.7.1 Maximum likelihood . . . . . . . . . . . . . . . . . . . . . 131

6.7.2 Likelihood ratio tests . . . . . . . . . . . . . . . . . . . . . 135

6.8 Complexity regularization(to be written). . . . . . . . . . . . . 139

7 Literature 141

CONTENTS5

These notes in English will closely followMathematische Statistik, by H.R. K¨unsch (2005), but are as yet incomplete.Mathematische Statistikcan be used as supplementary reading material in German. Mathematical rigor and clarity often bite each other. At some places, not all subtleties are fully presented. A snake will indicate this.

6CONTENTS

Chapter 1

Introduction

Statistics is about the mathematical modeling of observable phenomena, using stochastic models, and about analyzing data: estimating parameters of the model and testing hypotheses. In these notes, we study various estimation and testing procedures. We consider their theoretical properties and we investigate various notions of optimality.

1.1 Some notation and model assumptions

The data consist of measurements (observations)x1,...,xn, which are regarded as realizations of random variablesX1,...,Xn. In most of the notes, theXi are real-valued:Xi?R(fori= 1,...,n), although we will also consider some extensions to vector-valued observations. Example 1.1.1Fizeau and Foucault developed methods for estimating the speed of light (1849, 1850), which were later improved by Newcomb and Michel- son. The main idea is to pass light from a rapidly rotating mirror to a fixed mirror and back to the rotating mirror. An estimate of the velocity of light is obtained, taking into account the speed of the rotating mirror, the distance travelled, and the displacement of the light as it returns to the rotating mirror.Fig. 1 The data are Newcomb"s measurements of the passage time it took light to travel from his lab, to a mirror on the Washington Monument, and back to his lab. 7

8CHAPTER 1. INTRODUCTION

distance: 7.44373 km.

66 measurements on 3 consecutive days

first measurement: 0.000024828 seconds= 24828 nanoseconds The dataset has the deviations from 24800 nanoseconds.

The measurements on 3 different days:l

l l l l l l l l l l l l l l l l l l l

0510152025

-40 0 20 40
day 1 t1 X1 l l l l l l l l l l ll l l l l l l l l l l

202530354045

-40 0 20 40
day 2 t2 X2 l l llll l ll l l ll l l l ll l l l lll l l

404550556065

-40 0 20 40
day 3 t3

X3All measurements in one plot:

l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l ll l l l l l l l ll l l l l l l l l l l l l l

0102030405060

-40 -20 0 20 40
t X l l

1.1. SOME NOTATION AND MODEL ASSUMPTIONS9

One may estimate the speed of light using e.g. the mean, or the median, or Huber"s estimate (see below). This gives the following results (for the 3 days separately, and for the three days combined):Mean

Median

quotesdbs_dbs18.pdfusesText_24
[PDF] Ch. 3. Le contrat de transport international - France

[PDF] Ch. 7 - Enolates - Anciens Et Réunions

[PDF] CH. Marche avec lui

[PDF] Ch. SAINT-BENEZET - Les CAPRICES de LOLA - rosé

[PDF] Ch. viva 413 fr.qxd - Padre Pio and Chiesa viva

[PDF] Ch. Xirage des Enfants de Lutece

[PDF] CH.1 ARBRES - La Dépendance Au Tabac

[PDF] Ch.1 EXTRACTION ET SEPARATION D`ESPECES CHIMIQUES - Cartes De Crédit

[PDF] Ch.1 LES MÉCANISMES OPTIQUES DE LA VISION - Les Adolescents

[PDF] CH.1 L`EAU DANS NOTRE ENVIRONNEMENT – activité 1

[PDF] Ch.10. Exercices corrigés p : 270 n°6 à 11. C asymétrique

[PDF] Ch.11. L`ELEMENT CHIMIQUE - Asthme

[PDF] Ch.14 TRANSFERTS MACROSCOPIQUES D`ENERGIE I

[PDF] CH.17 : MECANIQUE DU SOLIDE

[PDF] Ch.3 NOUVEAUX HORIZONS GEOGRAPHIQUES