The only singular, all-encompassing textbook on state-of-the-art technical performance evaluation
Fundamentals of Performance Evaluation of Computer and Telecommunication Systems uniquely presents all techniques of performance evaluation of computers systems, communication networks, and telecommunications in a balanced manner. Written by the renowned Professor Mohammad S. Obaidat and his coauthor Professor Noureddine Boudriga, it is also the only resource to treat computer and telecommunication systems as inseparable issues. The authors explain the basic concepts of performance evaluation, applications, performance evaluation metrics, workload types, benchmarking, and characterization of workload. This is followed by a review of the basics of probability theory, and then, the main techniques for performance evaluation—namely measurement, simulation, and analytic modeling—with case studies and examples.
- Contains the practical and applicable knowledge necessary for a successful performance evaluation in a balanced approach
- Reviews measurement tools, benchmark programs, design of experiments, traffic models, basics of queueing theory, and operational and mean value analysis
- Covers the techniques for validation and verification of simulation as well as random number generation, random variate generation, and testing with examples
- Features numerous examples and case studies, as well as exercises and problems for use as homework or programming assignments
Fundamentals of Performance Evaluation of Computer and Telecommunication Systems is an ideal textbook for graduate students in computer science, electrical engineering, computer engineering, and information sciences, technology, and systems. It is also an excellent reference for practicing engineers and scientists.
Table of Contents:
PREFACE xiii
1 INTRODUCTION AND BASIC CONCEPTS 1
1.1 Background 2
1.2 Performance Evaluation Viewpoints and Concepts 3
1.3 Goals of Performance Evaluation 5
1.4 Applications of Performance Evaluation 6
1.5 Techniques 7
1.6 Metrics of Performance 8
1.7 Workload Characterization and Benchmarking 10
1.8 Summary 18
2 PROBABILITY THEORY REVIEW 21
2.1 Basic Concepts on Probability Theory 22
2.2 Elementary Sampling 26
2.3 Random Variables 29
2.4 Sums of Variables 38
2.5 Regression Models 40
2.6 Important Density and Distribution Functions 47
2.7 Markov Processes 50
2.8 Limits 54
2.9 Comparing Systems using Sample Data 57
2.10 Summary 62
3 MEASUREMENT/TESTING TECHNIQUE 66
3.1 Measurement Strategies 66
3.2 Event Tracing 67
3.3 Monitors 70
3.4 Program Optimizers 73
3.5 Accounting Logs 74
3.6 Summary 75
4 BENCHMARKING AND CAPACITY PLANNING 78
4.1 Introduction 79
4.2 Types of Benchmark Programs 80
4.3 Benchmark Examples 83
4.4 Frequent Mistakes and Games in Benchmarking 96
4.5 Procedures of Capacity Planning and Related Main Problems 100
4.6 Capacity Planning for Web Services 102
4.7 Summary 108
5 DATA REPRESENTATION AND ADVANCED TOPICS ON VALIDATION MODELING 113
5.1 Data Representation 114
5.2 Measurements 118
5.3 Program Profiling and Outlining 123
5.4 State Machine Models 127
5.5 Petri Net-Based Modeling 135
5.6 Protocol Validation 143
5.7 Summary 147
6 BASICS OF QUEUEING THEORY 152
6.1 Queue Models 152
6.2 Queue Parameters 157
6.3 Little's Law 162
6.4 Priority Management 167
6.5 Analysis of M/M/1 Systems 170
6.6 The M/M/M Queue 176
6.7 Other Queues 177
6.8 Queueing Models with Insensitive Length Distribution 184
6.9 Summary 186
7 QUEUEING NETWORKS 190
7.1 Fundamentals of Queueing Networks 190\
7.2 Model Inputs and Outputs in Queueing Networks 195
7.3 Open Networks 198
7.4 Closed Queueing Networks 204
7.5 Product Form Networks 209
7.6 Mean Value Analysis 215
7.7 Analysis Using Flow Equivalent Servers 218
7.8 Summary 220
8 OPERATIONAL AND MEAN VALUE ANALYSIS 226
8.1 Operational Laws 226
8.2 Little's Formula 231
8.3 Bottleneck Analysis 236
8.4 Standard MVA 239
8.5 Approximation of MVA 244
8.6 Bounding Analysis 248
8.7 Case Study: A Circuit Switching System 255
8.8 Summary 259
9 INTRODUCTION TO SIMULATION TECHNIQUE 265
9.1 Introduction 265
9.2 Types of Simulation 275
9.3 Some Terminology 279
9.4 Random-Number-Generation Techniques 280
9.5 Survey of Commonly Used Random Number Generators 291
9.6 Seed Selection 292
9.7 Random Variate Generation 294
9.8 Testing of Random Number Sequences 299
9.9 Summary 307
10 COMMONLY USED DISTRIBUTIONS IN SIMULATION AND THEIR APPLICATIONS 312
10.1 Exponential Distribution 313
10.2 Poisson Distribution 315
10.3 Uniform Distribution 318
10.4 Normal Distribution 319
10.5 Weibull Distribution 326
10.6 Pareto Distribution 327
10.7 Geometric Distribution 330
10.8 Gamma distribution 331
10.9 Erlang Distribution 334
10.10 Beta Distribution 337
10.11 Binomial Distribution 338
10.12 Chi-Square Distribution 342
10.13 Student's t Distribution 345
10.14 Examples of Applications 346
10.15 Summary 349
11 ANALYSIS OF SIMULATION RESULTS 353
11.1 Introduction 353
11.2 Fundamental Approaches 355
11.3 Verification Techniques 358
11.4 Validation Techniques 362
11.5 Verification and Validation in Distributed Environments 365
11.6 Transient Elimination 369
11.7 Stopping Principles for Simulations 372
11.8 Accreditation 373
11.9 Summary 374
12 SIMULATION SOFTWARE AND CASE STUDIES 377
12.1 Introduction 378
12.2 Selection of Simulation Software 378
12.3 General-Purpose Programming Languages 379
12.4 Simulation Languages 381
12.5 Simulation Software Packages 398
12.6 Comparing Simulation Tools and Languages 417
12.7 Case Studies on Simulation of Computer and Telecommunication Systems 418
12.8 Summary 428
References 429
Exercises 432
APPENDIX A TABLE OF STANDARD NORMAL (Z) DISTRIBUTION 434
APPENDIX B COMMONLY USED NORMAL QUANTILES 436
APPENDIX C QUANTILES OF UNIT NORMAL DISTRIBUTION 437
APPENDIX D QUANTILES OF STUDENT'S T-DISTRIBUTION WITH V DEGREES OF FREEDOM 439
INDEX 441
About the Author :
Professor Mohammad S. Obaidat is an internationally well-known academic/researcher/scientist. He received his Ph.D. and M. S. degrees in Computer Engineering with a minor in Computer Science from the Ohio State University, Columbus, Ohio, USA. Dr. Obaidat is currently a tenured full Professor of Computer Science at Monmouth University, NJ, USA. Among his previous positions are Chair of the Department of Computer Science and Director of the Graduate Program at Monmouth University and a faculty member at the City University of New York. He has received extensive research funding and has published over two hundred and ten (210) refereed technical articles in refereed scholarly journals and proceedings of refereed international conferences. He is the co-author of the book entitled, "Wireless Networks" to be published by Wiley in August 2002.
Noureddine Boudriga is a professor at the School of Telecommunications at Catharge University in Tunis, Tunisia.