UPC Distributed Shared Memory Programming

This is the first book to explain the language Unified Parallel C and its use. Authors El-Ghazawi, Carlson, and Sterling are among the developers of UPC, with close links with the industrial members of the UPC consortium. Their text covers background material on parallel architectures and algorithms, and includes UPC programming case studies. This book represents an invaluable resource for the growing number of UPC users and applications developers. More information about UPC can be found at: http://upc.gwu.edu/ An Instructor Support FTP site is available from the Wiley editorial department.

TAREK EL-GHAZAWI, PHD, is Professor, Electrical and Computer Engineering Department, The George Washington University. His research interests include high-performance computing, computer architecture, reconfigurable computing, embedded systems, and experimental performance.

WILLIAM CARLSON, PHD, is affiliated with the IDA Center for Computing Sciences. His research interests include performance evaluation of advanced computer architectures, operating systems, languages, and computers for parallel and distributed systems.

THOMAS STERLING, PHD, is a professor at Caltech and its Jet Propulsion Laboratory. His research interests include parallel computing architecture, cluster computing, petaflop computing, and systems software and evaluation.

KATHERINE YELICK, PHD, is Professor of Computer Science, University of California, Berkeley. Her research interests include parallel computing, memory hierarchy optimizations, programming languages, and compilers.

Preface

vii

1. Introductory Tutorial

1

(16)

1.1 Getting Started

1

(2)

1.2 Private and Shared Data

3

(3)

1.3 Shared Arrays and Affinity of Shared Data

6

(2)

1.4 Synchronization and Memory Consistency

8

(2)

1.5 Work Sharing

10

(1)

1.6 UPC Pointers

11

(3)

1.7 Summary

14

(1)

Exercises

14

(3)

2. Programming View and UPC Data Types

17

(16)

2.1 Programming Models

17

(3)

2.2 UPC Programming Model

20

(1)

2.3 Shared and Private Variables

21

(2)

2.4 Shared and Private Arrays

23

(2)

2.5 Blocked Shared Arrays

25

(5)

2.6 Compiling Environments and Shared Arrays

30

(1)

2.7 Summary

30

(1)

Exercises

31

(2)

3. Pointers and Arrays

33

(16)

3.1 UPC Pointers

33

(2)

3.2 Pointer Arithmetic

35

(3)

3.3 Pointer Casting and Usage Practices

38

(2)

3.4 Pointer Information and Manipulation Functions

40

(3)

3.5 More Pointer Examples

43

(4)

3.6 Summary

47

(1)

Exercises

47

(2)

4. Work Sharing and Domain Decomposition

49

(24)

4.1 Basic Work Distribution

50

(1)

4.2 Parallel Iterations

51

(3)

4.3 Multidimensional Data

54

(8)

4.4 Distributing Trees

62

(9)

4.5 Summary

71

(1)

Exercises

71

(2)

5. Dynamic Shared Memory Allocation

73

(18)

5.1 Allocating a Global Shared Memory Space Collectively

73

(5)

5.2 Allocating Multiple Global Spaces

78

(4)

5.3 Allocating Local Shared Spaces

82

(7)

5.4 Freeing Allocated Spaces

89

(1)

5.5 Summary

90

(1)

Exercises

90

(1)

6. Synchronization and Memory Consistency

91

(24)

6.1 Barriers

92

(2)

6.2 Split-Phase Barriers

94

(5)

6.3 Locks

99

(9)

6.4 Memory Consistency

108

(5)

6.5 Summary

113

(1)

Exercises

114

(1)

7. Performance Tuning and Optimization

115

(22)

7.1 Parallel System Architectures

116

(4)

7.2 Performance Issues in Parallel Programming

120

(2)

7.3 Role of Compilers and Run-Time Systems

122

(1)

7.4 UPC Hand Optimization

123

(5)

7.5 Case Studies

128

(7)

7.6 Summary

135

(1)

Exercises

135

(2)

8. UPC Libraries

137

(12)

8.1 UPC Collective Library

137

(4)

8.2 UPC-IO Library

141

(5)

8.3 Summary

146

(1)

References

147

(2)

Appendix A: UPC Language Specifications, vl.1.1

149

(34)

Appendix B: UPC Collective Operations Specifications, v1.0

183

(20)

Appendix C: UPC-IO Specifications, v1.0

203

(40)

Appendix D: How to Compile and Run UPC Programs

243

(2)

Appendix E: Quick UPC Reference

245

(6)

Index

251

What is included with this book?

The New copy of this book will include any supplemental materials advertised. Please check the title of the book to determine if it should include any access cards, study guides, lab manuals, CDs, etc.

The Used, Rental and eBook copies of this book are not guaranteed to include any supplemental materials. Typically, only the book itself is included. This is true even if the title states it includes any access cards, study guides, lab manuals, CDs, etc.

FREE SHIPPING

Amazon no longer offers textbook rentals. We do!

UPC Distributed Shared Memory Programming

Summary

Author Biography

Table of Contents

Supplemental Materials