Expert Hadoop Administration Managing, Tuning, and Securing Spark, YARN, and HDFS

The Comprehensive, Up-to-Date Apache Hadoop Administration Handbook and Reference

“Sam Alapati has worked with production Hadoop clusters for six years. His unique depth of experience has enabled him to write the go-to resource for all administrators looking to spec, size, expand, and secure production Hadoop clusters of any size.”

–Paul Dix, Series Editor

In Expert Hadoop® Administration, leading Hadoop administrator Sam R. Alapati brings together authoritative knowledge for creating, configuring, securing, managing, and optimizing production Hadoop clusters in any environment. Drawing on his experience with large-scale Hadoop administration, Alapati integrates action-oriented advice with carefully researched explanations of both problems and solutions. He covers an unmatched range of topics and offers an unparalleled collection of realistic examples.

Alapati demystifies complex Hadoop environments, helping you understand exactly what happens behind the scenes when you administer your cluster. You’ll gain unprecedented insight as you walk through building clusters from scratch and configuring high availability, performance, security, encryption, and other key attributes. The high-value administration skills you learn here will be indispensable no matter what Hadoop distribution you use or what Hadoop applications you run.

• Understand Hadoop’s architecture from an administrator’s standpoint
• Create simple and fully distributed clusters
• Run MapReduce and Spark applications in a Hadoop cluster
• Manage and protect Hadoop data and high availability
• Work with HDFS commands, file permissions, and storage management
• Move data, and use YARN to allocate resources and schedule jobs
• Manage job workflows with Oozie and Hue
• Secure, monitor, log, and optimize Hadoop
• Benchmark and troubleshoot Hadoop

Part 1: Introduction to Hadoop 2 - Architecture, Hadoop Clusters and Application Frameworks
1. Introduction to Hadoop 2 and its Architecture
2. Creating and Configuring a Simple Hadoop 2 Cluster
3. Planning for and Creating a Fully-Distributed Cluster
4. Running Applications in a Cluster the MapReduce Framework (and Pig, Hive)
5. Running Applications in a Cluster the Spark Framework on Hadoop

Part II: Managing and Protecting Hadoop Data and High Availability
6. The Role of the NameNode and how HDFS Works
7. HDFS Commands, File Permissions and HDFS Storage Management
8. Data Protection, Compression and Hadoop Data Formats
9. NameNode Operations and High Availability

Part III: Moving Data, Allocating Resources and Scheduling Jobs
10. Moving Data into and out of Hadoop
11. YARN and Resource Allocation in a Hadoop Cluster
12 Working with Oozie and Hue to Manage Job Workflows

Part IV: Security, Monitoring, Optimization and Troubleshooting
13. Securing Hadoop
14. Monitoring and Logging
15. Managing YARN Jobs and Performing Common Management Tasks
16. Benchmarking and Optimization
17. Troubleshooting Hadoop 2

Appendix. Installing the Virtual Environment for Hadoop 2

The New copy of this book will include any supplemental materials advertised. Please check the title of the book to determine if it should include any access cards, study guides, lab manuals, CDs, etc.

The Used, Rental and eBook copies of this book are not guaranteed to include any supplemental materials. Typically, only the book itself is included. This is true even if the title states it includes any access cards, study guides, lab manuals, CDs, etc.