Scientific Data Management: Challenges, Technology, and Deployment

The task of managing scientific data is so overwhelming that scientists spend much of their time managing the data by developing special purpose solutions, rather than using their time effectively for scientific investigation and discovery. This book summarizes state-of-the-art scientific data management technologies that address this problem area. It covers efficient access to storage systems, efficient data movement and management of storage spaces, effectively performing complex data analysis and searches over large data sets, and the automation of multistep scientific processes.