UNICOS/mpTM Disks and File Systems Administration


Table of Contents
Preface
Accessing Cray Documentation
Error Message Explanations
Typographical Conventions
Ordering Documentation
Reader Comments
1. Introduction
1.1. UNICOS/mp System Administration Publications
1.2. Related Publications
2. Cray X1 Disk Storage Architecture
2.1. Disk Concepts
2.1.1. Disk Partitions
2.1.2. Partition Types
2.1.3. Volume Headers
2.1.4. Device files
2.2. RAID Subsystem on Cray X1 Systems
2.2.1. Disk Chassis Physical Layout
2.2.2. CRAYSM Hardware Notation
2.2.3. C-brick
2.2.4. S-brick
2.2.5. RAID Groups and RAID Group Layouts
2.2.6. RAID Volume (RV) or Logical Unit Number (LUN)
3. Administering the RAID Subsystem
3.1. Adding a New RAID Subsystem
3.2. Installing a New RAID Subsystem
3.3. Configuring the Storage of a RAID Subsystem
3.3.1. CRAYSM Software
3.3.2. Using CRAYSM for RAID Subsystem Configuration
3.3.3. Configuring a New C-brick
3.3.4. Adding S-bricks
3.4. Deleting RAID Subsystem Configurations
3.5. Upgrading Firmware (ucode)
3.6. Additional Disk Administration
3.6.1. Listing the Disks on a System with hinv
3.6.2. Displaying a Disk's Partitions with parts
3.6.3. Repartitioning a Disk with parts
3.6.4. Displaying Alternate Paths to LUNs
4. XLV Logical Volume Concepts
4.1. Introduction to XLV Logical Volumes
4.2. Composition of XLV Logical Volumes
4.2.1. Volumes
4.2.2. Subvolumes
4.2.3. Plexes
4.2.4. Volume Elements
4.3. XLV Logical Volume Names
4.4. XLV Daemons
4.5. XLV Error Policy
4.6. XLV Logical Volume Planning
4.6.1. When to Avoid Using XLV
4.6.2. Selecting Subvolumes
4.6.3. Choosing Whether to Plex
4.6.4. Choosing Whether to Stripe
4.6.5. Choosing Whether to Concatenate Disk Partitions
5. Creating and Administering XLV Logical Volumes
5.1. Creating Volume Objects with xlv_make
5.1.1. Example 1: Creating a Simple XLV Logical Volume
5.1.2. Example 2: Creating a Striped, Plexed XLV Logical Volume
5.1.3. Example 3: Creating a Plexed XLV Logical Volume for an XFS File System with an External Log
5.2. Displaying XLV Logical Volume Objects
5.3. Adding a Volume Element to a Plex (Growing an XLV Logical Volume)
5.4. Adding a Plex to an XLV Logical Volume
5.5. Detaching a Plex from an XLV Logical Volume
5.6. Deleting an XLV Object
5.7. Removing and Mounting a Plex
5.8. Replacing a Disk for a Plexed Volume
5.8.1. Remove the Volume Element from XLV
5.9. Creating a Record of XLV Logical Volume Configurations
6. Planning and Creating File Systems
6.1. Introduction to UNICOS/mp File Systems
6.1.1. File System Overview
6.1.2. File System Types
6.1.3. File System Strategies
6.2. UNICOS/mp Directory Organization
6.3. General File System Concepts
6.3.1. Inodes
6.3.2. Types of Files
6.3.3. Hard Links and Symbolic Links
6.3.4. File System Names
6.4. Supported File Systems
6.4.1. XFS File Systems
6.4.2. Network File Systems (NFS)
6.4.3. Cache File Systems (CacheFS)
6.4.4. /proc File Systems
6.4.5. /hw File Systems
6.5. Planning an XFS File System
6.5.1. Choosing the File System Block Size and Extent Size
6.5.2. Choosing the File System Directory Format and Directory Block Size
6.5.3. Choosing the Log Type and Size
6.5.4. Choosing Allocation Groups and Stripe Units
6.5.5. Disk Repartitioning
6.6. Making an XFS File System
7. Maintaining XFS File Systems
7.1. Performing Routine File System Administration Tasks
7.2. Mounting and Unmounting File Systems
7.2.1. Manually Mounting File Systems
7.2.2. Mounting File Systems Automatically With the /etc/fstab File
7.2.3. Mounting a Remote File System Automatically
7.2.4. Unmounting File Systems
7.3. Managing Disk Space
7.3.1. Monitoring Free Space and Free Inodes
7.3.2. Monitoring Key Files and Directories
7.3.3. Cleaning Out Temporary Directories
7.3.4. Locating Unused Files
7.3.5. Identifying Accounts That Use Large Amounts of Disk Space
7.3.6. Running Out of Space in the Root File System
7.3.7. (Deferred implementation) Using Disk Quotas
7.4. Adding File System Space
7.4.1. Mounting a File System as a Subdirectory
7.4.2. “Stealing” Space From Another File System
7.4.3. Growing an XFS file system Onto Another Disk
7.5. Copying XFS File Systems with xfs_copy
7.6. Checking XFS File System Consistency with xfs_check and xfs_repair
7.6.1. Checking File System Consistency
7.6.2. Repairing Inconsistent File Systems
7.7. Repairing XFS File System Problems
7.7.1. Common Error Messages
7.7.2. Error Messages When Files Are in lost+found
7.7.3. What to Do If xfs_repair Cannot Repair a File System
7.7.4. Mounting A File System without Log Recovery
7.8. Running xfs_repair on the Root File System
7.9. (Deferred implementation) Reorganizing File Systems
7.10. Avoiding File System Corruption
8. Troubleshooting the RAID Subsystem
8.1. RAID Log Files, Status, and Reports
8.2. Using SMgui
8.2.1. Using SMgui to Monitor for Errors
8.2.2. Using SMgui to Fix Errors
8.2.3. Cache Battery
8.3. Repairing the FailOver of a LUN
8.4. Controlling E-mail Notification of Critical Events
Glossary
Index
List of Tables
2-1. Standard Partition Numbers, Names, and Functions
2-2. Partition Types and Uses
2-3. RAID Subsystem Hardware Location Naming in CRAYSM
3-1. Device Name Construction
6-1. Standard Directories and Their Contents
6-2. Types of Files
7-1. Forms of the umount Command
7-2. Files and Directories That Tend to Grow
List of Figures
2-1. Example of Disk Storage Architecture (4 Channels) for Cray X1 Systems
2-2. Example of Disk Storage Architecture (8 Channels) for Cray X1 Systems
2-3. RAID Subsystem Logical Overview
2-4. PC-20 Physical Layout of a RAID Subsystem
2-5. RAID Disks (logical view)
4-1. Plexed Subvolume Example
7-1. Mounting a File System
List of Examples
3-1. Example RAID Subsystem Configuration in cray.cfg
3-2. Adding a C-brick
3-3. Configuring an S-brick
3-4. Adding a LUN to a RAID group of an S-brick
3-5. Creating Full-capacity LUNs
6-1. mkfs Command for an XFS File System Using Defaults
6-2. mkfs Command for an XFS File System with an Internal Log
6-3. mkfs Command for an XFS File System with an External Log
6-4. mkfs Command for an XFS File System Specifying Directory Block Size