GPFS -- Add/Remvoe additional disks into


#vi adddisk_fm1.txt
#DiskName:serverlist::DiskUsage:FailureGroup:DesiredName:StoragePool
/dev/hdisk5:::dataAndMetadata::nsd6:
/dev/hdisk6:::dataAndMetadata::nsd7:
"adddisk_fm1.txt" 3 lines, 143 characters

# mmcrnsd -F  adddisk_fm1.txt
mmcrnsd: Processing disk hdisk5
mmcrnsd: Processing disk hdisk6
mmcrnsd: 6027-1371 Propagating the cluster configuration data to all
  affected nodes.  This is an asynchronous process.

# mmlsnsd

 File system   Disk name    NSD servers                                   
---------------------------------------------------------------------------
 ftm1data      mynsd1       (directly attached)     
 ftm2data      mynsd2       (directly attached)     
 ftm3data      mynsd3       (directly attached)     
 ftm4data      mynsd4       (directly attached)     
 ftm5data      mynsd5       (directly attached)     
 (free disk)   nsd6         (directly attached)     
 (free disk)   nsd7         (directly attached)     

# mmadddisk ftm1data -F adddisk_fm1.txt

GPFS: 6027-531 The following disks of ftm1data will be formatted on node p880lp1:
    nsd6: size 204800 MB
    nsd7: size 204800 MB
Extending Allocation Map
Checking Allocation Map for storage pool system
GPFS: 6027-1503 Completed adding disks to file system ftm1data.
mmadddisk: 6027-1371 Propagating the cluster configuration data to all
  affected nodes.  This is an asynchronous process.
# mmdf ftm1data
disk                disk size  failure holds    holds              free KB             free KB
name                    in KB    group metadata data        in full blocks        in fragments
--------------- ------------- -------- -------- ----- -------------------- -------------------
Disks in storage pool: system (Maximum disk size allowed is 1.6 TB)
mynsd1              209715200       -1 yes      yes       208480768 ( 99%)          3928 ( 0%)
nsd6                209715200       -1 yes      yes       209649152 (100%)           376 ( 0%)
nsd7                209715200       -1 yes      yes       209649152 (100%)           376 ( 0%)
                -------------                         -------------------- -------------------
(pool total)        629145600                             627779072 (100%)          4680 ( 0%)

                =============                         ==================== ===================
(total)             629145600                             627779072 (100%)          4680 ( 0%)

Inode Information
-----------------
Number of used inodes:            4939
Number of free inodes:          199925
Number of allocated inodes:     204864
Maximum number of inodes:     17476288
# mmchdisk gpfs suspend -d "nsd6;nsd7"
mmchdisk: 6027-1388 File system gpfs is not known to the GPFS cluster.
mmchdisk: 6027-1639 Command failed. Examine previous error messages to determine cause.
# mmchdisk ftm1data suspend -d "nsd6;nsd7"
GPFS: 6027-000 Attention: A disk being removed reduces the number of failure groups to 1,
           which is below the number required for replication: 2.
           New blocks will be allocated from the remaining disks,
           but files will be unreplicated and hence at risk.

 # mmrestripefs ftm1data -b
GPFS: 6027-589 Scanning file system metadata, phase 1 ...
GPFS: 6027-552 Scan completed successfully.
GPFS: 6027-589 Scanning file system metadata, phase 2 ...
GPFS: 6027-552 Scan completed successfully.
GPFS: 6027-589 Scanning file system metadata, phase 3 ...
GPFS: 6027-552 Scan completed successfully.
GPFS: 6027-589 Scanning file system metadata, phase 4 ...
GPFS: 6027-552 Scan completed successfully.
GPFS: 6027-565 Scanning user file metadata ...
 100.00 % complete on Wed Nov 30 11:17:20 2016  (    204864 inodes with total       1136 MB data processed)
GPFS: 6027-552 Scan completed successfully.

# mmdf ftm1data
disk                disk size  failure holds    holds              free KB             free KB
name                    in KB    group metadata data        in full blocks        in fragments
--------------- ------------- -------- -------- ----- -------------------- -------------------
Disks in storage pool: system (Maximum disk size allowed is 1.6 TB)
mynsd1              209715200       -1 yes      yes       209256192 (100%)          5056 ( 0%)
mynsd6              209715200       -1 yes      yes       209259008 (100%)           712 ( 0%)
mynsd7              209715200       -1 yes      yes       209262080 (100%)          1224 ( 0%)
                -------------                         -------------------- -------------------
(pool total)        629145600                             627777280 (100%)          6992 ( 0%)

                =============                         ==================== ===================
(total)             629145600                             627777280 (100%)          6992 ( 0%)

Inode Information
-----------------
Number of used inodes:            4939
Number of free inodes:          199925
Number of allocated inodes:     204864
Maximum number of inodes:     17476288

Then I found the name is inconstancy.  So now I need to remove both disks


# mmdf ftm1data
disk                disk size  failure holds    holds              free KB             free KB
name                    in KB    group metadata data        in full blocks        in fragments
--------------- ------------- -------- -------- ----- -------------------- -------------------
Disks in storage pool: system (Maximum disk size allowed is 1.6 TB)
mynsd1              209715200       -1 yes      yes       208480768 ( 99%)          3928 ( 0%)
nsd6                209715200       -1 yes      yes       209649152 (100%)           376 ( 0%) *
nsd7                209715200       -1 yes      yes       209649152 (100%)           376 ( 0%) *
                -------------                         -------------------- -------------------
(pool total)        209715200                             208480768 ( 99%)          3928 ( 0%)

                =============                         ==================== ===================
(total)             209715200                             208480768 ( 99%)          3928 ( 0%)

Inode Information
-----------------
Number of used inodes:            4939
Number of free inodes:          199925
Number of allocated inodes:     204864
Maximum number of inodes:     17476288
# mmrestripefs ftm1data -b
GPFS: 6027-589 Scanning file system metadata, phase 1 ...
GPFS: 6027-552 Scan completed successfully.
GPFS: 6027-589 Scanning file system metadata, phase 2 ...
GPFS: 6027-552 Scan completed successfully.
GPFS: 6027-589 Scanning file system metadata, phase 3 ...
GPFS: 6027-552 Scan completed successfully.
GPFS: 6027-589 Scanning file system metadata, phase 4 ...
GPFS: 6027-552 Scan completed successfully.
GPFS: 6027-565 Scanning user file metadata ...
 100.00 % complete on Wed Nov 30 10:40:37 2016  (    204864 inodes with total       1136 MB data processed)
GPFS: 6027-552 Scan completed successfully.
# mmdeldisk ftm1data "nsd6;nsd7"
Deleting disks ...
Checking Allocation Map for storage pool system
GPFS: 6027-370 tsdeldisk completed.
mmdeldisk: 6027-1371 Propagating the cluster configuration data to all
  affected nodes.  This is an asynchronous process.

# mmdf ftm1data
disk                disk size  failure holds    holds              free KB             free KB
name                    in KB    group metadata data        in full blocks        in fragments
--------------- ------------- -------- -------- ----- -------------------- -------------------
Disks in storage pool: system (Maximum disk size allowed is 1.6 TB)
mynsd1              209715200       -1 yes      yes       208481792 ( 99%)          3424 ( 0%)
                -------------                         -------------------- -------------------
(pool total)        209715200                             208481792 ( 99%)          3424 ( 0%)

                =============                         ==================== ===================
(total)             209715200                             208481792 ( 99%)          3424 ( 0%)

Inode Information
-----------------
Number of used inodes:            4939
Number of free inodes:          199925
Number of allocated inodes:     204864
Maximum number of inodes:     17476288
# mmlsnsd

 File system   Disk name    NSD servers                                   
---------------------------------------------------------------------------
 ftm1data      mynsd1       (directly attached)     
 ftm2data      mynsd2       (directly attached)     
 ftm3data      mynsd3       (directly attached)     
 ftm4data      mynsd4       (directly attached)     
 ftm5data      mynsd5       (directly attached)     
 (free disk)   nsd6         (directly attached)     
 (free disk)   nsd7         (directly attached)     

# mmdelnsd "nsd6;nsd7"
mmdelnsd: Processing disk nsd6
mmdelnsd: Processing disk nsd7
mmdelnsd: 6027-1371 Propagating the cluster configuration data to all
  affected nodes.  This is an asynchronous process.
# mmlsnsd

 File system   Disk name    NSD servers                                   
---------------------------------------------------------------------------
 ftm1data      mynsd1       (directly attached)     
 ftm2data      mynsd2       (directly attached)     
 ftm3data      mynsd3       (directly attached)     
 ftm4data      mynsd4       (directly attached)     
 ftm5data      mynsd5       (directly attached)     

#

Comments

Post a Comment

Popular posts from this blog

VIOS TIPs

HMC image locates: /extra/viosimages/2.2.3.4 To install VIO server from HMC: installios To erase the previous setting: installios -u hscroot@P7504HMC:~> cat /etc/nimol.conf # nimol.conf file NIMOL_SERVER 9.22.217.30 ORIGINAL_FILES_DIR /var/tmp/nimol_original RPCBIND_STARTED yes NFS_STARTED yes REMOTE_ACCESS_METHOD /usr/bin/rsh NIMOL_TFTPBOOT /tftpboot TFTP_ENABLED yes REMOTE_SYSLOG_ENABLED yes HMC_SYSLOG_CONF_MODIFIED yes NIMOL_SYSLOG_FACILITY local2 NIMOL_SUBNET 9.22.217.0 NIMOL_BOOTREPLYD yes LABEL default1 /extra/default1 processing hscroot@P7504HMC:~>  installios -F -e -R default1 Logging session output to /tmp/installios.24173.log. nimol_config WARNING: error from command /bin/awk nimol_config MESSAGE: Executed /usr/sbin/exportfs -ua. nimol_config MESSAGE: Executed /usr/sbin/exportfs -a. nimol_config MESSAGE: Removed /tftpboot/default1.chrp.mp.ent. nimol_config MESSAGE: Removed /extra/default1. nimol_config MESSAGE: Removed "LABEL def...
Read more

Configure Solaris 10 LDOM on Solaris 11.4

root@comglv1:~# ldm add-memory 16G htcsun1 root@comglv1: # zfs destroy zones cannot destroy 'zones': operation does not apply to pools use 'zfs destroy -r zones' to destroy all datasets in the pool use 'zpool destroy zones' to destroy the pool itself root@comglv1: # zfs destroy -r zones root@comglv1: # zpool create LDOM mirror c0t5000CCA03C0E89D8d0s0 c0t5000CCA03C2F3BB4d0s0 root@comglv1: # zfs create LDOM/htcsun1 root@comglv1: # zfs create -V 150g LDOM/htcsun1/disk0 root@comglv1: # ldm rm-vdisk vdisk0 htcsun1 root@comglv1: # ldm rm-vdsdev htcsun1-vd0@primary-vds0 root@comglv1: # ldm rm-vdsdev  vol0@primary-vds0 root@comglv1: # ldm rm-vdsdev iso@primary-vds0 root@comglv1: # add-vdsdev options=ro sol-10-u11-ga-sparc-dvd.iso htcsun1-iso@primary-vds0 root@comglv1: # ldm add-vdsdev /dev/zvol/dsk/LDOM/htcsun1/disk0 htcsun1-vd0@primary-vds0 root@comglv1: # ldm add-vdisk vdisk0 htcsun1-vd0@primary-vds0 htcsun1...
Read more

HA in Linux is pretty easy

NOTICE: -- Very important: Please do NOT FAT FINGER. Check your IP address/hostname correct first before configuring PCS. If any service(s) do(es) not startup correctly, please check the service log under /var/log/cluster or /var/log/pcsd. systemctl -xe does not help at all 1> Install PCS  yum isntall pcs -y 2>  Configure PCS. Please run the following commands on ALL nodes: systemctl start pcsd systemctl enable pcsd passwd hacluster 3> Configure PCS, Run he following commands on ONE node: pcs cluster auth <NODE-1> <NODE-2> <...> pcs cluster setup --name <CLUSTER_NAME> <NODE-1> <NODE-2> <...> pcs cluster start --all pcs cluster enable --all pcs resource create virtual_ip ocf:heartbeat:IPaddr2 ip=<IP_ADDR> cidr_netmask=32 op monitor interval=30s pcs resource create <APPLICATION_MON> ocf:heartbeat:nginx configfile=/etc/nginx/nginx.conf op monitor timeout="5s" interval="5s"  ...
Read more