Tuesday, September 16, 2014

Bring ASM disk back online after transient failure (with feature Oracle ASM Fast Mirror Resync)

Messages in the ASM alert log:

2014-09-16 22:05:59.529000 +08:00
WARNING: Disk 2 (LODG_0002) in group 2 will be dropped in: (12777) secs on ASM inst 1
2014-09-16 22:09:02.620000 +08:00
WARNING: Disk 2 (LODG_0002) in group 2 will be dropped in: (12594) secs on ASM inst 1
2014-09-16 22:12:05.702000 +08:00
WARNING: Disk 2 (LODG_0002) in group 2 will be dropped in: (12410) secs on ASM inst 1
2014-09-16 22:15:08.793000 +08:00
WARNING: Disk 2 (LODG_0002) in group 2 will be dropped in: (12227) secs on ASM inst 1

How to bring it back:

SQL> select name,header_status,mount_status,path from v$asm_disk;

NAME            HEADER_STATU MOUNT_S PATH
--------------- ------------ ------- ----------------------------------------
                MEMBER       CLOSED  /dev/raw/raw1
LODG_0002       UNKNOWN      MISSING
VOL12G          MEMBER       CACHED  ORCL:VOL12G
VOL4G           MEMBER       CACHED  ORCL:VOL4G
LODG_0001       MEMBER       CACHED  /dev/raw/raw2

SQL> alter diskgroup lodg online disk 'LODG_0002';

Diskgroup altered.

SQL> select name,header_status,mount_status,path from v$asm_disk;

NAME            HEADER_STATU MOUNT_S PATH
--------------- ------------ ------- ----------------------------------------
VOL12G          MEMBER       CACHED  ORCL:VOL12G
VOL4G           MEMBER       CACHED  ORCL:VOL4G
LODG_0001       MEMBER       CACHED  /dev/raw/raw2
LODG_0002       MEMBER       CACHED  /dev/raw/raw1

Alternatively, you could run “alter diskgroup lodg online all;”

 

Message you are expecting from ASM alert log:

SQL> alter diskgroup lodg online disk 'LODG_0002'
NOTE: initiating online disk group 2 disks
LODG_0002 (2)
NOTE: process _s000_+asm (5843) initiating offline of disk 2.3915946016 (LODG_0002) with mask 0x7e in group 2
NOTE: sending set offline flag message 1439557556 to 1 disk(s) in group 2
WARNING: Disk LODG_0002 in mode 0x1 is now being offlined
NOTE: initiating PST update: grp = 2, dsk = 2/0xe9689820, mask = 0x6a, op = clear
GMON updating disk modes for group 2 at 36 for pid 23, osid 5843
NOTE: cache closing disk 2 of grp 2: (not open) LODG_0002
NOTE: PST update grp = 2 completed successfully
NOTE: initiating PST update: grp = 2, dsk = 2/0xe9689820, mask = 0x7e, op = clear
GMON updating disk modes for group 2 at 37 for pid 23, osid 5843
NOTE: cache closing disk 2 of grp 2: (not open) LODG_0002
NOTE: PST update grp = 2 completed successfully
NOTE: requesting all-instance membership refresh for group=2
2014-09-16 22:16:58.772000 +08:00
NOTE: F1X0 copy 2 relocating from 2:2 to 2:4294967294 for diskgroup 2 (LODG)
NOTE: initiating PST update: grp = 2, dsk = 2/0x0, mask = 0x11, op = assign
GMON updating disk modes for group 2 at 38 for pid 23, osid 5843
NOTE: cache closing disk 2 of grp 2: (not open) LODG_0002
NOTE: group LODG: updated PST location: disk 0001 (PST copy 0)
NOTE: PST update grp = 2 completed successfully
NOTE: requesting all-instance disk validation for group=2
NOTE: disk validation pending for group 2/0xeff868ea (LODG)
2014-09-16 22:17:01.835000 +08:00
NOTE: Found /dev/raw/raw1 for disk LODG_0002
WARNING: ignoring disk  in deep discovery
SUCCESS: validated disks for 2/0xeff868ea (LODG)
GMON querying group 2 at 39 for pid 23, osid 5843
NOTE: initiating PST update: grp = 2, dsk = 2/0x0, mask = 0x19, op = assign
GMON updating disk modes for group 2 at 40 for pid 23, osid 5843
NOTE: group LODG: updated PST location: disk 0001 (PST copy 0)
NOTE: group LODG: updated PST location: disk 0002 (PST copy 1)
NOTE: PST update grp = 2 completed successfully
NOTE: membership refresh pending for group 2/0xeff868ea (LODG)
2014-09-16 22:17:04.845000 +08:00
GMON querying group 2 at 41 for pid 13, osid 1845
NOTE: cache opening disk 2 of grp 2: LODG_0002 path:/dev/raw/raw1
SUCCESS: refreshed membership for 2/0xeff868ea (LODG)
NOTE: initiating PST update: grp = 2, dsk = 2/0x0, mask = 0x5d, op = assign
SUCCESS: alter diskgroup lodg online disk 'LODG_0002'
GMON updating disk modes for group 2 at 42 for pid 23, osid 5843
NOTE: group LODG: updated PST location: disk 0001 (PST copy 0)
NOTE: group LODG: updated PST location: disk 0002 (PST copy 1)
NOTE: PST update grp = 2 completed successfully
NOTE: initiating PST update: grp = 2, dsk = 2/0x0, mask = 0x7d, op = assign
GMON updating disk modes for group 2 at 43 for pid 23, osid 5843
NOTE: group LODG: updated PST location: disk 0001 (PST copy 0)
NOTE: group LODG: updated PST location: disk 0002 (PST copy 1)
NOTE: PST update grp = 2 completed successfully
NOTE: Voting File refresh pending for group 2/0xeff868ea (LODG)
NOTE: F1X0 copy 2 relocating from 2:4294967294 to 2:2 for diskgroup 2 (LODG)
2014-09-16 22:17:07.856000 +08:00
NOTE: Attempting voting file refresh on diskgroup LODG