Expert Oracle Exadata - Parent Directory

CHAPTER 9 RECOVERING EXADATACellCLI> list griddisk where name = 'SCRATCH_CD_05_cell03';SCRATCH_CD_05_cell03 inactiveASM immediately notices the loss of the disk, takes it offline, and starts the disk repair timer. TheASM alert log (alert_+ASM2.log) shows that we have about 8.5 hours (30596/60/60) to bring the disk backonline before ASM permanently drops it from the disk group:alert_+ASM1.log--------------------Tue Dec 28 08:40:54 2010GMON checking disk modes for group 5 at 121 for pid 52, osid 29292Errors in file /u01/app/oracle/diag/asm/+asm/+ASM2/trace/+ASM2_gmon_5912.trc:ORA-27603: Cell storage I/O error, I/O failed on disk o/192.168.12.5/SCRATCH_CD_05_cell03 atoffset 4198400 for data length 4096ORA-27626: Exadata error: 201 (Generic I/O error)WARNING: Write Failed. group:5 disk:3 AU:1 offset:4096 size:4096...WARNING: Disk SCRATCH_DG_CD_05_CELL03 in mode 0x7f is now being offlinedWARNING: Disk SCRATCH_DG_CD_05_CELL03 in mode 0x7f is now being taken offline...Tue Dec 28 08:43:21 2010WARNING: Disk (SCRATCH_DG_CD_05_CELL03) will be dropped in: (30596) secs on ASM inst: (2)Tue Dec 28 08:43:23 2010The status of the disk in ASM can be seen using the following query from one of the ASM instances.Notice that the SCRATCH disk group is still mounted (online):SYS:+ASM2> select dg.name, d.name, dg.state, d.mount_status, d.header_status, d.statefrom v$asm_disk d,v$asm_diskgroup dgwhere dg.name = 'SCRATCH_DG'and dg.group_number = d.group_numberorder by 1,2;NAME NAME STATE MOUNT_S HEADER_STATU STATE------------- ---------------------------- ---------- ------- ------------ ----------SCRATCH SCRATCH_DG_CD_05_CELL01 MOUNTED CACHED MEMBER NORMALSCRATCH SCRATCH_DG_CD_05_CELL02 MOUNTED CACHED MEMBER NORMALSCRATCH SCRATCH_DG_CD_05_CELL03 MOUNTED MISSING UNKNOWN NORMALWhile the disk is offline, ASM continues to poll its status to see if the disk is available. We see thefollowing query repeating in the ASM alert log:alert_+ASM1.log--------------------WARNING: Exadata Auto Management: OS PID: 5918 Operation ID: 3015: in diskgroup FailedSQL : /* Exadata Auto Mgmt: Select disks in DG that are not ONLINE. */select name from v$asm_disk_statwheremode_status='OFFLINE'andgroup_number in(select group_number from v$asm_diskgroup_stat308