ORA-15041 – Restore Failed

I had to create a second standby(Standby-2). I took the backup to an NFS disk on Standby-1 and tried to restore it on the Standby-2.
The database size was only 4TB. Both are exadata machines, but eventually my restore failed.

ORA-19504: failed to create file "+DATA"
ORA-17502: ksfdcre:4 Failed to create file +DATA
ORA-15041: diskgroup "DATA" space exhausted
I checked the diskgrup +DATA
SQL> select NAME,TOTAL_MB,FREE_MB,REQUIRED_MIRROR_FREE_MB,USABLE_FILE_MB from   v$asm_diskgroup;

NAME         TOTAL_MB    FREE_MB REQUIRED_MIRROR_FREE_MB USABLE_FILE_MB
---------- ---------- ---------- ----------------------- --------------
DATA         11137536     753888                 3016416        -754176  
DBFS_DG       1192960    1191600                  298240         446680
RECO         14848512   14847768                 3712128        5567820

ASMCMD> lsdg
State    Type    Rebal  Sector  Block       AU  Total_MB   Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name
MOUNTED  HIGH    N         512   4096  4194304  11137536    753888          3016416         -754176              0             N  DATA/
MOUNTED  NORMAL  N         512   4096  4194304   1192960   1191600           298240          446680              0             Y  DBFS_DG/
MOUNTED  NORMAL  N         512   4096  4194304  14848512  14847768          3712128         5567820              0             N  RECO/

The usable_file_mb was running on -ve.

I checked the same on the Standby-1 and there was a huge difference:

SQL> select NAME,TOTAL_MB,FREE_MB,REQUIRED_MIRROR_FREE_MB,USABLE_FILE_MB from   v$asm_diskgroup;

NAME         TOTAL_MB    FREE_MB REQUIRED_MIRROR_FREE_MB USABLE_FILE_MB
---------- ---------- ---------- ----------------------- --------------
DATA_ACS4    44126208   29030664                 2451456        8859736
DBFS_DG       1038240    1036984                  346080         345452
RECO_ACS4    57622464   36066904                19207488        8429708

I logged into the corresponding cell servers and to my surprise the physical disks in Standby-2 were of High Performace Disks (600 GB), where as in Standby-1 they were of High Capacity ( 3 TB).

Standby-2:
CellCLI> list celldisk attributes name,diskType,physicalDisk,size;
         CD_00_x2111         HardDisk        KV05LL          528.734375G
         CD_01_x2111         HardDisk        KV04EL          528.734375G
         CD_02_x2111         HardDisk        KV025L          557.859375G


Standby-1:
CellCLI> list celldisk attributes name,diskType,physicalDisk,size;
         CD_00_ac12         HardDisk        RJ73XG          2760.15625G
         CD_01_ac12         HardDisk        R9VMVG          2760.15625G
         CD_02_ac12         HardDisk        RKD99G          2793.953125G

Even if i carve out disk from +RECO, with HIGH redundancy i will get only 5Tb and soon i will run out of space.

Another restore failed, sigh !

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s