Error Description:
Below frequent error messages will be appeared in alert log file of either of the nodes of RAC database or single instance database. This is because you recently changed the target database incarnation and the archived log or archived logs still exist and part of old incarnation. There is no impact on existing database due these error messages, but these need to be fixed.
Errors in file /u01/app/oracle/diag/rdbms/demo/demo2/trace/demo2_tt00_10879.trc: ORA-00308: cannot open archived log '+ARCH/DEMO/ARCHIVELOG/2023_10_28/thread_2_seq_1501.1034.1151386069' ORA-17503: ksfdopn:2 Failed to open file +ARCH/DEMO/ARCHIVELOG/2023_10_28/thread_2_seq_1501.1034.1151386069 ORA-15012: ASM file '+ARCH/DEMO/ARCHIVELOG/2023_10_28/thread_2_seq_1501.1034.1151386069' does not exist |
Observation:
It is confirmed that the respective archive log is not located in the specified archivelog directory.
ASMCMD> cd +ARCH/DEMO/ARCHIVELOG ASMCMD> ls -l Type Redund Striped Time Sys Name Y 2023_11_05/ Y 2023_11_06/ Y 2023_11_07/ ASMCMD> cd 2023_10_28 ASMCMD-8002: entry '2023_10_28' does not exist in directory '+ARCH/DEMO/ARCHIVELOG/' ASMCMD> ASMCMD> ls -l +ARCH/DEMO/ARCHIVELOG/2023_10_28/thread_2_seq_1501.1034.1151386069 ASMCMD-8002: entry '2023_10_28' does not exist in directory '+ARCH/DEMO/ARCHIVELOG/' ASMCMD> ASMCMD> exit From database, execute below query to check the details of this archived log sequence. col name for a85 set lines 300 pages 3000 select NAME,SEQUENCE#,THREAD#,to_char(RESETLOGS_CHANGE#),RESETLOGS_TIME,COMPLETION_TIME,STATUS,ARCHIVED,APPLIED,DELETED,REGISTRAR,CREATOR,DEST_ID from v$archived_log where name like '%thread_2_seq_1501%'; NAME SEQUENCE# THREAD# TO_CHAR(RESETLOGS_CHANGE#) RESETLOG COMPLETI S ARC APPLIED DEL REGISTR CREATOR DEST_ID ------------------------------------------------------------------ ---------- ------- -------------------------- -------- -------- - --- ------- --- ------- ------- ------- +ARCH/DEMO/ARCHIVELOG/2023_10_28/thread_2_seq_1501.1034.1151386069 1501 2 7429543152122 20221113 20231028 A YES YES NO RFS ARCH 1 From RMAN, check the incarnation details: RMAN> list incarnation; using target database control file instead of recovery catalog List of Database Incarnations DB Key Inc Key DB Name DB ID STATUS Reset SCN Reset Time ------- ------- -------- ----------- -------- ------------ ------- 1 1 DEMO 3860760733 PARENT 1 06-AUG-03 2 2 DEMO 3860760733 ORPHAN 6379260852182 13-FEB-20 3 3 DEMO 3860760733 ORPHAN 6712315461481 15-MAR-21 5 5 DEMO 3860760733 ORPHAN 6859418022158 15-AUG-21 4 4 DEMO 3860760733 ORPHAN 6920207128763 12-OCT-21 6 6 DEMO 3860760733 PARENT 7261310561426 30-JUN-22 7 7 DEMO 3860760733 PARENT 7429543152122 13-NOV-22 8 8 DEMO 3860760733 ORPHAN 7515920871700 24-JAN-23 9 9 DEMO 3860760733 CURRENT 7853900340335 28-OCT-23 |
It is confirmed that this archived log belongs to old incarnation i.e. "Inc Key" is 7 and "Reset SCN" is 7429543152122
Solution:
To fix or avoid these error messages, check the archive log from RMAN repository.
This command will not show anything since we have added wrong incarnation clause. RMAN> list archivelog sequence 1501 incarnation 7429543152122; specification does not match any archived log in the repository This command will not show the archived log since we have added proper incarnation clause. RMAN> list archivelog sequence 1501 incarnation all; specification does not match any archived log in the repository This command will not show the archived log since we have added thread clause as this is RAC database. RMAN> list archivelog sequence 1501 incarnation 7; specification does not match any archived log in the repository The actual command to list the archived log sequence of specific incarnation as below: RMAN> list archivelog sequence 1501 thread 2 incarnation 7; List of Archived Log Copies for database with db_unique_name DEMO ===================================================================== Key Thrd Seq S Low Time ------- ---- ------- - --------- 2403161 2 1501 A 28-OCT-23 Name: +ARCH/DEMO/ARCHIVELOG/2023_10_28/thread_2_seq_1501.1034.1151386069 Now crosscheck the listed archive log of specific incarnation by executing below command: RMAN> crosscheck archivelog sequence 1501 thread 2 incarnation 7; allocated channel: ORA_DISK_1 channel ORA_DISK_1: SID=6787 instance=demo2 device type=DISK allocated channel: ORA_DISK_2 channel ORA_DISK_2: SID=6822 instance=demo2 device type=DISK allocated channel: ORA_DISK_3 channel ORA_DISK_3: SID=1427 instance=demo2 device type=DISK allocated channel: ORA_DISK_4 channel ORA_DISK_4: SID=7082 instance=demo2 device type=DISK allocated channel: ORA_DISK_5 channel ORA_DISK_5: SID=5145 instance=demo2 device type=DISK validation failed for archived log archived log file name=+ARCH/DEMO/ARCHIVELOG/2023_10_28/thread_2_seq_1501.1034.1151386069 RECID=2403161 STAMP=1151386069 Crosschecked 1 objects RMAN> Here, once crosscheck is done then you won't get any further ORA- messages in the alert log file, but still you want to delete expired archivelog of specific incarnation, then execute below command: RMAN> delete expired archivelog sequence 1501 thread 2 incarnation 7; released channel: ORA_DISK_1 released channel: ORA_DISK_2 released channel: ORA_DISK_3 released channel: ORA_DISK_4 released channel: ORA_DISK_5 allocated channel: ORA_DISK_1 channel ORA_DISK_1: SID=92 instance=demo2 device type=DISK allocated channel: ORA_DISK_2 channel ORA_DISK_2: SID=2948 instance=demo2 device type=DISK allocated channel: ORA_DISK_3 channel ORA_DISK_3: SID=1665 instance=demo2 device type=DISK allocated channel: ORA_DISK_4 channel ORA_DISK_4: SID=1901 instance=demo2 device type=DISK allocated channel: ORA_DISK_5 channel ORA_DISK_5: SID=6376 instance=demo2 device type=DISK List of Archived Log Copies for database with db_unique_name DEMO ===================================================================== Key Thrd Seq S Low Time ------- ---- ------- - --------- 2403153 4 1501 X 28-OCT-23 Name: +ARCH/DEMO/ARCHIVELOG/2023_10_28/thread_2_seq_1501.1034.1151386069 Do you really want to delete the above objects (enter YES or NO)? YES deleted archived log archived log file name=+ARCH/DEMO/ARCHIVELOG/2023_10_28/thread_2_seq_1501.1034.1151386069 RECID=2403161 STAMP=1151386069 Deleted 1 EXPIRED objects RMAN> |
Thank you for visiting my blog ! Thanks for your comment !