This morning we had an issue with a physical standby server. The first notification was that log apply was falling behind. It turned out that the standby server had been restarted and the listener and the database not restarted. When we started the database, we saw the below errors in the alert log:
Standby crash recovery aborted due to error 16016. Errors in file /opt/app/oracle/diag/rdbms/dr/PRODDR/trace/PRODDR_ora_21598.trc: ORA-16016: archived log for thread 1 sequence# 16661 unavailable Recovery interrupted! Some recovered datafiles maybe left media fuzzy Media recovery may continue but open resetlogs may fail Completed standby crash recovery. Errors in file /opt/app/oracle/diag/rdbms/dr/PRODDR/trace/PRODDR_ora_21598.trc: ORA-10458: standby database requires recovery ORA-01196: file 1 is inconsistent due to a failed media recovery session ORA-01110: data file 1: '/appl_ware/oradata/data/PRODDR/system01.dbf' ORA-10458 signalled during: ALTER DATABASE OPEN...
A lot of posts on google indicated that a recovery was needed. Before we did that we decided to try and start MRP to see if that would resolve the issue. We issued
ALTER DATABASE MOUNT STANDBY DATABASE;
followed by the command to start MRP
alter database recover managed standby database using current logfile disconnect from session;
and the problem was resolved.
