转载

启动数据库至open状态报错：ORA-03113: end-of-file on communication channel

环境描述：
      DB环境：RAC双节点 Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
      OS版本：Red Hat Enterprise Linux Server release 5.7 (Tikanga)
问题描述：
     启动数据库的时候报如下错误提示：
     ORA-03113: end-of-file on communication channel
Process ID: 10138
     Session ID: 14 Serial number: 3
查看数据库的相关服务状态：
[oracle@rac53 trace]$ crs_stat -t -v
Name           Type           R/RA   F/FT   Target    State     Host
----------------------------------------------------------------------
ora.DATA.dg    ora....up.type 0/5    0/     ONLINE    ONLINE    rac53
ora.FLASH.dg   ora....up.type 0/5    0/     ONLINE    ONLINE    rac53
ora.GRIDDG.dg ora....up.type 0/5    0/     ONLINE    ONLINE    rac53
ora....ER.lsnr ora....er.type 0/5    0/     ONLINE    ONLINE    rac53
ora....N1.lsnr ora....er.type 0/5    0/0    ONLINE    ONLINE    rac53
ora.asm        ora.asm.type   0/5    0/     ONLINE    ONLINE    rac53
ora.cvu        ora.cvu.type   0/5    0/0    ONLINE    ONLINE    rac53
ora.gsd        ora.gsd.type   0/5    0/     OFFLINE   OFFLINE
ora.hbang.db   ora....se.type 0/2    0/1    ONLINE    ONLINE    rac53
ora....network ora....rk.type 0/5    0/     ONLINE    ONLINE    rac53
ora.oc4j       ora.oc4j.type 0/1    0/2    ONLINE    ONLINE    rac53
ora.ons        ora.ons.type   0/3    0/     ONLINE    ONLINE    rac53
ora....SM1.asm application    0/5    0/0    ONLINE    ONLINE    rac53
ora....53.lsnr application    0/5    0/0    ONLINE    ONLINE    rac53
ora.rac53.gsd application    0/5    0/0    OFFLINE   OFFLINE
ora.rac53.ons application    0/3    0/0    ONLINE    ONLINE    rac53
ora.rac53.vip ora....t1.type 0/0    0/0    ONLINE    ONLINE    rac53
ora....SM2.asm application    0/5    0/0    ONLINE    ONLINE    rac54
ora....54.lsnr application    0/5    0/0    ONLINE    ONLINE    rac54
ora.rac54.gsd application    0/5    0/0    OFFLINE   OFFLINE
ora.rac54.ons application    0/3    0/0    ONLINE    ONLINE    rac54
ora.rac54.vip ora....t1.type 0/0    0/0    ONLINE    ONLINE    rac54
ora....ry.acfs ora....fs.type 0/5    0/     ONLINE    ONLINE    rac53
ora.scan1.vip ora....ip.type 0/0    0/0    ONLINE    ONLINE    rac53
正常，没问题；
处理步骤：
1. 分布启动数据库至nomount、mount、open状态，查看是哪个环节报的错误提示
SQL> startup nomount;
SQL> alter database mount;
SQL> alter database open;
alter database open
*
ERROR at line 1:
ORA-03113: end-of-file on communication channel
Process ID: 11752
Session ID: 16 Serial number: 1
2. 退出刚才那个会话窗口，重新启动到mount状态，查看告警日志信息
SQL> show parameter background_dump_dest;

NAME                                 TYPE        VALUE
------------------------------------ ----------- ------------------------------
background_dump_dest                 string      /u01/app/oracle/diag/rdbms/hbang/hbang1/trace
SQL>
查看最新的告警日志信息：hbang1_arc2_12195.trc
25 Initial buffer sizes: read 1024K, overflow 832K, change 805K
26 ORA-19815: WARNING: db_recovery_file_dest_size of 4621074432 bytes is 100.00    % used, and has 0 remaining bytes available.
27 ************************************************************************
28 You have following choices to free up space from recovery area:
29 1. Consider changing RMAN RETENTION POLICY. If you are using Data Guard,
30    then consider changing RMAN ARCHIVELOG DELETION POLICY.
31 2. Back up files to tertiary device such as tape using RMAN
32    BACKUP RECOVERY AREA command.
33 3. Add disk space and increase db_recovery_file_dest_size parameter to
34    reflect the new space.
35 4. Delete unnecessary files using RMAN DELETE command. If an operating
36    system command was used to delete files, then use RMAN CROSSCHECK and
37    DELETE EXPIRED commands.
38 ************************************************************************
39 *** 2016-04-20 15:30:19.345 4329 krsh.c
40 ARC2: Error 19809 Creating archive log file to '+FLASH'
41 *** 2016-04-20 15:30:19.345 2917 krsi.c
42 krsi_dst_fail: dest:1 err:19809 force:0 blast:1
43 DDE: Problem Key 'ORA 312' was flood controlled (0x1) (no incident)
44 ORA-00312: online log 3 thread 2: '+FLASH/hbang/onlinelog/group_3.259.907536    373'
45 DDE: Problem Key 'ORA 312' was flood controlled (0x1) (no incident)
46 ORA-00312: online log 3 thread 2: '+DATA/hbang/onlinelog/group_3.266.9075363    73'
47 ORA-00312: online log 3 thread 2: '+FLASH/hbang/onlinelog/group_3.259.907536    373'
问题分析，闪回空间不足；
3. 查看闪回空间大小
SQL> show parameter db_recovery_file_dest;

NAME                                 TYPE        VALUE
------------------------------------ ----------- ------------------------------
db_recovery_file_dest                string      +FLASH
db_recovery_file_dest_size           big integer 4407M
解决办法有三个，如下：
     1> 设置新的归档路径，操作语句为 SQL> alter system set log_archive_dest=new_location;
     2> 转储或删除闪回恢复区里的归档日志；
     3> 增大闪回恢复区，操作语句为 SQL> alter system set db_recovery_file_dest_size=new_size;
如下采用删除过旧归档备份进行处理。
4. RMAN方式登录，手动删除不需要的归档日志（eg：删除三天以前的归档记录）
[oracle@rac53 trace]$ rman target /

Recovery Manager: Release 11.2.0.4.0 - Production on Wed Apr 20 15:49:22 2016

Copyright (c) 1982, 2011, Oracle and/or its affiliates. All rights reserved.

connected to target database: HBANG (DBID=1821727253, not open)

RMAN>delete archivelog all completed before 'sysdate - 3';
......
Do you really want to delete the above objects (enter YES or NO)?YES
......
RMAN> quit
5. 重新打开数据库验证
SQL> alter database open;

Database altered.

正文到此结束