Error while starting the database in RAC PRCR-1079 : Failed to start resource ora.rac.db

While starting the oracle RAC database I was getting an error CRS-5017 and ORA-03113. the full error message is

[oracle@rac1 admin]$ srvctl start database -d RAC
PRCR-1079 : Failed to start resource ora.rac.db
CRS-5017: The resource action "ora.rac.db start" encountered the following error:
ORA-03113: end-of-file on communication channel
Process ID: 10605
Session ID: 1 Serial number: 3
. For details refer to "(:CLSN00107:)" in "/u01/app/11.2.0/grid/log/rac1/agent/crsd/oraagent_oracle/oraagent_oracle.log".
CRS-2674: Start of 'ora.rac.db' on 'rac1' failed
CRS-2632: There are no more servers to try to place resource 'ora.rac.db' on that would satisfy its placement policy
CRS-5017: The resource action "ora.rac.db start" encountered the following error:
ORA-03113: end-of-file on communication channel
Process ID: 13620
Session ID: 1 Serial number: 3
. For details refer to "(:CLSN00107:)" in "/u01/app/11.2.0/grid/log/rac2/agent/crsd/oraagent_oracle/oraagent_oracle.log".
CRS-2674: Start of 'ora.rac.db' on 'rac2' failed
[oracle@rac1 admin]$ 

I had a look at the oraagent_oracle.log file but could not get much out of this then had a look at the oracle alert logs which showed me the cause of the issue.

Errors in file /u01/app/oracle/diag/rdbms/rac/RAC2/trace/RAC2_ora_14431.trc:ORA-19815: WARNING: db_recovery_file_dest_size of 10737418240 bytes is 100.00% used, and has 0 remaining bytes available.

To fix this i had stared the database manually with the following steps and change the db_recovery_file_dest_size to little bigger.

SQL> startup nomountORACLE instance started.
Total System Global Area  793350144 bytesFixed Size                  2232552 bytesVariable Size             364908312 bytesDatabase Buffers          423624704 bytesRedo Buffers                2584576 bytesSQL>SQL> alter system set db_recovery_file_dest_size=12G;
System altered.
SQL> shutdown immediateORA-01507: database not mounted
ORACLE instance shut down.SQL>

Resulting I was able to start the database.

[oracle@rac1 admin]$ srvctl start database -d RAC[oracle@rac1 admin]$ srvctl status database -d RACInstance RAC1 is running on node rac1Instance RAC2 is running on node rac2[oracle@rac1 admin]$ 

The issue was that all the archive logs under FRA filled the space. I was not using RMAN to take backups. Will update how the issue was fix permanently.