Adding a new node to an existing cluster results in PRKC-1025 error

The PRKC-1025 error is encountered when adding a new node to an existing cluster using the following command in Oracle release 10g and 11g:

./addNode.sh -silent "CLUSTER_NEW_NODES={joords4}" "CLUSTER_NEW_VIRTUAL_HOSTNAMES={joords4-vip}" -debug -logLevel finest"

This command create the following output :

SEVERE: 4/9/12 3:55:03 AM IST: Abnormal program termination. An internal error has occured. Please provide the following files to Oracle Support : 

"/opt/oracle/oraInventory/logs/addNodeActions2012-04-09_03-54-34AM.log"
"/opt/oracle/oraInventory/logs/oraInstall2012-04-09_03-54-34AM.err"
"/opt/oracle/oraInventory/logs/oraInstall2012-04-09_03-54-34AM.out"
INFO: 4/9/10 3:55:03 AM IST: User Selected: Yes/OK

From the oraInstall[date-timestamp]AM.err we notice the following errors:

oracle.ops.mgmt.cluster.SharedDeviceException: PRKC-1025 : Failed to create a file under the filepath /opt because the filepath is not executable or writable
at oracle.ops.mgmt.nativesystem.UnixSystem.isSharedPath(UnixSystem.java:1564)
at oracle.ops.mgmt.cluster.Cluster.isSharedPath(Cluster.java:1109)
at oracle.sysman.oii.oiip.oiipg.OiipgCFSDriveCheck.isDriveOnCFS(OiipgCFSDriveCheck.java:655)
….
at oracle.sysman.oii.oiic.OiicInstaller.run(OiicInstaller.java:579)
at oracle.sysman.oii.oiic.OiicInstaller.runInstaller(OiicInstaller.java:969)
at oracle.sysman.oii.oiic.OiicInstaller.main(OiicInstaller.java:906)
Exception java.lang.OutOfMemoryError: Java heap space occurred..
java.lang.OutOfMemoryError: Java heap space
at java.lang.StringCoding$CharsetSE.encode(StringCoding.java:334)
at java.lang.StringCoding.encode(StringCoding.java:378)
at java.lang.String.getBytes(String.java:812)
…
at oracle.sysman.oii.oiic.OiicSessionWrapper.doOperation(OiicSessionWrapper.java:294)
at oracle.sysman.oii.oiic.OiicInstaller.run(OiicInstaller.java:579)
at oracle.sysman.oii.oiic.OiicInstaller.runInstaller(OiicInstaller.java:969)
at oracle.sysman.oii.oiic.OiicInstaller.main(OiicInstaller.java:906)

The two important rows for solving this PRKC-1025 error when adding a new node to the cluster are:

PRKC-1025 : Failed to create a file under the filepath /opt because the filepath is not executable or writable <--------- FIRST ERROR

Exception java.lang.OutOfMemoryError: Java heap space occurred..
java.lang.OutOfMemoryError: Java heap space  <------------------- SECOND ERROR

The FIRST ERROR is the misleading oner for solving this problem. The real cause of the problem is the SECOND ERROR OutOfMemoryError: Java heap space

Solution

Increasing of the JRE_MEMORY_OPTIONS will be solving the problem of the OutOfMemoryError

Increase JRE_MEMORY_OPTIONS=" -mx1024m" or greater value in the oraparam.ini located in:  $GRID_HOME/oui/