I was trying to bring up a new RAC physical standby node and encountered the below error:
[racnode2-DEVDBTPN2] srvctl start database -d DEVDBTPN PRCR-1079 : Failed to start resource ora.devdbtpn.db CRS-5017: The resource action "ora.devdbtpn.db start" encountered the following error: ORA-27154: post/wait create failed ORA-27300: OS system dependent operation:semget failed with status: 28 ORA-27301: OS failure message: No space left on device ORA-27302: failure occurred at: sskgpcreates . For details refer to "(:CLSN00107:)" in "/oracle/base/diag/crs/racnode1/crs/trace/crsd_oraagent_oracle.trc". CRS-2674: Start of 'ora.devdbtpn.db' on 'racnode1' failed CRS-2632: There are no more servers to try to place resource 'ora.devdbtpn.db' on that would satisfy its placement policy
The OS information was
Linux racnode1 2.6.32-696.13.2.el6.x86_64 #1 SMP Fri Sep 22 12:32:14 EDT 2017 x86_64 x86_64 x86_64 GNU/Linux
There were many other instances running on this RAC node. The issue turned out to be a system parameter setting for the semaphores.
Edit the sysctl.conf file as follows:
vi /etc/sysctl.conf
and change this line
kernel.sem=250 32000 100 128
to this
kernel.sem=250 64000 100 256
Basically double the 2nd and 4th parameter. Then to make the changes go into effect issue the command
sysctl –p
Stop and start the RAC DB with srvctl commands.
