Problem:
On Windows 2008, the R12.1 instance has become flaky, not allowing connections and responding slowly.
Solution:
Tweak the IRPStackSize registry parameter, or change the memory allocated to user processes using the BCDEDIT Windows command.
Set or increase the following registry key value :
HKEY_LOCAL_MACHINESYSTEMCurrentControlSetServicesLanmanServerParameters
Value Name: IRPStackSize
Data Type: DWORD
Default: 0x4
Maximum: 0xC
The default value of the IRPStackSize parameter is 15. The range is from 11 (0xb hexadecimal) through 50 (0x32 hexadecimal).
You need to increase the default value and test until you eliminate the issue.
Alert log shows:
Restarting dead background process DIA0 Fri Jul 20 10:25:07 2012 Process startup failed, error stack: Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_psp0_2952.trc: ORA-27300: OS system dependent operation:CreateThread failed with status: 8 ORA-27301: OS failure message: Not enough storage is available to process this command. ORA-27302: failure occurred at: ssthrddcr Process DIA0 died, see its trace file Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_pmon_2920.trc: ORA-00443: background process "DIA0" did not start Fri Jul 20 10:26:34 2012 Process startup failed, error stack: Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_psp0_2952.trc: ORA-27300: OS system dependent operation:CreateThread failed with status: 8 ORA-27301: OS failure message: Not enough storage is available to process this command. ORA-27302: failure occurred at: ssthrddcr Fri Jul 20 10:26:35 2012 Process J000 died, see its trace file kkjcre1p: unable to spawn jobq slave process Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_cjq0_10192.trc: Process startup failed, error stack: Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_psp0_2952.trc: ORA-27300: OS system dependent operation:CreateThread failed with status: 8 ORA-27301: OS failure message: Not enough storage is available to process this command. ORA-27302: failure occurred at: ssthrddcr Process J000 died, see its trace file kkjcre1p: unable to spawn jobq slave process Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_cjq0_10192.trc: Fri Jul 20 10:27:10 2012 Starting background process DIA0 Fri Jul 20 10:27:10 2012 Process startup failed, error stack: Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_psp0_2952.trc: ORA-27300: OS system dependent operation:CreateThread failed with status: 8 ORA-27301: OS failure message: Not enough storage is available to process this command. ORA-27302: failure occurred at: ssthrddcr Process DIA0 died, see its trace file Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_pmon_2920.trc: ORA-00443: background process "DIA0" did not start Fri Jul 20 10:27:26 2012 Process startup failed, error stack: Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_psp0_2952.trc: ORA-27300: OS system dependent operation:CreateThread failed with status: 8 ORA-27301: OS failure message: Not enough storage is available to process this command. ORA-27302: failure occurred at: ssthrddcr Fri Jul 20 10:27:27 2012 Process J000 died, see its trace file kkjcre1p: unable to spawn jobq slave process Process startup failed, error stack: Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_cjq0_10192.trc: Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_psp0_2952.trc: ORA-27300: OS system dependent operation:CreateThread failed with status: 8 ORA-27301: OS failure message: Not enough storage is available to process this command. ORA-27302: failure occurred at: ssthrddcr Fri Jul 20 10:27:28 2012 Process m001 died, see its trace file Fri Jul 20 10:27:52 2012 Process startup failed, error stack: Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_psp0_2952.trc: ORA-27300: OS system dependent operation:CreateThread failed with status: 8 ORA-27301: OS failure message: Not enough storage is available to process this command. ORA-27302: failure occurred at: ssthrddcr Fri Jul 20 10:27:53 2012 Process J000 died, see its trace file kkjcre1p: unable to spawn jobq slave process Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_cjq0_10192.trc: Fri Jul 20 10:28:23 2012 Process startup failed, error stack: Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_psp0_2952.trc: ORA-27300: OS system dependent operation:CreateThread failed with status: 8 ORA-27301: OS failure message: Not enough storage is available to process this command. ORA-27302: failure occurred at: ssthrddcr Fri Jul 20 10:28:24 2012 Process J000 died, see its trace file kkjcre1p: unable to spawn jobq slave process Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_cjq0_10192.trc: Fri Jul 20 10:29:19 2012 Process startup failed, error stack: Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_psp0_2952.trc: ORA-27300: OS system dependent operation:CreateThread failed with status: 8 ORA-27301: OS failure message: Not enough storage is available to process this command. ORA-27302: failure occurred at: ssthrddcr Fri Jul 20 10:29:20 2012 Process J000 died, see its trace file kkjcre1p: unable to spawn jobq slave process Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_cjq0_10192.trc: Process startup failed, error stack: Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_psp0_2952.trc: ORA-27300: OS system dependent operation:CreateThread failed with status: 8 ORA-27301: OS failure message: Not enough storage is available to process this command. ORA-27302: failure occurred at: ssthrddcr Process J000 died, see its trace file kkjcre1p: unable to spawn jobq slave process Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_cjq0_10192.trc: Fri Jul 20 10:31:03 2012 Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_ora_10496.trc (incident=57049): ORA-04030: out of process memory when trying to allocate 123404 bytes (QERHJ hash-joi,kllcqas:kllsltba) Fri Jul 20 10:31:03 2012 Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_ora_548.trc (incident=56913): ORA-04030: out of process memory when trying to allocate 21024 bytes (PLS SGA hp,PL/SQL STACK) Fri Jul 20 10:31:05 2012 Process startup failed, error stack: Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_psp0_2952.trc: ORA-27300: OS system dependent operation:CreateThread failed with status: 8 ORA-27301: OS failure message: Not enough storage is available to process this command. ORA-27302: failure occurred at: ssthrddcr Fri Jul 20 10:31:06 2012 Process m002 died, see its trace file Fri Jul 20 10:31:09 2012 Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_ora_9820.trc (incident=56761): ORA-04030: out of process memory when trying to allocate 16396 bytes (QERHJ hash-joi,QERHJ Bit vector) Fri Jul 20 10:32:05 2012 Starting background process DIA0 Fri Jul 20 10:32:05 2012 Process startup failed, error stack: Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_psp0_2952.trc: ORA-27300: OS system dependent operation:CreateThread failed with status: 8 ORA-27301: OS failure message: Not enough storage is available to process this command. ORA-27302: failure occurred at: ssthrddcr Process DIA0 died, see its trace file Process startup failed, error stack: Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_pmon_2920.trc: ORA-00443: background process "DIA0" did not start Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_psp0_2952.trc: ORA-27300: OS system dependent operation:CreateThread failed with status: 8 ORA-27301: OS failure message: Not enough storage is available to process this command. ORA-27302: failure occurred at: ssthrddcr Fri Jul 20 10:32:07 2012 Process m001 died, see its trace file Fri Jul 20 10:33:07 2012 Process startup failed, error stack: Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_psp0_2952.trc: ORA-27300: OS system dependent operation:CreateThread failed with status: 8 ORA-27301: OS failure message: Not enough storage is available to process this command. ORA-27302: failure occurred at: ssthrddcr Fri Jul 20 10:33:08 2012 Process m002 died, see its trace file Fri Jul 20 10:34:08 2012 Process startup failed, error stack: Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_psp0_2952.trc: ORA-27300: OS system dependent operation:CreateThread failed with status: 8 ORA-27301: OS failure message: Not enough storage is available to process this command. ORA-27302: failure occurred at: ssthrddcr Fri Jul 20 10:34:09 2012 Process m001 died, see its trace file Fri Jul 20 10:35:10 2012 Process startup failed, error stack: Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_psp0_2952.trc: ORA-27300: OS system dependent operation:CreateThread failed with status: 8 ORA-27301: OS failure message: Not enough storage is available to process this command. ORA-27302: failure occurred at: ssthrddcr Fri Jul 20 10:35:11 2012 Process m002 died, see its trace file Fri Jul 20 10:36:10 2012 Starting background process DIA0 Fri Jul 20 10:36:10 2012 Process startup failed, error stack: Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_psp0_2952.trc: ORA-27300: OS system dependent operation:CreateThread failed with status: 8 ORA-27301: OS failure message: Not enough storage is available to process this command. ORA-27302: failure occurred at: ssthrddcr Process DIA0 died, see its trace file Process startup failed, error stack: Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_pmon_2920.trc: ORA-00443: background process "DIA0" did not start Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_psp0_2952.trc: ORA-27300: OS system dependent operation:CreateThread failed with status: 8 ORA-27301: OS failure message: Not enough storage is available to process this command. ORA-27302: failure occurred at: ssthrddcr Fri Jul 20 10:36:12 2012 Process m001 died, see its trace file Fri Jul 20 10:36:39 2012 Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_ora_9820.trc (incident=56762): ORA-04030: out of process memory when trying to allocate 123404 bytes (QERHJ hash-joi,kllcqas:kllsltba) Fri Jul 20 10:36:58 2012 Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_mmon_3052.trc (incident=56569): ORA-04030: out of process memory when trying to allocate 123404 bytes (QERHJ hash-joi,kllcqas:kllsltba) AUTO SGA: Disabling background sga tuning due to err 604 AUTO SGA: Dumping call and error stack to file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_mmon_3052.trc Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_mmon_3052.trc: ORA-00604: error occurred at recursive SQL level 1 ORA-04030: out of process memory when trying to allocate 123404 bytes (QERHJ hash-joi,kllcqas:kllsltba) Fri Jul 20 10:37:03 2012 Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_ora_10496.trc (incident=57050): ORA-04030: out of process memory when trying to allocate 123404 bytes (QERHJ hash-joi,kllcqas:kllsltba) Fri Jul 20 10:37:09 2012 Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_ora_12728.trc (incident=56593): ORA-04030: out of process memory when trying to allocate 547600 bytes (joxu pga heap,u:CTX_SEG) Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_ora_12728.trc: ORA-04030: out of process memory when trying to allocate 547600 bytes (joxu pga heap,u:CTX_SEG) Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_ora_12728.trc (incident=56594): ORA-04030: out of process memory when trying to allocate 32780 bytes (kxs-heap-b,bind var buf) Fri Jul 20 10:37:10 2012 Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_ora_884.trc (incident=57034): ORA-04030: out of process memory when trying to allocate 32780 bytes (kxs-heap-b,bind var buf) Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_ora_884.trc (incident=57035): ORA-04030: out of process memory when trying to allocate 1040 bytes (PL/SQL DIANA,PAR.C:parchk:page) Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_ora_884.trc (incident=57036): ORA-04030: out of process memory when trying to allocate 40932 bytes (koh-kghu call ,pl/sql vc2) Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_ora_884.trc (incident=57037): ORA-04030: out of process memory when trying to allocate 40932 bytes (koh-kghu call ,pl/sql vc2) Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_ora_884.trc (incident=57038): ORA-04030: out of process memory when trying to allocate 40932 bytes (koh-kghu call ,pl/sql vc2) Fri Jul 20 10:37:09 2012 Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_ora_9820.trc (incident=56763): ORA-04030: out of process memory when trying to allocate 123404 bytes (QERHJ hash-joi,kllcqas:kllsltba) Fri Jul 20 10:37:10 2012 Trace dumping is performing id=[cdmp_20120720103710] Fri Jul 20 10:37:10 2012 Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_ora_12988.trc (incident=56641): ORA-04030: out of process memory when trying to allocate 4056 bytes (PLS SGA hp,pdzdM80_Allocate_Block) Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_ora_12988.trc (incident=56642): ORA-04030: out of process memory when trying to allocate 4076 bytes (PLS SGA hp,pdz2M87_Allocate_Permanent) Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_ora_12988.trc (incident=56643): ORA-04030: out of process memory when trying to allocate 40932 bytes (koh-kghu call ,pl/sql vc2) Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_ora_12988.trc (incident=56644): ORA-04030: out of process memory when trying to allocate 40932 bytes (koh-kghu call ,pl/sql vc2) Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_ora_12988.trc (incident=56645): ORA-04030: out of process memory when trying to allocate 40932 bytes (koh-kghu call ,pl/sql vc2) Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_ora_12988.trc (incident=56646): ORA-04030: out of process memory when trying to allocate 40932 bytes (koh-kghu call ,pl/sql vc2) Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_ora_12988.trc (incident=56647): ORA-04030: out of process memory when trying to allocate 40932 bytes (koh-kghu call ,pl/sql vc2) Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_ora_12988.trc (incident=56648): ORA-04030: out of process memory when trying to allocate 40932 bytes (koh-kghu call ,pl/sql vc2) Fri Jul 20 10:37:11 2012 Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_ora_12736.trc (incident=56601): ORA-04030: out of process memory when trying to allocate 4076 bytes (PLS SGA hp,pdy2M03_Create) Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_ora_884.trc (incident=57039): ORA-04030: out of process memory when trying to allocate 32780 bytes (kxs-heap-b,bind var buf) Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_ora_884.trc (incident=57040): ORA-04030: out of process memory when trying to allocate 40932 bytes (koh-kghu call ,pl/sql vc2) Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_ora_884.trc (incident=58062): ORA-04030: out of process memory when trying to allocate 40932 bytes (koh-kghu call ,pl/sql vc2) Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_ora_884.trc (incident=58069): ORA-04030: out of process memory when trying to allocate 40932 bytes (koh-kghu call ,pl/sql vc2) Fri Jul 20 10:37:12 2012 Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_ora_10504.trc (incident=58053): ORA-04030: out of process memory when trying to allocate 123404 bytes (QERHJ hash-joi,kllcqas:kllsltba) Fri Jul 20 10:37:13 2012 Process startup failed, error stack: Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_psp0_2952.trc: ORA-27300: OS system dependent operation:CreateThread failed with status: 8 ORA-27301: OS failure message: Not enough storage is available to process this command. ORA-27302: failure occurred at: ssthrddcr Fri Jul 20 10:37:14 2012 Process m002 died, see its trace file Fri Jul 20 10:37:29 2012 Process startup failed, error stack: Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_psp0_2952.trc: ORA-27300: OS system dependent operation:CreateThread failed with status: 8 ORA-27301: OS failure message: Not enough storage is available to process this command. ORA-27302: failure occurred at: ssthrddcr Fri Jul 20 10:37:30 2012 Process m001 died, see its trace file Fri Jul 20 10:38:15 2012 Process startup failed, error stack: Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_psp0_2952.trc: ORA-27300: OS system dependent operation:CreateThread failed with status: 8 ORA-27301: OS failure message: Not enough storage is available to process this command. ORA-27302: failure occurred at: ssthrddcr Fri Jul 20 10:38:16 2012 Process m002 died, see its trace file Fri Jul 20 10:39:16 2012 Process startup failed, error stack: Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_psp0_2952.trc: ORA-27300: OS system dependent operation:CreateThread failed with status: 8 ORA-27301: OS failure message: Not enough storage is available to process this command. ORA-27302: failure occurred at: ssthrddcr Fri Jul 20 10:39:17 2012 Process m001 died, see its trace file Fri Jul 20 10:39:52 2012 Incremental checkpoint up to RBA [0x46.235c.0], current log tail at RBA [0x46.2421.0] Fri Jul 20 10:40:16 2012 Starting background process DIA0 Fri Jul 20 10:40:16 2012 Process startup failed, error stack: Errors in file c:oracledev1dbtech_st11.1.0admindev1_domainnamediagrdbmsdev1dev1tracedev1_psp0_2952.trc: ORA-27300: OS system dependent operation:CreateThread failed with status: 8 ORA-27301: OS failure message: Not enough storage is available to process this command.
MOS Reference:
Ora-27300: Os System Dependent Operation:Createthread Failed With Status: 8 [ID 1310453.1]
[amazon asin=0470532866&template=iframe image&chan=default] [amazon asin=0470525398&template=iframe image&chan=default] [amazon asin=0735666334&template=iframe image&chan=default]
0 Comments.