<html><head><meta http-equiv="Content-Type" content="text/html charset=us-ascii"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;">On Jun 17, 2014, at 3:01 PM, Kevin Falcone <<a href="mailto:falcone@bestpractical.com">falcone@bestpractical.com</a>> wrote:<br><div><br class="Apple-interchange-newline"><blockquote type="cite"><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;">Look for slow queries in your database (there are oracle specific</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;"><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;">reports for this) or try turning on MasonX::Profiler in development</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;"><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;">and see what RT is doing when it times out.</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;"></blockquote></div><div><br></div><div>I enabled MasonX::Profiler as you suggested. Here is the relevant log entries</div><div><br></div><br><div><div>RT::Config::__ANON__('RT::Config=HASH(0x14eab98)', undef) called at /opt/rt4devel/sbin/../lib/RT/Config.pm line 1159</div><div>RT::Config::PostLoadCheck('RT::Config=HASH(0x14eab98)') called at /opt/rt4devel/sbin/../lib/RT.pm line 199</div><div>RT::Init('RT', 'Heavy', 1) called at /opt/rt4devel/sbin/rt-server.fcgi line 126</div><div><br></div><div>==> /var/log/httpd/error_log <==</div><div>=Mason= localhost - /index.html BEGINS {{{</div><div>=Mason= localhost - /autohandler {{{</div><div>=Mason= localhost - /Elements/SetupSessionCookie {{{</div></div><div><br></div><div>At this point there is a 3 minute (I upped it to see if it would ever finish) wait until fcgi times out and throws the internal server error.</div><div><br></div><div><div>==> /var/log/httpd/rt4devel_error_log <==</div><div>[Tue Jun 24 14:17:06 2014] [warn] [client 137.238.60.9] mod_fcgid: read data timeout in 180 seconds, referer: <a href="https://rtdevel.geneseo.edu/index.html?HomeRefreshInterval=120">https://rtdevel.geneseo.edu/index.html?HomeRefreshInterval=120</a></div><div>[Tue Jun 24 14:17:06 2014] [error] [client 137.238.60.9] Premature end of script headers: rt-server.fcgi, referer: <a href="https://rtdevel.geneseo.edu/index.html?HomeRefreshInterval=120">https://rtdevel.geneseo.edu/index.html?HomeRefreshInterval=120</a></div><div><br></div><div>==> /var/log/httpd/error_log <==</div><div>=Mason= localhost - /favicon.ico BEGINS {{{</div><div>=Mason= localhost - /autohandler {{{</div><div>=Mason= localhost - /Elements/SetupSessionCookie }}} 180.1433</div></div><div>TONS more Mason logs</div><div><br></div><div>Not sure what this really tells me.</div><div><br></div><div>Our DBA is looking into the database side. Apparently It is blocking itself going against the 11g database. Sessions are blocking other sessions. We are looking into any possible database parameters new to 11g that cause this behavior to be different from our production 10g RT database.</div><div><br></div><div><br></div><div><span style="text-align: -webkit-auto; orphans: 2; widows: 2;">--</span></div><div><div><div style="orphans: 2; text-align: -webkit-auto; widows: 2;">Shawn Plummer</div><div style="orphans: 2; text-align: -webkit-auto; widows: 2;">Systems Manager | SUNY Geneseo</div><div style="orphans: 2; text-align: -webkit-auto; widows: 2;">South Hall 119 | 585-245-5577 | <a href="http://www.geneseo.edu/cit">http://www.geneseo.edu/cit</a></div><div><br></div></div></div></body></html>