[rt-users] Segmentation Fault

Tue Jan 27 20:37:57 EST 2009

I have a problem that I think may be database specific, but I'm lost in how to troubleshoot further.

I have a working 3.6.3 system that I want to port to a test machine running 3.8.x.

I took a minimal Fedora 10 install and installed RT3 from "yum".  I then upgraded the DBD::mysql using CPAN to 4.010

I mysqldump'ed the 3.6.3 database (using -default-character-set=binary), sftp'ed the dump over to the new box, and pumped it into the new mysql database there.  I then ran rt-setup-database -action upgrade from 3.6.3 to 3.8.1 (which is what yum installed for me).

After customizing the RT_SiteConfig.pm file, I can log in and see my cases on my home screen, but as soon as I attempt to either go into a case, or hit anything else on the screen (tickets, configuration, ...), I get hit with a segmentation fault.

As I said - I'm fairly sure that this is a database issue on my end (starting out with a blank database and populating it with several cases, I don't see any problems - just when I add my 3-year old, 1.1GB database).  If anyone has any suggestions for further troubleshooting, I'd love to hear them!!

I ran GDB and backtraced from the point of the seg fault, and this is what I got:

(hitting "Configure" in the menu):

Program received signal SIGSEGV, Segmentation fault.
memcpy () at ../sysdeps/i386/i686/memcpy.S:75
75              rep
Current language:  auto; currently asm
(gdb) bt
#0  memcpy () at ../sysdeps/i386/i686/memcpy.S:75
#1  0xba9dad1c in ?? ()
#2  0x00de43c2 in retrieve_hash (my_perl=0xbb1b3a80, cxt=0x426f16f8, cname=0x0) at /usr/include/bits/string3.h:52
#3  0x00ddfafd in retrieve (my_perl=0xbb1b3a80, cxt=0xba9dad1c, cname=0x0) at Storable.xs:5967
#4  0x00de22a0 in retrieve_ref (my_perl=0xbb1b3a80, cxt=0xba9dad1c, cname=0x0) at Storable.xs:4477
#5  0x00ddfafd in retrieve (my_perl=0xbb1b3a80, cxt=0xba9dad1c, cname=0x0) at Storable.xs:5967
#6  0x00de48ad in retrieve_array (my_perl=0xbb1b3a80, cxt=0xba9dad1c, cname=0x0) at Storable.xs:5159
#7  0x00ddfafd in retrieve (my_perl=0xbb1b3a80, cxt=0xba9dad1c, cname=0x0) at Storable.xs:5967
#8  0x00de22a0 in retrieve_ref (my_perl=0xbb1b3a80, cxt=0xba9dad1c, cname=0x0) at Storable.xs:4477
#9  0x00ddfafd in retrieve (my_perl=0xbb1b3a80, cxt=0xba9dad1c, cname=0x0) at Storable.xs:5967
#10 0x00de42d6 in retrieve_hash (my_perl=0xbb1b3a80, cxt=0xba9dad1c, cname=0x0) at Storable.xs:5214
#11 0x00ddfafd in retrieve (my_perl=0xbb1b3a80, cxt=0xba9dad1c, cname=0x0) at Storable.xs:5967
#12 0x00de0742 in do_retrieve (my_perl=0xbb1b3a80, f=0x0, in=0xbb16512c, optype=2) at Storable.xs:6148
#13 0x00de18b4 in mretrieve () at Storable.xs:6264
#14 XS_Storable_mretrieve (my_perl=0xbb1b3a80, cv=0xba9d6b0c) at Storable.xs:6460
#15 0x00af66f9 in Perl_pp_entersub (my_perl=0xbb1b3a80) at pp_hot.c:2847
#16 0x00ab7f03 in Perl_runops_debug (my_perl=0xbb1b3a80) at dump.c:1931
#17 0x00b65d0f in S_docatch (my_perl=0xbb1b3a80, o=<value optimized out>) at pp_ctl.c:2679
#18 0x00ab7f03 in Perl_runops_debug (my_perl=0xbb1b3a80) at dump.c:1931
#19 0x00aef64d in Perl_call_sv (my_perl=0xbb1b3a80, sv=0xbc191934, flags=<value optimized out>) at perl.c:2631
#20 0x00b93dc8 in Perl_pp_tie (my_perl=0xbb1b3a80) at pp_sys.c:850
#21 0x00ab7f03 in Perl_runops_debug (my_perl=0xbb1b3a80) at dump.c:1931
#22 0x00b65d0f in S_docatch (my_perl=0xbb1b3a80, o=<value optimized out>) at pp_ctl.c:2679
#23 0x00b68e4d in Perl_pp_entereval (my_perl=0xbb1b3a80) at pp_ctl.c:3617
#24 0x00ab7f03 in Perl_runops_debug (my_perl=0xbb1b3a80) at dump.c:1931
#25 0x00aef64d in Perl_call_sv (my_perl=0xbb1b3a80, sv=0xbc17fb64, flags=<value optimized out>) at perl.c:2631
#26 0x00b93dc8 in Perl_pp_tie (my_perl=0xbb1b3a80) at pp_sys.c:850
#27 0x00ab7f03 in Perl_runops_debug (my_perl=0xbb1b3a80) at dump.c:1931
#28 0x00aefa58 in Perl_call_sv (my_perl=0xbb1b3a80, sv=0xbac33804, flags=4) at perl.c:2646
#29 0x009e6da4 in modperl_callback () from /etc/httpd/modules/mod_perl.so
#30 0x009e7b3c in modperl_callback_run_handlers () from /etc/httpd/modules/mod_perl.so
#31 0x009e856a in modperl_callback_per_dir () from /etc/httpd/modules/mod_perl.so
#32 0x009df5ff in ?? () from /etc/httpd/modules/mod_perl.so
#33 0x009df7c5 in modperl_response_handler_cgi () from /etc/httpd/modules/mod_perl.so
#34 0xb7ef2b7d in ap_run_handler (r=0xbae277d8) at /usr/src/debug/httpd-2.2.10/server/config.c:158
#35 0xb7ef66cf in ap_invoke_handler (r=0xbae277d8) at /usr/src/debug/httpd-2.2.10/server/config.c:372
#36 0xb7f02ea1 in ap_process_request (r=0xbae277d8) at /usr/src/debug/httpd-2.2.10/modules/http/http_request.c:258
#37 0xb7effab8 in ap_process_http_connection (c=0xbae1b940) at /usr/src/debug/httpd-2.2.10/modules/http/http_core.c:190
#38 0xb7efae9d in ap_run_process_connection (c=0xbae1b940) at /usr/src/debug/httpd-2.2.10/server/connection.c:43
#39 0xb7f082d1 in child_main (child_num_arg=<value optimized out>)
    at /usr/src/debug/httpd-2.2.10/server/mpm/prefork/prefork.c:650
#40 0xb7f08599 in make_child (s=<value optimized out>, slot=0)
    at /usr/src/debug/httpd-2.2.10/server/mpm/prefork/prefork.c:690
#41 0xb7f092f0 in ap_mpm_run (_pconf=0xb9cfc5c0, plog=0xb9d2a678, s=0xb9cfe4b8)
    at /usr/src/debug/httpd-2.2.10/server/mpm/prefork/prefork.c:966
#42 0xb7edd7c9 in main (argc=-1177573960, argv=0xbfc18cb4) at /usr/src/debug/httpd-2.2.10/server/main.c:740

(when selecting a case):
Program received signal SIGSEGV, Segmentation fault.
sYSMALLOc () at malloc.c:3358
3358        set_head(remainder, remainder_size | PREV_INUSE);
 (gdb) bt
#0  sYSMALLOc () at malloc.c:3358
#1  _int_malloc (av=0x54f140, bytes=1918986097) at malloc.c:4580
#2  0x00450d5f in _int_realloc (av=0x54f140, oldmem=0xbad35f90, bytes=1918986098) at malloc.c:5035
#3  0x00451c86 in __libc_realloc (oldmem=0xbad35f90, bytes=1918986098) at malloc.c:3708
#4  0x00acb759 in Perl_safesysrealloc (where=<value optimized out>, size=1918986098) at util.c:178
#5  0x00de4362 in retrieve_hash (my_perl=0xb9c64a28, cxt=0xb948d59c, cname=0x0) at Storable.xs:5226
#6  0x00ddfafd in retrieve (my_perl=0xb9c64a28, cxt=0xb948d59c, cname=0x0) at Storable.xs:5967
#7  0x00de22a0 in retrieve_ref (my_perl=0xb9c64a28, cxt=0xb948d59c, cname=0x0) at Storable.xs:4477
#8  0x00ddfafd in retrieve (my_perl=0xb9c64a28, cxt=0xb948d59c, cname=0x0) at Storable.xs:5967
#9  0x00de48ad in retrieve_array (my_perl=0xb9c64a28, cxt=0xb948d59c, cname=0x0) at Storable.xs:5159
#10 0x00ddfafd in retrieve (my_perl=0xb9c64a28, cxt=0xb948d59c, cname=0x0) at Storable.xs:5967
#11 0x00de22a0 in retrieve_ref (my_perl=0xb9c64a28, cxt=0xb948d59c, cname=0x0) at Storable.xs:4477
#12 0x00ddfafd in retrieve (my_perl=0xb9c64a28, cxt=0xb948d59c, cname=0x0) at Storable.xs:5967
#13 0x00de42d6 in retrieve_hash (my_perl=0xb9c64a28, cxt=0xb948d59c, cname=0x0) at Storable.xs:5214
#14 0x00ddfafd in retrieve (my_perl=0xb9c64a28, cxt=0xb948d59c, cname=0x0) at Storable.xs:5967
#15 0x00de0742 in do_retrieve (my_perl=0xb9c64a28, f=0x0, in=0xbad32f1c, optype=2) at Storable.xs:6148
#16 0x00de18b4 in mretrieve () at Storable.xs:6264
#17 XS_Storable_mretrieve (my_perl=0xb9c64a28, cv=0xb94893a4) at Storable.xs:6460
#18 0x00af66f9 in Perl_pp_entersub (my_perl=0xb9c64a28) at pp_hot.c:2847
#19 0x00ab7f03 in Perl_runops_debug (my_perl=0xb9c64a28) at dump.c:1931
#20 0x00b65d0f in S_docatch (my_perl=0xb9c64a28, o=<value optimized out>) at pp_ctl.c:2679
#21 0x00ab7f03 in Perl_runops_debug (my_perl=0xb9c64a28) at dump.c:1931
#22 0x00aef64d in Perl_call_sv (my_perl=0xb9c64a28, sv=0xbac4266c, flags=<value optimized out>) at perl.c:2631
#23 0x00b93dc8 in Perl_pp_tie (my_perl=0xb9c64a28) at pp_sys.c:850
#24 0x00ab7f03 in Perl_runops_debug (my_perl=0xb9c64a28) at dump.c:1931
#25 0x00b65d0f in S_docatch (my_perl=0xb9c64a28, o=<value optimized out>) at pp_ctl.c:2679
#26 0x00b68e4d in Perl_pp_entereval (my_perl=0xb9c64a28) at pp_ctl.c:3617
#27 0x00ab7f03 in Perl_runops_debug (my_perl=0xb9c64a28) at dump.c:1931
#28 0x00aef64d in Perl_call_sv (my_perl=0xb9c64a28, sv=0xbac30874, flags=<value optimized out>) at perl.c:2631
#29 0x00b93dc8 in Perl_pp_tie (my_perl=0xb9c64a28) at pp_sys.c:850
#30 0x00ab7f03 in Perl_runops_debug (my_perl=0xb9c64a28) at dump.c:1931
#31 0x00aefa58 in Perl_call_sv (my_perl=0xb9c64a28, sv=0xb96e6084, flags=4) at perl.c:2646
#32 0x009e6da4 in modperl_callback () from /etc/httpd/modules/mod_perl.so
#33 0x009e7b3c in modperl_callback_run_handlers () from /etc/httpd/modules/mod_perl.so
#34 0x009e856a in modperl_callback_per_dir () from /etc/httpd/modules/mod_perl.so
#35 0x009df5ff in ?? () from /etc/httpd/modules/mod_perl.so
#36 0x009df7c5 in modperl_response_handler_cgi () from /etc/httpd/modules/mod_perl.so
#37 0xb7f03b7d in ap_run_handler (r=0xb98ddfe0) at /usr/src/debug/httpd-2.2.10/server/config.c:158
#38 0xb7f076cf in ap_invoke_handler (r=0xb98ddfe0) at /usr/src/debug/httpd-2.2.10/server/config.c:372
#39 0xb7f13ea1 in ap_process_request (r=0xb98ddfe0) at /usr/src/debug/httpd-2.2.10/modules/http/http_request.c:258
#40 0xb7f10ab8 in ap_process_http_connection (c=0xb98ce138) at /usr/src/debug/httpd-2.2.10/modules/http/http_core.c:190
#41 0xb7f0be9d in ap_run_process_connection (c=0xb98ce138) at /usr/src/debug/httpd-2.2.10/server/connection.c:43
#42 0xb7f192d1 in child_main (child_num_arg=<value optimized out>)
    at /usr/src/debug/httpd-2.2.10/server/mpm/prefork/prefork.c:650
#43 0xb7f19599 in make_child (s=<value optimized out>, slot=0)
    at /usr/src/debug/httpd-2.2.10/server/mpm/prefork/prefork.c:690
#44 0xb7f1a2f0 in ap_mpm_run (_pconf=0xb87ad5c0, plog=0xb87db678, s=0xb87af4b8)
---Type <return> to continue, or q <return> to quit---
    at /usr/src/debug/httpd-2.2.10/server/mpm/prefork/prefork.c:966
#45 0xb7eee7c9 in main (argc=-1199917640, argv=0xbfd2a5c4) at /usr/src/debug/httpd-2.2.10/server/main.c:740

I've also tried building a 3.8.2 from scratch using Debian-Lenny and got the same overall effect (didn't get the GDB traces from that system, but the symptoms are the same).

Paul Franson
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.bestpractical.com/pipermail/rt-users/attachments/20090127/e8c9d699/attachment.htm>