bugGluster - Bugs: bug #21736, Glusterfs client crash upon...

 
 

bug #21736: Glusterfs client crash upon execution (during poll_iteration)

Submitted by:  lorisluise <lluise>
Submitted on:  Thu 06 Dec 2007 11:33:41 AM UTC  
 
Category: GlusterFSSeverity: 3 - Normal
Priority: 5 - NormalItem Group: Crash
Status: FixedPrivacy: Public
Assigned to: Amar Tumballi <amarts>Originator Name: 
Open/Closed: ClosedRelease: 
Operating System: GNU/LinuxReproducibility: None

Add a New Comment(Rich Markup)
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Thu 06 Dec 2007 12:40:52 PM UTC, comment #1:

hi,
Thanks for submitting the bug, fixed it in patch-600. But, noticed one error (not related to this bug) in your client spec file. The "option alu.min-free-disk 5GB" is not going to work for you. Please change it to % based value, [ie, 0-100] you can also give '5%' as an option.

Regards,
Amar

Amar Tumballi <amarts>
Project MemberIn charge of this item.
Thu 06 Dec 2007 11:33:41 AM UTC, original submission:

Hello everybody,

i downloaded & compiled glusterfs 2.5 p599.
I noticed the same problem (crashing) of older patch number.
This is the log of the client.
In attachment configuration file of client and server.
I use this for start-up anything
glusterfsd --spec-file=/etc/glusterfs-server0.vol --log-file=/var/log/glusterfsd.log --log-level=DEBUG
glusterfs --spec-file=/etc/glusterfs-client.vol --log-file=/var/log/glusterfs.log --log-level=DEBUG /mnt/ftpdata

2007-12-06 12:01:35 D [glusterfs.c:141:get_spec_fp] glusterfs: loading spec from /etc/glusterfs-client.vol
2007-12-06 12:01:35 D [spec.y:117:new_section] libglusterfs/parser: New node for 'client0'
2007-12-06 12:01:35 D [spec.y:133:section_type] libglusterfs/parser: Type:client0:protocol/client
2007-12-06 12:01:35 D [xlator.c:103:xlator_set_type] libglusterfs/xlator: attempt to load type protocol/client
2007-12-06 12:01:35 D [xlator.c:110:xlator_set_type] libglusterfs/xlator: attempt to load file /usr/lib/glusterfs/1.3.8/xlator/protocol/client.so
2007-12-06 12:01:35 D [spec.y:153:section_option] libglusterfs/parser: Option:client0:transport-type:tcp/client
2007-12-06 12:01:35 D [spec.y:153:section_option] libglusterfs/parser: Option:client0:remote-host:192.168.21.11
2007-12-06 12:01:35 D [spec.y:153:section_option] libglusterfs/parser: Option:client0:remote-port:6996
2007-12-06 12:01:35 D [spec.y:153:section_option] libglusterfs/parser: Option:client0:remote-subvolume:brick
2007-12-06 12:01:35 D [spec.y:217:section_end] libglusterfs/parser: end:client0
2007-12-06 12:01:35 D [spec.y:117:new_section] libglusterfs/parser: New node for 'client0-afr'
2007-12-06 12:01:35 D [spec.y:133:section_type] libglusterfs/parser: Type:client0-afr:protocol/client
2007-12-06 12:01:35 D [xlator.c:103:xlator_set_type] libglusterfs/xlator: attempt to load type protocol/client
2007-12-06 12:01:35 D [xlator.c:110:xlator_set_type] libglusterfs/xlator: attempt to load file /usr/lib/glusterfs/1.3.8/xlator/protocol/client.so
2007-12-06 12:01:35 D [spec.y:153:section_option] libglusterfs/parser: Option:client0-afr:transport-type:tcp/client
2007-12-06 12:01:35 D [spec.y:153:section_option] libglusterfs/parser: Option:client0-afr:remote-host:192.168.21.11
2007-12-06 12:01:35 D [spec.y:153:section_option] libglusterfs/parser: Option:client0-afr:remote-port:6996
2007-12-06 12:01:35 D [spec.y:153:section_option] libglusterfs/parser: Option:client0-afr:remote-subvolume:brick-afr
2007-12-06 12:01:35 D [spec.y:217:section_end] libglusterfs/parser: end:client0-afr
2007-12-06 12:01:35 D [spec.y:117:new_section] libglusterfs/parser: New node for 'client1'
2007-12-06 12:01:35 D [spec.y:133:section_type] libglusterfs/parser: Type:client1:protocol/client
2007-12-06 12:01:35 D [xlator.c:103:xlator_set_type] libglusterfs/xlator: attempt to load type protocol/client
2007-12-06 12:01:35 D [xlator.c:110:xlator_set_type] libglusterfs/xlator: attempt to load file /usr/lib/glusterfs/1.3.8/xlator/protocol/client.so
2007-12-06 12:01:35 D [spec.y:153:section_option] libglusterfs/parser: Option:client1:transport-type:tcp/client
2007-12-06 12:01:35 D [spec.y:153:section_option] libglusterfs/parser: Option:client1:remote-host:192.168.21.12
2007-12-06 12:01:35 D [spec.y:153:section_option] libglusterfs/parser: Option:client1:remote-port:6997
2007-12-06 12:01:35 D [spec.y:153:section_option] libglusterfs/parser: Option:client1:remote-subvolume:brick
2007-12-06 12:01:35 D [spec.y:217:section_end] libglusterfs/parser: end:client1
2007-12-06 12:01:35 D [spec.y:117:new_section] libglusterfs/parser: New node for 'client1-afr'
2007-12-06 12:01:35 D [spec.y:133:section_type] libglusterfs/parser: Type:client1-afr:protocol/client
2007-12-06 12:01:35 D [xlator.c:103:xlator_set_type] libglusterfs/xlator: attempt to load type protocol/client
2007-12-06 12:01:35 D [xlator.c:110:xlator_set_type] libglusterfs/xlator: attempt to load file /usr/lib/glusterfs/1.3.8/xlator/protocol/client.so
2007-12-06 12:01:35 D [spec.y:153:section_option] libglusterfs/parser: Option:client1-afr:transport-type:tcp/client
2007-12-06 12:01:35 D [spec.y:153:section_option] libglusterfs/parser: Option:client1-afr:remote-host:192.168.21.12
2007-12-06 12:01:35 D [spec.y:153:section_option] libglusterfs/parser: Option:client1-afr:remote-port:6997
2007-12-06 12:01:35 D [spec.y:153:section_option] libglusterfs/parser: Option:client1-afr:remote-subvolume:brick-afr
2007-12-06 12:01:35 D [spec.y:217:section_end] libglusterfs/parser: end:client1-afr
2007-12-06 12:01:35 D [spec.y:117:new_section] libglusterfs/parser: New node for 'afr0'
2007-12-06 12:01:35 D [spec.y:133:section_type] libglusterfs/parser: Type:afr0:cluster/afr
2007-12-06 12:01:35 D [xlator.c:103:xlator_set_type] libglusterfs/xlator: attempt to load type cluster/afr
2007-12-06 12:01:35 D [xlator.c:110:xlator_set_type] libglusterfs/xlator: attempt to load file /usr/lib/glusterfs/1.3.8/xlator/cluster/afr.so
2007-12-06 12:01:35 D [spec.y:202:section_sub] liglusterfs/parser: child:afr0->client0
2007-12-06 12:01:35 D [spec.y:202:section_sub] liglusterfs/parser: child:afr0->client1
2007-12-06 12:01:35 D [spec.y:217:section_end] libglusterfs/parser: end:afr0
2007-12-06 12:01:35 D [spec.y:117:new_section] libglusterfs/parser: New node for 'afr1'
2007-12-06 12:01:35 D [spec.y:133:section_type] libglusterfs/parser: Type:afr1:cluster/afr
2007-12-06 12:01:35 D [xlator.c:103:xlator_set_type] libglusterfs/xlator: attempt to load type cluster/afr
2007-12-06 12:01:35 D [xlator.c:110:xlator_set_type] libglusterfs/xlator: attempt to load file /usr/lib/glusterfs/1.3.8/xlator/cluster/afr.so
2007-12-06 12:01:35 D [spec.y:202:section_sub] liglusterfs/parser: child:afr1->client0
2007-12-06 12:01:35 D [spec.y:202:section_sub] liglusterfs/parser: child:afr1->client1-afr
2007-12-06 12:01:35 D [spec.y:217:section_end] libglusterfs/parser: end:afr1
2007-12-06 12:01:35 D [spec.y:117:new_section] libglusterfs/parser: New node for 'afr2'
2007-12-06 12:01:35 D [spec.y:133:section_type] libglusterfs/parser: Type:afr2:cluster/afr
2007-12-06 12:01:35 D [xlator.c:103:xlator_set_type] libglusterfs/xlator: attempt to load type cluster/afr
2007-12-06 12:01:35 D [xlator.c:110:xlator_set_type] libglusterfs/xlator: attempt to load file /usr/lib/glusterfs/1.3.8/xlator/cluster/afr.so
2007-12-06 12:01:35 D [spec.y:202:section_sub] liglusterfs/parser: child:afr2->client1
2007-12-06 12:01:35 D [spec.y:202:section_sub] liglusterfs/parser: child:afr2->client0-afr
2007-12-06 12:01:35 D [spec.y:217:section_end] libglusterfs/parser: end:afr2
2007-12-06 12:01:35 D [spec.y:117:new_section] libglusterfs/parser: New node for 'ns1'
2007-12-06 12:01:35 D [spec.y:133:section_type] libglusterfs/parser: Type:ns1:protocol/client
2007-12-06 12:01:35 D [xlator.c:103:xlator_set_type] libglusterfs/xlator: attempt to load type protocol/client
2007-12-06 12:01:35 D [xlator.c:110:xlator_set_type] libglusterfs/xlator: attempt to load file /usr/lib/glusterfs/1.3.8/xlator/protocol/client.so
2007-12-06 12:01:35 D [spec.y:153:section_option] libglusterfs/parser: Option:ns1:transport-type:tcp/client
2007-12-06 12:01:35 D [spec.y:153:section_option] libglusterfs/parser: Option:ns1:remote-host:192.168.21.11
2007-12-06 12:01:35 D [spec.y:153:section_option] libglusterfs/parser: Option:ns1:remote-port:6996
2007-12-06 12:01:35 D [spec.y:153:section_option] libglusterfs/parser: Option:ns1:remote-subvolume:brick-ns
2007-12-06 12:01:35 D [spec.y:217:section_end] libglusterfs/parser: end:ns1
2007-12-06 12:01:35 D [spec.y:117:new_section] libglusterfs/parser: New node for 'bricks'
2007-12-06 12:01:35 D [spec.y:133:section_type] libglusterfs/parser: Type:bricks:cluster/unify
2007-12-06 12:01:35 D [xlator.c:103:xlator_set_type] libglusterfs/xlator: attempt to load type cluster/unify
2007-12-06 12:01:35 D [xlator.c:110:xlator_set_type] libglusterfs/xlator: attempt to load file /usr/lib/glusterfs/1.3.8/xlator/cluster/unify.so
2007-12-06 12:01:35 D [spec.y:202:section_sub] liglusterfs/parser: child:bricks->afr0
2007-12-06 12:01:35 D [spec.y:153:section_option] libglusterfs/parser: Option:bricks:namespace:ns1
2007-12-06 12:01:35 D [spec.y:153:section_option] libglusterfs/parser: Option:bricks:scheduler:alu
2007-12-06 12:01:35 D [spec.y:153:section_option] libglusterfs/parser: Option:bricks:alu.limits.min-free-disk:5GB
2007-12-06 12:01:35 D [spec.y:153:section_option] libglusterfs/parser: Option:bricks:alu.limits.max-open-files:10000
2007-12-06 12:01:35 D [spec.y:153:section_option] libglusterfs/parser: Option:bricks:alu.order:disk-usage:read-usage:write-usage:open-files-usage:disk-speed-usage
2007-12-06 12:01:35 D [spec.y:153:section_option] libglusterfs/parser: Option:bricks:alu.disk-usage.entry-threshold:2GB
2007-12-06 12:01:35 D [spec.y:153:section_option] libglusterfs/parser: Option:bricks:alu.disk-usage.exit-threshold:60MB
2007-12-06 12:01:35 D [spec.y:153:section_option] libglusterfs/parser: Option:bricks:alu.open-files-usage.entry-threshold:1024
2007-12-06 12:01:35 D [spec.y:153:section_option] libglusterfs/parser: Option:bricks:alu.open-files-usage.exit-threshold:32
2007-12-06 12:01:35 D [spec.y:153:section_option] libglusterfs/parser: Option:bricks:alu.stat-refresh.interval:10sec
2007-12-06 12:01:35 D [spec.y:217:section_end] libglusterfs/parser: end:bricks
2007-12-06 12:01:35 D [inode.c:1103:inode_table_new] fuse: creating new inode table with lru_limit=1024, sizeof(inode_t)=96
2007-12-06 12:01:35 D [inode.c:559:__create_inode] fuse/inode: create inode(1)
2007-12-06 12:01:35 D [inode.c:351:__active_inode] fuse/inode: activating inode(1), lru=0/1024
2007-12-06 12:01:35 D [client-protocol.c:4633:init] client0: missing 'inode-lru-limit'. defaulting to 1000
2007-12-06 12:01:35 D [client-protocol.c:4650:init] client0: defaulting transport-timeout to 108
2007-12-06 12:01:35 D [transport.c:83:transport_load] libglusterfs/transport: attempt to load type tcp/client
2007-12-06 12:01:35 D [transport.c:88:transport_load] libglusterfs/transport: attempt to load file /usr/lib/glusterfs/1.3.8/transport/tcp/client.so
2007-12-06 12:01:35 D [client-protocol.c:4677:init] client0: defaulting limits.transaction-size to 268435456
2007-12-06 12:01:35 D [client-protocol.c:4633:init] client1: missing 'inode-lru-limit'. defaulting to 1000
2007-12-06 12:01:35 D [client-protocol.c:4650:init] client1: defaulting transport-timeout to 108
2007-12-06 12:01:35 D [transport.c:83:transport_load] libglusterfs/transport: attempt to load type tcp/client
2007-12-06 12:01:35 D [transport.c:88:transport_load] libglusterfs/transport: attempt to load file /usr/lib/glusterfs/1.3.8/transport/tcp/client.so
2007-12-06 12:01:35 D [client-protocol.c:4677:init] client1: defaulting limits.transaction-size to 268435456
2007-12-06 12:01:35 D [afr.c:6242:init] afr0: self-heal is enabled (default)
2007-12-06 12:01:35 D [afr.c:6270:init] afr0: (default) reads will be scheduled between the children
2007-12-06 12:01:35 D [unify.c:4152:init] bricks: namespace node specified as ns1
2007-12-06 12:01:35 D [scheduler.c:36:get_scheduler] libglusterfs/scheduler: attempt to load file alu.so

2007-12-06 12:01:35 D [unify.c:4170:init] bricks: Child node count is 1
2007-12-06 12:01:35 D [alu.c:146:alu_init] scheduler/alu: alu_init: order string: disk-usage
2007-12-06 12:01:35 D [alu.c:178:alu_init] scheduler/alu: alu_init: = 2147483648,62914560
2007-12-06 12:01:35 D [alu.c:146:alu_init] scheduler/alu: alu_init: order string: read-usage
2007-12-06 12:01:35 D [alu.c:248:alu_init] scheduler/alu: alu_init: = 25,5
2007-12-06 12:01:35 D [alu.c:146:alu_init] scheduler/alu: alu_init: order string: write-usage
2007-12-06 12:01:35 D [alu.c:213:alu_init] scheduler/alu: alu_init: = 25,5
2007-12-06 12:01:35 D [alu.c:146:alu_init] scheduler/alu: alu_init: order string: open-files-usage
2007-12-06 12:01:35 D [alu.c:281:alu_init] alu: alu.c->alu_init: = 1024,0

2007-12-06 12:01:35 D [alu.c:146:alu_init] scheduler/alu: alu_init: order string: disk-speed-usage
2007-12-06 12:01:35 D [alu.c:345:alu_init] scheduler/alu: alu.limit.min-disk-free = 5368709120
2007-12-06 12:01:35 D [alu.c:361:alu_init] scheduler/alu: alu_init: limit.max-open-files = 10000
2007-12-06 12:01:35 D [client-protocol.c:4633:init] ns1: missing 'inode-lru-limit'. defaulting to 1000
2007-12-06 12:01:35 D [client-protocol.c:4650:init] ns1: defaulting transport-timeout to 108
2007-12-06 12:01:35 D [transport.c:83:transport_load] libglusterfs/transport: attempt to load type tcp/client
2007-12-06 12:01:35 D [transport.c:88:transport_load] libglusterfs/transport: attempt to load file /usr/lib/glusterfs/1.3.8/transport/tcp/client.so
2007-12-06 12:01:35 D [client-protocol.c:4677:init] ns1: defaulting limits.transaction-size to 268435456
2007-12-06 12:01:35 D [client-protocol.c:4942:notify] ns1: got GF_EVENT_PARENT_UP, attempting connect on transport
2007-12-06 12:01:35 D [client-protocol.c:4942:notify] ns1: got GF_EVENT_PARENT_UP, attempting connect on transport
2007-12-06 12:01:35 D [client-protocol.c:4942:notify] client0: got GF_EVENT_PARENT_UP, attempting connect on transport
2007-12-06 12:01:35 D [client-protocol.c:4942:notify] client1: got GF_EVENT_PARENT_UP, attempting connect on transport
2007-12-06 12:01:35 D [client-protocol.c:4377:client_protocol_reconnect] ns1: attempting reconnect
2007-12-06 12:01:35 D [tcp-client.c:70:tcp_connect] ns1: socket fd = 6
2007-12-06 12:01:35 D [tcp-client.c:88:tcp_connect] ns1: finalized on port `1023'
2007-12-06 12:01:35 D [common-utils.c:165:gf_resolve_ip] resolver: DNS cache not present, freshly probing hostname: 192.168.21.11
2007-12-06 12:01:35 D [common-utils.c:190:gf_resolve_ip] resolver: returning IP:192.168.21.11[0] for hostname: 192.168.21.11
2007-12-06 12:01:35 D [common-utils.c:198:gf_resolve_ip] resolver: flushing DNS cache
2007-12-06 12:01:35 D [tcp-client.c:142:tcp_connect] ns1: connect on 6 in progress (non-blocking)
2007-12-06 12:01:35 D [tcp-client.c:186:tcp_connect] ns1: connection on 6 success
2007-12-06 12:01:35 D [client-protocol.c:4964:notify] ns1: got GF_EVENT_CHILD_UP
2007-12-06 12:01:35 D [client-protocol.c:4377:client_protocol_reconnect] client0: attempting reconnect
2007-12-06 12:01:35 D [tcp-client.c:70:tcp_connect] client0: socket fd = 7
2007-12-06 12:01:35 D [tcp-client.c:88:tcp_connect] client0: finalized on port `1022'
2007-12-06 12:01:35 D [common-utils.c:165:gf_resolve_ip] resolver: DNS cache not present, freshly probing hostname: 192.168.21.11
2007-12-06 12:01:35 D [common-utils.c:190:gf_resolve_ip] resolver: returning IP:192.168.21.11[0] for hostname: 192.168.21.11
2007-12-06 12:01:35 D [common-utils.c:198:gf_resolve_ip] resolver: flushing DNS cache
2007-12-06 12:01:35 D [tcp-client.c:142:tcp_connect] client0: connect on 7 in progress (non-blocking)
2007-12-06 12:01:35 D [tcp-client.c:186:tcp_connect] client0: connection on 7 success
2007-12-06 12:01:35 D [client-protocol.c:4964:notify] client0: got GF_EVENT_CHILD_UP
2007-12-06 12:01:35 D [client-protocol.c:4377:client_protocol_reconnect] client1: attempting reconnect
2007-12-06 12:01:35 D [tcp-client.c:70:tcp_connect] client1: socket fd = 8
2007-12-06 12:01:35 D [tcp-client.c:88:tcp_connect] client1: finalized on port `1021'
2007-12-06 12:01:35 D [common-utils.c:165:gf_resolve_ip] resolver: DNS cache not present, freshly probing hostname: 192.168.21.12
2007-12-06 12:01:35 D [common-utils.c:190:gf_resolve_ip] resolver: returning IP:192.168.21.12[0] for hostname: 192.168.21.12
2007-12-06 12:01:35 D [common-utils.c:198:gf_resolve_ip] resolver: flushing DNS cache
2007-12-06 12:01:35 D [tcp-client.c:142:tcp_connect] client1: connect on 8 in progress (non-blocking)
2007-12-06 12:01:35 D [client-protocol.c:4722:client_protocol_handshake_reply] ns1: reply frame has callid: 424242
2007-12-06 12:01:35 D [client-protocol.c:4756:client_protocol_handshake_reply] ns1: SETVOLUME on remote-host succeeded
2007-12-06 12:01:35 D [client-protocol.c:4722:client_protocol_handshake_reply] client0: reply frame has callid: 424242
2007-12-06 12:01:35 D [client-protocol.c:4756:client_protocol_handshake_reply] client0: SETVOLUME on remote-host succeeded
2007-12-06 12:01:35 D [tcp-client.c:186:tcp_connect] client1: connection on 8 success
2007-12-06 12:01:35 D [client-protocol.c:4964:notify] client1: got GF_EVENT_CHILD_UP

---------
got signal (11), printing backtrace
---------
[0xffffe420]
/usr/lib/glusterfs/1.3.8/xlator/protocol/client.so(notify+0x7ef)[0xb753e5bf]
/usr/lib/libglusterfs.so.0(transport_notify+0x37)[0xb7ed62c7]
/usr/lib/libglusterfs.so.0(sys_epoll_iteration+0xf3)[0xb7ed7023]
/usr/lib/libglusterfs.so.0(poll_iteration+0x7c)[0xb7ed63fc]
[glusterfs](main+0x43e)[0x804a88e]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xdc)[0xb7d6f8cc]
[glusterfs][0x804a3c1]
---------

lorisluise <lluise>

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

Attached Files
file #14573:  glusterfs-client.vol added by lluise (3KiB - application/octet-stream)
file #14574:  glusterfs-server0.vol added by lluise (1KiB - application/octet-stream)
file #14575:  glusterfs.log added by lluise (16KiB - text/x-log)

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by amarts (Posted a comment)
  • -unavailable- added by lluise (Submitted the item)
  •  

    Do you think this task is very important?
    If so, you can click here to add your encouragement to it.
    This task has 0 encouragements so far.

    Only logged-in users can vote.

     

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    Follow 6 latest changes.

    Date Changed By Updated Field Previous Value => Replaced By
    Thu 06 Dec 2007 12:40:52 PM UTCamartsOpen/ClosedOpen=>Closed
    Thu 06 Dec 2007 12:40:51 PM UTCamartsStatusNone=>Fixed
      Assigned toNone=>amarts
    Thu 06 Dec 2007 11:33:41 AM UTClluiseAttached File-=>Added glusterfs-client.vol, #14573
      Attached File-=>Added glusterfs-server0.vol, #14574
      Attached File-=>Added glusterfs.log, #14575

    Back to the top


    Powered by Savane 3.1-cleanup1